Skip to content

npu: multi-prompt prefix cache, resumes from the longest saved prompt (#650) - #738

Merged
bong-water-water-bong merged 1 commit into
1bit/npu-json-schemafrom
1bit/npu-prefix-cache
Nov 1, 2026
Merged

npu: multi-prompt prefix cache, resumes from the longest saved prompt (#650)#738
bong-water-water-bong merged 1 commit into
1bit/npu-json-schemafrom
1bit/npu-prefix-cache

Commits

  1. Commits on Nov 1, 2026