server: a KV handoff records its cells as an in-place checkpoint, so the decoder stops re-processing the prompt (engine#941) - #189

server: a KV handoff records its cells as an in-place checkpoint, so the decoder stops re-processing the prompt (engine#941)#189

bong-water-water-bong merged 1 commit into

1bit/hrx-vulkan-patched1bit-MONSTER/llama.cpp:1bit/hrx-vulkan-patchedfrom

1bit/941-inplace-checkpoint1bit-MONSTER/llama.cpp:1bit/941-inplace-checkpointCopy head branch name to clipboard