Skip to content

1bit serve --prefill-device hrx: prompt prefill on HRX, decode on Vulkan, one shared KV cache (zero copy) - #30

Merged
bong-water-water-bong merged 1 commit into
mainfrom
hrx-prefill-split
Sep 24, 2026
Merged

bong-water-water-bong merged 1 commit into
mainfrom
hrx-prefill-split

1bit serve --prefill-device hrx: prompt prefill on HRX, decode on Vul…

ca2c8cc
Select commit
Loading
Failed to load commit list.
Sign in for the full log view

Annotations

1 warning
build
succeeded Sep 24, 2026 in 1m 1s