Skip to content

CUDA backend: 3-bit uniform KV cache (turbo3, 4.6x compression, 96% f16 speed) - #15

Closed
nalditopr wants to merge 95 commits into
TheTom:feature/turboquant-kv-cachefrom
nalditopr:feature/tq3-reference-approach
Closed

CUDA backend: 3-bit uniform KV cache (turbo3, 4.6x compression, 96% f16 speed)#15
nalditopr wants to merge 95 commits into
TheTom:feature/turboquant-kv-cachefrom
nalditopr:feature/tq3-reference-approach

Revert "Implement full TurboQuant paper algorithm (WHT128 + Lloyd-Max…

e0a96b6
Select commit
Loading
Failed to load commit list.
Sign in for the full log view

The logs for this run have expired and are no longer available.