hw-gate: q8_0 KV cache rows, the add-on fa-decode q8 check, and the GPU token - #484

hw-gate: q8_0 KV cache rows, the add-on fa-decode q8 check, and the GPU token#484

bong-water-water-bong merged 2 commits into

main1bit-MONSTER/engine:mainfrom

1bit/hw-gate-mixed-kv1bit-MONSTER/engine:1bit/hw-gate-mixed-kvCopy head branch name to clipboard