Skip to content

decode: batch the verify window's per-token kernels (bit-identical, +~10% decode) - #109

Merged
Niko1221 merged 1 commit into
Niko1221:mainfrom
q8atnight:pr/decode-batch
Sep 29, 2026
Merged

Niko1221 merged 1 commit into
Niko1221:mainfrom
q8atnight:pr/decode-batch

decode: batch the verify window's per-token kernels (bit-identical); …

1e4515c
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs