Skip to content

cpu kernels: gathered decode on the cores where it is faster, AVX-VNNI rows, IQ3_S one-token kernel - #863

Closed
Hardin22 wants to merge 3 commits into
Niko1221:mainfrom
Hardin22:pr/cpu-iq-kernels
Closed

cpu kernels: gathered decode on the cores where it is faster, AVX-VNNI rows, IQ3_S one-token kernel#863
Hardin22 wants to merge 3 commits into
Niko1221:mainfrom
Hardin22:pr/cpu-iq-kernels

native experts: IQ3_S takes the AVX-2 kernel for one token too where …

695a75b
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs