Skip to content

CUDA: fuse FFN gate/up matmuls and GLU in MMQ with interleaved gate/up rows - #29948

Merged
ggerganov merged 14 commits into
ggml-org:masterfrom
anujj:cuda-mmq-fused-gate-up-interleaved
Oct 25, 2026
Merged

ggerganov merged 14 commits into
ggml-org:masterfrom
anujj:cuda-mmq-fused-gate-up-interleaved

Commits

  1. Commits on Oct 20, 2026

  2. Commits on Oct 24, 2026