Repository navigation

perf(cuda): fused decode/verify/MTP kernels and graph launch reductions on 0.1.39 - #783

Closed

stuchapin909 wants to merge 5 commits into

Niko1221:mainfrom

stuchapin909:perf/cuda-decode-wave2-6

Closed

perf(cuda): fused decode/verify/MTP kernels and graph launch reductions on 0.1.39#783
stuchapin909 wants to merge 5 commits into
Niko1221:mainfrom
stuchapin909:perf/cuda-decode-wave2-6

Commits on Oct 4, 2026
- perf(cuda): multi-token GR/RMSNorm/post-op kernels and exact-T specializations
  
  stuchapin909
  authored and
  root
  committed
  d18d8b7
- perf(cuda): IQ/MMVQ sub-warp & 2-row kernels and MoE/shared-expert fusions
  
  stuchapin909
  authored and
  root
  committed
  a46daec
- perf(cuda): batched KV append, QSA indexer/RoPE fusion, and parallel resident_plan
  
  stuchapin909
  authored and
  root
  committed
  b7222cc
- perf(core): wire multi-token kernels into Verifier and MtpDrafter CUDA graphs
  
  stuchapin909
  authored and
  root
  committed
  4327807
Commits on Oct 5, 2026
- style: normalise the 23 source files back to LF, and pin it in .gitattributes
  
  root
  authored and
  root
  committed
  a748042