Skip to content

refill: improve multi-GPU processing speed ~27% PP improvement on 4× RTX 3060 - #598

Closed
hash13 wants to merge 1 commit into
Niko1221:mainfrom
hash13:prefill-parallel
Closed

refill: improve multi-GPU processing speed ~27% PP improvement on 4× RTX 3060#598
hash13 wants to merge 1 commit into
Niko1221:mainfrom
hash13:prefill-parallel

Commits

  1. Commits on Oct 3, 2026