Skip to content

llama : use n_swa + n_ubatch cells for SWA cache - #13833

Merged
ggerganov merged 2 commits into
masterfrom
gg/swa-optimize
May 31, 2025
Merged

llama : use n_swa + n_ubatch cells for SWA cache#13833
ggerganov merged 2 commits into
masterfrom
gg/swa-optimize

Commits

  1. Commits on May 31, 2025