Repository navigation

Throughput improvement for small batch sizes - #17342

Open

uttampc1 wants to merge 1 commit into

ggml-org:masterfrom

uttampc1:core-scaling-opt

Open

Throughput improvement for small batch sizes#17342
uttampc1 wants to merge 1 commit into
ggml-org:masterfrom
uttampc1:core-scaling-opt

Commits on Nov 17, 2025
- Keep barrier at the end of loop to synchronise threads reducing cache-line contention (cache HITM)
  uttampc1
  committed
  e516cd0