Skip to content

bench: IQ4_XS on a 64 GB PC - pinned arena vs experts.bin mmap vs the RAM budget - #416

Closed
pipeob0 wants to merge 497 commits into
Niko1221:mainfrom
pipeob0:gh/bench-iq4xs-64gb
Closed

pipeob0 wants to merge 497 commits into
Niko1221:mainfrom
pipeob0:gh/bench-iq4xs-64gb

the prefetch finding is measured warm only: a cold run reading 1.3 GB…

2067e70
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs