Skip to content

serve: llama-server-style timings on responses (prefill/decode rates for llama-swap & friends) - #83

Closed
mikicvi wants to merge 2 commits into
Niko1221:mainfrom
mikicvi:llama-timings
Closed

serve: llama-server-style timings on responses (prefill/decode rates for llama-swap & friends)#83
mikicvi wants to merge 2 commits into
Niko1221:mainfrom
mikicvi:llama-timings

Commits

  1. Commits on Sep 28, 2026

  2. Commits on Sep 29, 2026