Skip to content

Pipelined windows over the active slots (+ slot allocator), /metrics for Prometheus (vLLM names) + monitoring kit - #793

Closed
blange48 wants to merge 851 commits into
Niko1221:mainfrom
blange48:upstream-metrics-autoconfig
Closed

Pipelined windows over the active slots (+ slot allocator), /metrics for Prometheus (vLLM names) + monitoring kit#793
blange48 wants to merge 851 commits into
Niko1221:mainfrom
blange48:upstream-metrics-autoconfig

serve: pipelined groups are filled from their first slot (no leading …

81fcc9e
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs