Skip to content

server: expose speculative decoding counters in Prometheus metrics - #23328

Closed
boxcee wants to merge 1 commit into
ggml-org:masterfrom
boxcee:feat/prometheus-spec-metrics
Closed

server: expose speculative decoding counters in Prometheus metrics#23328
boxcee wants to merge 1 commit into
ggml-org:masterfrom
boxcee:feat/prometheus-spec-metrics

server: expose speculative decoding counters in Prometheus metrics

122fb87
Select commit
Loading
Failed to load commit list.
Sign in for the full log view

The logs for this run have expired and are no longer available.