Repository navigation

serve: report prefix reuse as usage.prompt_tokens_details.cached_tokens - #114

Closed

Yunado wants to merge 1 commit into

Niko1221:mainfrom

Yunado:feat/serve-cached-tokens

Closed

serve: report prefix reuse as usage.prompt_tokens_details.cached_tokens#114
Yunado wants to merge 1 commit into
Niko1221:mainfrom
Yunado:feat/serve-cached-tokens

Commits on Sep 29, 2026
- serve: report prefix reuse as usage.prompt_tokens_details.cached_tokens
  Yunado
  committed
  e5c3d65