Repository navigation

[Engine] OpenAI logprobs / top_logprobs / allowed_token_ids for the CUDA/HIP engine - #3200

Closed

xiezhipeng-git wants to merge 17 commits into

Niko1221:mainfrom

xiezhipeng-git:feat/openai-logprobs

Closed

[Engine] OpenAI logprobs / top_logprobs / allowed_token_ids for the CUDA/HIP engine#3200
xiezhipeng-git wants to merge 17 commits into
Niko1221:mainfrom
xiezhipeng-git:feat/openai-logprobs

Commits on Oct 19, 2026
- OpenAI logprobs / top_logprobs / allowed_token_ids for the CUDA/HIP engine
  xiezhipeng-git
  committed
  104becf
Commits on Oct 22, 2026
- serve: logprobs lines belong to the request that asked for them; bounded replies; unreadable LP lines skipped
  
  leonardomurillo
  authored and
  xiezhipeng-git
  committed
  a4349ec
- serve: allowed_token_ids keeps the token when no named id survives the filter
  xiezhipeng-git
  committed
  900a5b8
- docs: logprobs on the chat API: the keys, the cap, and what allowed_token_ids does
  xiezhipeng-git
  committed
  597571c
- engine: allowed_token_ids: keep the list the request named
  
  xiezhipeng-git
  authored and
  trae-solo-agent
  committed
  22fe518
- serve: logprobs are refused on the --parallel / --batch path
  
  xiezhipeng-git
  authored and
  trae-solo-agent
  committed
  b55e9fd
- serve: an allowed_token_ids id past the vocabulary is a 400
  
  xiezhipeng-git
  authored and
  trae-solo-agent
  committed
  26a2d48
Commits on Oct 25, 2026
Commits on Oct 26, 2026
- [Engine] allocate verifier logprobs buffers at startup
  envy-ai
  committed
  7265fc7
Commits on Oct 27, 2026
- [Engine] score generated token logprobs on GPU (#2)
  xiezhipeng-git
  authored
  3b6145f