Skip to content

[feat] [speculative] implement pipelined self-speculative decoding for looped transformers - #121

Merged
bjf-frz merged 14 commits into
InferMatrixLab:mainfrom
cs-ai-li:feat/pipelined-speculative-decoding
Oct 27, 2026
Merged

bjf-frz merged 14 commits into
InferMatrixLab:mainfrom
cs-ai-li:feat/pipelined-speculative-decoding

feat(speculative): implement device-resident asynchronous token pipeline

483c10e
Select commit
Loading
Failed to load commit list.
Sign in for the full log view

Annotations

1 warning and 1 notice
lint and CPU unit tests
succeeded Oct 27, 2026 in 2m 17s