[AutoTP] Enable HF `colwise_gather_output` to support `lm_head` replace - #8146

Merged

delock merged 12 commits into

deepspeedai:masterfrom

jinyouzhi:lm_head_colwise

Jul 29, 2026

Commits on Jul 16, 2026

Implement gathered column parallelism support and enhance AutoTP configuration(`colwise_gather_output`/`colwise_rep`)
jinyouzhi
committed
18e7227
Enhance AutoTP logging for lm_head diagnostics and improve HuggingFace tp_plan extraction logic
jinyouzhi
committed
4a45694
Refactor AutoTP gathered column tie handling and update related tests for fallback behavior
jinyouzhi
committed
0e2a0c2
fix the AttributeError for _gathered_column_tie_fallbacks_configured
jinyouzhi
committed
02b214c
handle uneven gathered lm_head shards
jinyouzhi
committed
c63d2d4

Commits on Jul 23, 2026

fix pattern
jinyouzhi
committed
bca340e
fix code style
jinyouzhi
committed
da9d0db
Merge remote-tracking branch 'origin/master' into HEAD
jinyouzhi
committed
fdfce90
add ut for uneven vocab slice
jinyouzhi
committed
afc886f

Commits on Jul 25, 2026

Merge branch 'master' into lm_head_colwise
delock
authored
5f982d6

Commits on Jul 27, 2026

Merge branch 'master' into lm_head_colwise
delock
authored
e377fef

Commits on Jul 29, 2026

Merge branch 'master' into lm_head_colwise
jinyouzhi
authored
90edcf2