Add AutoEP - #7938

Merged

tohtana merged 93 commits into

deepspeedai:masterfrom

tohtana:tohtana/add_autoep

Jun 11, 2026

Commits on Feb 7, 2026

add autoep
Masahiro Tanaka
committed
bea50ef
add checkpointing
Masahiro Tanaka
committed
2c041db
fix format
Masahiro Tanaka
committed
c2a89bc

Commits on Feb 8, 2026

add custom patterns
Masahiro Tanaka
committed
fd07c93

Commits on Feb 9, 2026

fix optimizer resumption
Masahiro Tanaka
committed
cabfebc

Commits on Feb 13, 2026

autoep: fix post-dispatch local expert permutation grouping
Masahiro Tanaka
committed
a2ab10d

Commits on Mar 31, 2026

Merge branch 'master' into tohtana/add_autoep
Masahiro Tanaka
committed
e79c2e8

Commits on Apr 1, 2026

fix(autoep): restore ep_count helper
Masahiro Tanaka
committed
046db04
test(autoep): make checkpoint tests cpu-safe
Masahiro Tanaka
committed
71a0a36

Commits on Apr 3, 2026

Fix AutoEP ZeRO-2 expert gradient scaling
Masahiro Tanaka
committed
fae0276

Commits on Apr 5, 2026

fix(autoep): preserve manual backward parity
Masahiro Tanaka
committed
5f7dc1e

Commits on Apr 10, 2026

fix(autoep): align combine path with grouped-mm baseline
Masahiro Tanaka
committed
90f86c7

Commits on Apr 11, 2026

feat(autoep): add selectable combine implementations
Masahiro Tanaka
committed
b207c5e
Merge branch 'master' into tohtana/add_autoep
tohtana
authored
0e872cc

Commits on Apr 16, 2026

Merge branch 'master' into tohtana/add_autoep
tohtana
authored
6b65486
test(autoep): update combine_from_routed calls
Masahiro Tanaka
committed
2c873a9
fix(autoep): support llama4 fused experts
Masahiro Tanaka
committed
240495c

Commits on Apr 29, 2026

fix(autoep): match llama4 moe parity contract
Masahiro Tanaka
committed
3d49fbf
fix(autoep): match qwen moe shared expert parity
Masahiro Tanaka
committed
424e38b

Commits on Apr 30, 2026

Add AutoEP license attribution notices
Masahiro Tanaka
committed
851c284

Commits on May 1, 2026

Support Qwen3.5 MoE AutoEP router capture
Masahiro Tanaka
committed
611645d

Commits on May 9, 2026

Merge branch 'master' into tohtana/add_autoep
tohtana
authored
8820caf
test(autoep): include qwen3.5 preset in coverage check
Masahiro Tanaka
committed
3212fda

Commits on May 12, 2026

Merge branch 'master' into tohtana/add_autoep
tohtana
authored
5af8e41

Commits on May 13, 2026

AutoEP: remove grouped_mm_backend surface
Masahiro Tanaka
committed
00aecdd
AutoEP: align supported presets and Qwen3.5 guard
Masahiro Tanaka
committed
71a903d
AutoEP: document Universal Checkpointing support
Masahiro Tanaka
committed
b59d3d4
AutoEP: fix Universal Checkpoint load path
Masahiro Tanaka
committed
1104084
AutoEP: guard selected preset detection
Masahiro Tanaka
committed
6aac593
AutoEP: document Transformers preset compatibility
Masahiro Tanaka
committed
bbed716
AutoEP: fix DeepSeek forward parity
Masahiro Tanaka
committed
c1d7684
AutoEP: move DeepSeek bias guards into specs
Masahiro Tanaka
committed
a1cdc2f
Merge pull request #8 from tohtana/codex/autoep-pr7938-remove-grouped-mm-backend
tohtana
authored
9268c5e
docs: clarify AutoEP native MoE checkpoint compatibility
Masahiro Tanaka
committed
376cc09
AutoEP: delegate preset-specific parser behavior
Masahiro Tanaka
committed
1773510
Merge pull request #12 from tohtana/codex/autoep-pr7938-deepseek-forward-parity
tohtana
authored
9592ed3
docs: integrate AutoEP universal checkpointing flow
Masahiro Tanaka
committed
3e73c96
docs: place AutoEP requirements after universal checkpoint steps
Masahiro Tanaka
committed
7012927
AutoEP: align preset compatibility guard
Masahiro Tanaka
committed
489d4bf
AutoEP: map Qwen2 model type to Qwen3 preset
Masahiro Tanaka
committed
52d32d2
Merge pull request #9 from tohtana/codex/autoep-pr7938-supported-presets-guard
tohtana
authored
c1ec90c
Merge remote-tracking branch 'origin/codex/autoep-pr7938-staging' into codex/autoep-pr7938-universal-checkpoint-docs
Masahiro Tanaka
committed
ba6f6c2
docs: distinguish AutoEP from DeepSpeed MoE docs
Masahiro Tanaka
committed
8432aa3
Merge pull request #10 from tohtana/codex/autoep-pr7938-universal-checkpoint-docs
tohtana
authored
a6183d9
Merge pull request #11 from tohtana/codex/autoep-pr7938-universal-load-path
tohtana
authored
83f9261
Merge AutoEP staging branch
Masahiro Tanaka
committed
e463cdf
Refactor AutoEP presets into registry package
Masahiro Tanaka
committed
fad3058
Disable unsupported AutoEP expert bias
Masahiro Tanaka
committed
e08859c
Address AutoEP preset registry review findings
Masahiro Tanaka
committed
da8074d
Merge pull request #14 from tohtana/codex/disable-autoep-load-balance-expert-bias
tohtana
authored
2b4e804
Merge AutoEP staging expert-bias guard
Masahiro Tanaka
committed
224ec82
Merge pull request #13 from tohtana/codex/autoep-pr7938-preset-registry-refactor
tohtana
authored
9d920fe
AutoEP: resolve routed scaling factor
Masahiro Tanaka
committed
068b59e
Merge pull request #15 from tohtana/codex/autoep-pr7938-routed-scaling-factor
tohtana
authored
968ff9c
AutoEP: skip AutoEP subtrees in AutoTP traversal
Masahiro Tanaka
committed
5bb7482
Merge pull request #16 from tohtana/codex/autoep-pr7938-autotp-subtree-skip
tohtana
authored
2d17f30
AutoEP: use sequential experts in CPU tests
Masahiro Tanaka
committed
8d43053
Fix AutoEP review regressions
Masahiro Tanaka
committed
f8ff765
Merge pull request #17 from tohtana/codex/autoep-pr7938-review-fixes
tohtana
authored
e6ed426

Commits on May 14, 2026

Fix AutoEP PR7938 review follow-ups
Masahiro Tanaka
committed
9facfd5
Fix AutoEP HF output recorder retargeting
Masahiro Tanaka
committed
c019aff
Merge pull request #18 from tohtana/tohtana/autoep-pr7938-final-review-followups
tohtana
authored
f9b9026
Merge upstream master for AutoEP review cleanups
Masahiro Tanaka
committed
f75f958
AutoEP: support DeepSeek-V3 remote-code layout
Masahiro Tanaka
committed
da375f4
Merge pull request #19 from tohtana/codex/autoep-deepseek-v3-remote-code-layout
tohtana
authored
9d8c4a5
Fix AutoEP review cleanups
Masahiro Tanaka
committed
85ff3cc
Merge pull request #20 from tohtana/tohtana/autoep-pr7938-review-cleanups
tohtana
authored
58460d6
Fix AutoEP PR 7938 review findings
Masahiro Tanaka
committed
a2f706e
Fix AutoEP review followups
Masahiro Tanaka
committed
da2f121
Trim AutoEP PR follow-up tests
Masahiro Tanaka
committed
6823e31
Merge pull request #21 from tohtana/codex/autoep-pr7938-review-findings
tohtana
authored
6cf1797
tests/moe: compact autoep regression suite
Masahiro Tanaka
committed
89082cd
Merge pull request #22 from tohtana/tohtana/reduce-autoep-test-code
tohtana
authored
ff4ebf1
Remove AutoEP backward loss multiplier
Masahiro Tanaka
committed
a05f092
Use active MPU for AutoEP sequence-parallel size
Masahiro Tanaka
committed
71077a5
Merge pull request #23 from tohtana/tohtana/remove-autoep-loss-multiplier
tohtana
authored
045b061
Merge pull request #24 from tohtana/tohtana/fix-autoep-sp-size-before-groups-mpu
tohtana
authored
04b8abd

Commits on May 18, 2026

Commits on May 19, 2026

Fix AutoEP + Muon compatibility for batched expert tensors
delock
committed
00edd29
Merge AutoEP Muon fixes
Masahiro Tanaka
committed
ea73adc

Commits on May 20, 2026

Merge branch 'master' into tohtana/add_autoep
tohtana
authored
61f3dca

Commits on May 21, 2026

Merge branch 'master' into tohtana/add_autoep
tohtana
authored
827b633
Preserve AutoEP requires_grad flags
Masahiro Tanaka
committed
71205e3
Preserve AutoEP replacement dtype and device
Masahiro Tanaka
committed
b2e23a8
Format AutoEP dtype device test
Masahiro Tanaka
committed
31c4bd4

Commits on Jun 11, 2026

Address AutoEP review feedback
Masahiro Tanaka
committed
ae351e7
Merge branch 'master' into tohtana/add_autoep
tohtana
authored
be534f4
Update AutoEP docs and supported presets
Masahiro Tanaka
committed
de8da26
Clarify DeepSpeed MoE docs intro
Masahiro Tanaka
committed
2938a6b
docs: clarify DeepSpeed MoE see also link
Masahiro Tanaka
committed
6b9ef4b