Skip to content

Normalize ZeRO-3 DeepCompile grad dtype before reduction - #8038

Merged
tohtana merged 3 commits into
deepspeedai:masterfrom
tohtana:tohtana/fix/deepcompile-zero3-grad-dtype-buckets
Jun 9, 2026
Merged

tohtana merged 3 commits into
deepspeedai:masterfrom
tohtana:tohtana/fix/deepcompile-zero3-grad-dtype-buckets