Skip to content

Add engine.coalesce_grad_reduction() for ZeRO 1/2/3 multi-backward - #7992

Merged
tohtana merged 8 commits into
deepspeedai:masterfrom
roycho96:feat/zero-coalesce-grad-reduction
May 28, 2026
Merged

tohtana merged 8 commits into
deepspeedai:masterfrom
roycho96:feat/zero-coalesce-grad-reduction