Skip to content

Fix ZeRO-1/2 CPU-offloaded gradient loss with multiple backward() per step - #7981

Merged
delock merged 2 commits into
deepspeedai:masterfrom
roycho96:fix/zero2-offload-ga1-multi-backward
Apr 22, 2026
Merged

Fix ZeRO-1/2 CPU-offloaded gradient loss with multiple backward() per step#7981
delock merged 2 commits into
deepspeedai:masterfrom
roycho96:fix/zero2-offload-ga1-multi-backward

Commits

Commits on Apr 20, 2026

Commits on Apr 21, 2026