Skip to content

fix: guard softmax_offset.grad.zero_() by is_training - #3389

Open
andrewwhitecdw wants to merge 1 commit into
NVIDIA:mainfrom
andrewwhitecdw:bugfix/run-attention-with-cp-guard-softmax-offset-grad-zero-by-is
Open

fix: guard softmax_offset.grad.zero_() by is_training#3389
andrewwhitecdw wants to merge 1 commit into
NVIDIA:mainfrom
andrewwhitecdw:bugfix/run-attention-with-cp-guard-softmax-offset-grad-zero-by-is

fix: guard softmax_offset.grad.zero_() by is_training

516c4fe
Select commit
Loading
Failed to load commit list.
DCO / DCO succeeded Aug 17, 2026 in 1s

DCO

All commits are signed off!

View more details on DCO