Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
32 commits
Select commit Hold shift + click to select a range
815cb99
improve device grouped linear
zhongbozhu Jul 20, 2026
649155b
proper support for grouped bias
zhongbozhu Jul 21, 2026
1e8cda9
[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot] Jul 21, 2026
6842f03
fixes and improvements
zhongbozhu Jul 28, 2026
e5090c4
fix unit test failure
zhongbozhu Jul 23, 2026
2369d11
fix group linear UT
zhongbozhu Jul 23, 2026
b781f84
fix group mlp UT by disabling wrong fallback
zhongbozhu Jul 23, 2026
58f3512
[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot] Jul 23, 2026
66aae6e
lint
zhongbozhu Jul 23, 2026
1e4b695
fix CI errors
zhongbozhu Aug 5, 2026
28d570a
rename toggle resolve comments
zhongbozhu Jul 25, 2026
79d4de6
[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot] Jul 25, 2026
90e0ad9
don't always set optimize_for_gemm=True
zhongbozhu Jul 25, 2026
a17aac4
test other fp8 recipes on hopper
zhongbozhu Jul 25, 2026
3e91d01
fix test failure
zhongbozhu Jul 25, 2026
5a2a308
relax atol for bf16 sum errors
zhongbozhu Jul 25, 2026
dd31cd6
fix CI
zhongbozhu Jul 28, 2026
de59aae
continue to fix edge cases
zhongbozhu Jul 28, 2026
4f85d44
unify grouped tensor check
zhongbozhu Jul 28, 2026
92a9d6b
special case handling for all empty moe inputs for fp8 CS
zhongbozhu Jul 28, 2026
d1b34aa
add another specific case guard
zhongbozhu Jul 29, 2026
0a7bb60
fix cublas setup meta data issue for empty inputs
zhongbozhu Jul 31, 2026
4e38f4b
mcore integration fixes
zhongbozhu Aug 1, 2026
657bdfb
chore fix after rebase
zhongbozhu Aug 6, 2026
ddddc3f
chore
zhongbozhu Aug 6, 2026
5a948af
chore fix after rebase
zhongbozhu Aug 7, 2026
2657448
resolve comments, enable save original input
zhongbozhu Aug 7, 2026
15c4c99
fix cudnn version gurad
vthumbe1503 Aug 7, 2026
b1a8d52
comments
zhongbozhu Aug 8, 2026
0e04634
Merge branch 'main' into improve_device_grouped_linear
vthumbe1503 Aug 11, 2026
fafb041
update benchmark script
zhongbozhu Aug 12, 2026
ab6c175
[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot] Aug 12, 2026
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Original file line number Diff line number Diff line change
Expand Up @@ -13,21 +13,21 @@

Example:

python benchmarks/linear/benchmark_graph_safe_grouped_linear.py
python benchmarks/linear/benchmark_graph_safe_grouped_mlp.py

Forward-only:

python benchmarks/linear/benchmark_graph_safe_grouped_linear.py --fwd-only
python benchmarks/linear/benchmark_graph_safe_grouped_mlp.py --fwd-only

Nsight Systems:

(optionally: unset DEBUGINFOD_URLS)

nsys profile \
--output=./benchmarks/linear/graph_safe_grouped_linear_mxfp8 \
--output=./benchmarks/linear/graph_safe_grouped_mlp_mxfp8 \
--force-overwrite true \
--trace=cuda,nvtx,cudnn,cublas \
python benchmarks/linear/benchmark_graph_safe_grouped_linear.py --profile
python benchmarks/linear/benchmark_graph_safe_grouped_mlp.py --profile
"""

# Match the Qwen MXFP8 SFT launch toggles before importing TE.
Expand Down
Loading
Loading