Skip to content

vulkan: support qwen4exp hc ops - #28988

Merged
0cc4m merged 2 commits into
masterfrom
0cc4m/vulkan-qwen4exp-hc-ops
Sep 17, 2026
Merged

vulkan: support qwen4exp hc ops#28988
0cc4m merged 2 commits into
masterfrom
0cc4m/vulkan-qwen4exp-hc-ops

Conversation

@0cc4m

@0cc4m 0cc4m commented Sep 16, 2026

Copy link
Copy Markdown
Contributor

Overview

Support qwen4exp HC ops added in #28901 in Vulkan.

DGX Spark, GB10 Blackwell

Metric Vulkan before Vulkan after VK Δ (after vs before) CUDA (ref) VK-after vs CUDA
pp512 (t/s) 746.6 803.7 +7.6% 949.5 84.6%
tg128 (t/s) 30.55 31.50 +3.1% 37.65 83.7%

Ryzen AI Max+ 395, Radeon 8060S (RDNA3.5)

Metric Vulkan before Vulkan after VK Δ (after vs before) ROCm (ref) VK-after vs ROCm
pp512 (t/s) 330.9 337.0 +1.9% 347.7 96.9%
tg128 (t/s) 25.55 26.17 +2.4% 21.34 122.6%

Requirements

@0cc4m
0cc4m requested a review from a team as a code owner September 16, 2026 09:46
@github-actions github-actions Bot added Vulkan Issues specific to the Vulkan backend ggml changes relating to the ggml tensor library for machine learning labels Sep 16, 2026
jeffbolznv
jeffbolznv approved these changes Sep 16, 2026
View reviewed changes
Comment thread ggml/src/ggml-vulkan/vulkan-shaders/dsv4_hc_post.comp Resolved
@ggerganov ggerganov mentioned this pull request Sep 16, 2026
Merged
@0cc4m
0cc4m merged commit 35822af into master Sep 17, 2026
28 of 30 checks passed
@0cc4m
0cc4m deleted the 0cc4m/vulkan-qwen4exp-hc-ops branch September 17, 2026 04:34
@ggerganov ggerganov mentioned this pull request Sep 23, 2026
Merged
@BrewTestBot BrewTestBot mentioned this pull request Sep 23, 2026
Merged
1 task done
@noamsto noamsto mentioned this pull request Sep 27, 2026
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@CISC CISC CISC approved these changes
@jeffbolznv jeffbolznv jeffbolznv approved these changes

Assignees

No one assigned

Labels

ggml changes relating to the ggml tensor library for machine learning Vulkan Issues specific to the Vulkan backend

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@0cc4m @CISC @jeffbolznv