Skip to content

hexagon: add VISION RoPE support - #25216

Merged
max-krasnyansky merged 5 commits into
ggml-org:masterfrom
qualcomm:aparmp/hex-visionrope
Jul 9, 2026
Merged

max-krasnyansky merged 5 commits into
ggml-org:masterfrom
qualcomm:aparmp/hex-visionrope

Conversation

@aparmp-quic

Copy link
Copy Markdown
Contributor

Overview

Support VISION RoPE and strided src0 for RoPE at hexagon. Enables RoPE ops from the Qwen2-VL / Qwen3-VL vision encoder (ViT).

Requirements

  • I have read and agree with the contributing guidelines
  • AI usage disclosure: YES, For structuring and formatting. Manual review is fully performed.

@aparmp-quic
aparmp-quic requested a review from a team as a code owner July 2, 2026 03:12
@github-actions github-actions Bot added ggml changes relating to the ggml tensor library for machine learning Hexagon labels Jul 2, 2026
Comment thread ggml/src/ggml-hexagon/ggml-hexagon.cpp Outdated
return false;
}
}

// src0 rows must be densely packed so each DMA transfer covers exactly one row

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think this check is actually not correct. The dma setup we have in the ROPE is properly handling src0->nb[1] strides. In fact I believe we can remove all ggml_is_contiguous checks here but need to double check.

@aparmp-quic
aparmp-quic force-pushed the aparmp/hex-visionrope branch from a79c3b3 to 7772e1f Compare July 9, 2026 03:51
@max-krasnyansky
max-krasnyansky merged commit f2d1c2f into ggml-org:master Jul 9, 2026
28 of 30 checks passed
satindergrewal pushed a commit to satindergrewal/llama.cpp that referenced this pull request Aug 12, 2026
* hexagon: add VISION RoPE support

* hexagon: support RoPE on strided half-dim views for all modes

* hex-rope: decouple src0 DMA copy size from row stride

* hex-rope: support non-contiguous dst for RoPE

* hex-rope: fix dst spad pitch for non-contiguous dst
zbrad pushed a commit to zbrad/llama.cpp that referenced this pull request Sep 10, 2026
* hexagon: add VISION RoPE support

* hexagon: support RoPE on strided half-dim views for all modes

* hex-rope: decouple src0 DMA copy size from row stride

* hex-rope: support non-contiguous dst for RoPE

* hex-rope: fix dst spad pitch for non-contiguous dst
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

ggml changes relating to the ggml tensor library for machine learning Hexagon

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants