Skip to content

metal: fix missing MoE kernel variant for 9 experts per token - #30699

Merged
nikwen merged 1 commit into
ggml-org:masterfrom
Caladrel65:fix/nemotron-bolt-9-expert-metal-segfault
Oct 20, 2026
Merged

nikwen merged 1 commit into
ggml-org:masterfrom
Caladrel65:fix/nemotron-bolt-9-expert-metal-segfault

Conversation

@Caladrel65

Copy link
Copy Markdown
Contributor

Overview

Added 9-expert variant to support Nemotron 3.5 Bolt. This closes #30610 and is only applicable for apple hardware.

Requirements

  • I have read and agree with the contributing guidelines
  • AI usage disclosure: Yes. I thought it would be funny to use Nemotron to fix one line to fix Nemotron.

@Caladrel65
Caladrel65 requested a review from a team as a code owner October 17, 2026 01:02
@github-actions github-actions Bot added ggml changes relating to the ggml tensor library for machine learning Apple Metal https://en.wikipedia.org/wiki/Metal_(API) labels Oct 17, 2026
@Caladrel65 Caladrel65 changed the title metal: fix missing MoE kernel variant for 9 experts per token (#30610) metal: fix missing MoE kernel variant for 9 experts per token Oct 17, 2026
@nikwen nikwen added the merge ready A maintainer can use this label to indicate that they consider the changes final and ready to merge. label Oct 19, 2026
@nikwen

nikwen commented Oct 20, 2026 •

Copy link
Copy Markdown
Member

Merging as the test failures look unrelated to me. (The beam one is fixed on master as far as I can tell.)

@nikwen
nikwen merged commit 704366d into ggml-org:master Oct 20, 2026
17 of 19 checks passed
@BrewTestBot BrewTestBot mentioned this pull request Oct 28, 2026
1 task done
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Apple Metal https://en.wikipedia.org/wiki/Metal_(API) ggml changes relating to the ggml tensor library for machine learning merge ready A maintainer can use this label to indicate that they consider the changes final and ready to merge.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Eval bug: Nemotron 3.5 Bolt 74B-A9B segfaults on Metal in ggml_metal_op_mul_mat_id

3 participants