Skip to content

knowledge: distill mistral.rs Metal paged-attention contracts #222

New issue
New issue
Closed
Closed
knowledge: distill mistral.rs Metal paged-attention contracts#222

Description

@david6666666
david6666666
opened on Oct 28, 2026

Accepted goal and sequential boundary

Second of the user-authorized Metal-engine source knowledge deliveries, after vllm-metal issue #218 / PR #219 merged and closed with checks. h3-metal is explicitly excluded. This issue owns EricLBuehler/mistral.rs only; MLX Swift LM and MLC LLM follow separately.

Accountable parent: Codex distill_metal_engine_batch. Implementer: Codex author_metal_knowledge (actual gpt-6.1-sol, xhigh), with bounded author lanes if used. Authorized coordinator/integrator owns final review/check-based acceptance and closure.

Source and method

Bounded extraction

A focused repository operating graph for native Metal paged attention:

  1. Decode layout/feature/geometry eligibility, specialized versus generic paths, partition and scratch/capacity distinctions.
  2. Prefill metadata, packed/strided/HND layout, absolute positions/masks/window/ranges and bounded workspace.
  3. Actual-model prewarm, source test/reference/dispatch evidence and safe qualification boundaries.

Include substantive source/consumer/test readsets with whole-byte identities and analysis spans, root MIT plus relevant paged-attention Apache-2.0/NOTICE retention, safe strict offline helpers, hard assertion cases, troubleshooting and explicit long-tail gaps. Exclude generic model catalog/server/agentic runtime/quantization duplication and unsupported performance claims.

Environment / non-goals

Current Linux executor has no cargo/rustc/Swift/Apple SDK/Metal device. Rust compilation and actual Apple kernel/model tests are not run, never passing substitutes. Required native backend evidence remains BLOCKED_REQUIRED_BACKEND; source/CPU helper checks are guidance only. Source graph is candidate / native-unverified under the user's accepted source/CPU-supported delivery boundary.

No toolchain/dependency host install, model/weights/downloads, GPU/paid-provider calls, public services, source-engine changes, upstream writes, rules/workflow changes or unrelated acceptance.

Acceptance

  • Integrated complete English root and three bounded routes with safe helpers/references/troubleshooting.
  • Exact source/readset/license gate and classified native candidates; missing tools/backend preserved.
  • Difficult per-route/integrated assertion cases and actual bounded helper/static/scaffold tests.
  • Both generated catalog/index AND skill-coverage refreshed; maintained ownership/matrices and noneditable-wheel reads verified.
  • Stable-head independent review, current-base/head Ready CI/admission, normal authorized squash merge, acceptance card before closure.

Activity

  1. david6666666 commented on Oct 28, 2026

    @david6666666
    david6666666
    on Oct 28, 2026 – with ChatGPT Codex Connector
    CollaboratorAuthor

    Delivery acceptance — bounded source/offline-support candidate

    flowchart LR
  A["Pinned source / 24-file readset"] --> B["Root + 3 operating routes"]
  B --> C["Independent content review"]
  C --> D["Ready CI + installed wheel"]
  D --> E["Normal squash / candidate retained"]
    Loading

    Delivered

    • PR knowledge: distill mistral.rs Metal paged-attention contracts #224 normally squash-merged as 6b446d4fa5a2e07033eebf0a9246d535b4471dda.
    • Decode layout/scale/GQA/workspace, prefill positions/masks/workspace, and actual-model preparation/pipeline-cache/native-evidence procedures; three bounded Python support helpers and ten hard assertion cases.
    • Retained root MIT and component Apache-2.0/NOTICE bytes; generated discovery and skill coverage, matrices/owners and installed checks updated.

    Verified

    • Independent exact-head internal review: approve this bounded candidate; no actionable P1/P2/P3 findings. This is not a published GitHub approval or native qualification.
    • 103 focused graph/helper/case tests; 121 combined graph/index/library tests; global Ruff, source hashes, four-SKILL license gate and both generator checks passed.
    • Latest exact-head Ready 484 run 40680736676: all four Python 3.10/3.11 full and wheel jobs succeeded. Python 3.10: 1694 passed, 11 skipped, 183 subtests. Latest admission status succeeded before normal merge.
    • Noneditable [skills] wheel check outside checkout: 117 catalog records; all 25 owner resources byte-identical.

    Limits preserved

    • Cargo/rustc/Apple native prerequisites absent. No original Rust compile/test, live Rust API/CLI, Metal tensor/cache/dispatch/parity/model, fit, quality, service or performance execution. Required native candidates stay BLOCKED_REQUIRED_BACKEND / not_run; engine candidate empirical validation remains not_run.
    • Local serial full-suite attempt lost execution transport at 69% and has no terminal receipt: INCONCLUSIVE infrastructure, not a claimed test failure/pass. No duplicate local attempt; completed exact-head hosted suites supply full-suite evidence.
    • Initial author fixture/guard findings and declared-extra setup boundary remain disclosed in PR/report. Resolver NO_LICENSE is an unauthenticated warning fallback, not legal absence. No managed DisCo import or candidate promotion.
    Revision and packaging receipts

    Source: 9459891e7697238225885518119682ac8209a612; Candle lineage: 66a8cf184a5a519671454066b1b9efd446ec9f5c; AREX method: ac3fe1afa80fb9a09775ecfb2b6cc3ba850a2db6.

    Reviewed PR head: f5026257709c4439f7ca1d6aef0ef427ec37db73; source projection: f03c19659f319213b9ab75ca60d3cb9d896e2e5c; tested merge: c23b57ee4f4bdd67ee912803a29047f638bc97d4 (base d9dc091e255acefef731249aa2e50dcc9118d69f plus reviewed head).

    Wheel SHA256: 7d0e93840dc843c163dec8b32a1a55016ade8fdf5173529d994344900debc59c. Library: 69 registered roots / 108 SKILL documents. Closure is knowledge-delivery acceptance, not engine-performance acceptance.

  2. david6666666
    closed this as completedon Oct 28, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions