…mat SwiGLU, Hadamard Q4_0 (#278)
* Pin llama.cpp bd5b297: HRX remainder prefill, 32K+ prompts, mixed-format SwiGLU, Hadamard Q4_0
llama.cpp fork commits since 6e42b51 (figures from each PR, Qwen3.8-27B on HRX0, balanced mode):
- #61: q8_1 x4 prefill takes the 256-aligned head of a Q5_K/IQ4_XS remainder chunk.
UD-Q4_K_XL pp400 67.4 -> 103.4, pp1862 172.1 -> 234.6 tok/s; KLD vs 6e42b51 0.00215,
same top token 97.19%; MUL_MAT HRX0 287/287.
- #59: V stays row-major past copy_transpose_f16's 32768-row range. pp512 @ d32768 failed
before, 227.4 tok/s now; a 34,816-token wikitext chunk gives PPL 6.2150.
- #60: K-quant SwiGLU decode stages separate gate/up codebooks. UD-IQ2_S tg128 3.12 -> 8.32;
UD-Q4_K_XL unchanged; KLD 0.00013; test-backend-ops HRX0 996/996.
- #58: llama loads onebit.hadamard_q4_0 files through llama-hadamard (needed by #277).
Q4_0-H32 vs BF16: PPL 6.021, KLD 0.0292, same top token 92.5%.
Docs: docs/hrx.md #55 section (remainders now covered for Q5_K/IQ4_XS) and "Our patches".
Registry regenerated (tools/registry_build.py; no mapping changes).
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
* docs/hrx.md: the #61 figures were measured on 6e42b51 + #61 (a36d547) (review)
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
---------
Co-authored-by: bong-water-water-bong <bong-water-water-bong@1bit.gg>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Adds PR-Agent (0.43.0) to the engine repo.
1bit serveon Vulkan, 64K context. It runs on strixhalo as thecoder-llmuser service at 127.0.0.1:8090.strixhalo-engine(labelpr-agent). No code leaves the box, and there is no API key or Docs7 quota./review,/describe,/improveor/ask <question>..pr_agent.tomlcarries engine-specific review instructions: correctness on NPU/HRX/Vulkan, C++ ownership, measured claims only, the Apache notice, and docs updated in the same PR.This PR itself is the first test run.
🤖 Generated with Claude Code