…4 SwiGLU prefill opt-in (27B KLD base re-recorded) (#493)
llama.cpp 96f81977 (fork #120, #122, #121 on 5dcf6623):
- #120: prompt flash attention above 2048 query rows as query chunks (27B -ub 4096: 6.5 -> 588 tok/s).
- #122: ROPE above 2048 tokens as token chunks (Qwen3-4B now runs -ub 4096; KLD 0.000002).
- #121: the int4-activation SwiGLU prefill (symmetric_i4_q8_plane) is opt-in,
GGML_HRX_SYMMETRIC_I4_PREFILL=1. 27B prefill speed -0.0..-0.7% (interleaved x3).
scripts/hw-gate.sh --bin on a private build (this llama.cpp + hrx-system 82804197 + gpu-kernels
08bb2241, strixhalo performance mode), check mode: PASS on every row (ops 667/667, kat, needle,
placement, kld). The 27B kld row moved, as expected from #121: mean KLD 0.000000 -> 0.002222
(p99 0.01868, same top 97.65%, limit 0.01) against the base recorded with the int4 path on.
The 27B base is re-recorded on that same build (scripts/hw-gate.sh --phases kld --models
qwen3.8-27b --record): manifest sha256 d2f9a8af -> a31cb56c; the previous base file is kept on
strixhalo as ~/.cache/hw-gate/kld/qwen3.8-27b.kld.pre-96f81977. Measured directly: the new
default is the exact path - 27B -ub 2048 against the -ub 4096 logits 0.001949 -> 0.000003,
PPL (c4096) 6.7183 -> 6.7097, PPL (c512, the gate args) 6.6835 -> 6.6381.
Co-authored-by: bong-water-water-bong <bong-water-water-bong@1bit.gg>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Weekly releases, every Sunday (docs/releases.md). The engine pins every upstream, and Lemonade ships on Fridays, so on Sunday Strix Halo rebuilds everything at that week's pins and publishes
v<ISO year>.<ISO week>.scripts/weekly.sh <workdir> [stage...]:bump-*PR merged onto main (full build, ctest withserveend to end, plus the check that bump needs), then updates it, waits for CI and merges it. PRs that fail stay open and are listed as held back.WEEKLY_DRY_RUN=1merges and publishes nothing.mem-guardkills them, because the box is shared.scripts/package-linux.sh: a relocatable tarball of 1bit and every backend. Libraries loaded from the build tree go beside the programs that load them ($ORIGIN), and XRT goes inxrt/lib. RUNPATHs into TheRock stay.app/built_path.h: 1bit's backends are compiled in by build-tree path. When that path is gone, 1bit looks for the same relative path beside itself.tools/weekly_changes.py: for each moved pin, the upstream commits (authors, PRs) and releases since the last release. Its output becomeschanges.jsonand the release notes. Discord's #announcements post is written fromchanges.jsonby a local bot.scripts/build-lemonade.sh: copiesresources/besidelemond, which refuses to start without it.Verified on Strix Halo (build 21 min, packages 6 min):
serve_e2eon vulkan, hrx, vulkan with hrx prefill, and zinc.serve_e2eon vulkan, hrx, zinc and--prefill-device hrx. DwarfStar, ONNX and lean have no missing libraries.lemondfrom the Lemonade package starts and lists the onebit models.🤖 Generated with Claude Code