Repository navigation
Conversation
…gine 0.1.45 (+ WSL2 bonus)
This was referenced Oct 19, 2026
Owner
|
Thanks for the pull request. We're resetting the tracker for 0.2.0-beta. There are more than 1,300 open issues and pull requests, too many for us to review properly, so we're closing everything that isn't being worked on right now. Closed here does not mean rejected. To reopen it takes about two minutes:
The rules are in CONTRIBUTING.md. |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Community benchmark for engine 0.1.45 on an Intel Arc Pro B70 32 GB
(Ryzen 7 3700X, 121 GB RAM, native Ubuntu 26.04, SYCL AOT build
bmg-g31), serving the official ISTA-DASLab GSQ-RCO IQ3_S at 32,768
context, single-GPU (a B580 drives the display only), with
experimental speed projection enabled. Results only: no engine, build or
test changes.
One run per condition (stated in the README, no median/range), all prompts
unique with 0 reused tokens:
Draft acceptance 48.9%/51.4%. The README also includes an ESP refusal A/B
on the same prompt: this time both sides generated 500 tokens
(finish=length, no refusal either way), unlike the 0.1.41 RTX 5060 Ti
report where ESP off refused at 106 tokens.
What changed
Add
bench/results/2026-10-17-community-arc-pro-b70-iq3_s-0145/:the README (hardware, settings, method, tables, limitations),
per-condition medians (
measurements.csv), one row per request(
requests.csv), a/metricssnapshot, the sanitized server config andengine start lines, and the client script.
Local paths are generalized and no credentials are included.
Add
bench/results/2026-10-14-community-arc-pro-b70-wsl2-iq3_s-0143/as a bonus: the same card's older WSL2 GPU-PV numbers (engine 0.1.43.1
plus four uncommitted local WSL2 patches), summary values transcribed
from a 2026-10-14 migration memo — README and
measurements.csvonly,no per-request data preserved (stated in that README).
Add nothing else: no code, docs, or index changes (index left to
the maintainers).
Not attached: the full engine log and the model/pack files. The main
README lists what is missing.
Extra Notes
Native Linux on Intel (oneAPI 2026.2,
xedriver, XFCE desktop onthe B580), so these numbers describe that stack.
VRAM reserve 500 MiB sits below the engine's own recommendation: a LOW
warning was active (211 MiB free, engine suggests 801), so the main
numbers describe that pressured configuration.
The story decode (27.8 tok/s) trails the explanation decode
(38.0 tok/s) on lower draft acceptance (48.9% vs 51.4%); outputs
differ, so this is not a controlled decode comparison.
Not tested: needle recall, TTFT, vision, soak, other quants, larger
contexts, a layer split across the B580, calibration sweeps,
concurrent requests.