Repository navigation
Conversation
…S / strata-qwen38-thinking-v1-draft.1 (8 runs) Eight complete standard draft runs on one Windows 11 PC: the official windows-x86_64-hip-rdna2 package 0.1.48 at setup defaults and with measured settings (VRAM reserve, KV residency, opt-in prompt switches, a rocBLAS table tuned on the PC, --pcie-frac 0.2, --prefill 8192), and one run of main 7dd5cf1 + Niko1221#4005. README, results.json, config.json, outputs.jsonl and provenance per run; engine logs left out. Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
This was referenced Oct 24, 2026
…at --prefill 8192 The same local build and settings as ...-c97e2108 with --prefill 8192 instead of auto (6,144), so the last step is comparable with the package run at 8,192 (...-0e04f3ea): complete, 12/12, prompt 4K 808.5 / 16K 1,125.1 tok/s, decode 43.9 / 45.5 / 45.3. README, results.json, config.json, outputs.jsonl and provenance; engine log left out. Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
Owner
|
Thank you for measuring this and writing it up. We are building a Strata website with a page for community benchmarks, and results like these will be added there when it launches, so we are closing this pull request here; the numbers are not lost. If your numbers change with a new version, you are welcome to send them again. |
This was referenced Oct 29, 2026
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Results only (no engine change). Nine runs of
strata bench runon one Windows 11 PC with one RX 6900 XT, allcomplete, every scheduled request kept. The 0.2.3 notes call the Windowsrdna2package "built but untried"; these are runs of it on a real card, plus two runs ofmainwith #4005. The same card under Linux is in #3790.PC: Windows 11 (10.0.26300), i9-10900K, 64 GB DDR4-3600, RX 6900 XT 16 GB on PCIe 3.0 x16 (driver 32.0.21045.16010), model files on an NVMe SSD, 64 GB fixed page file. Qwen3.8-Flash-Next GSQ-RCO IQ3_S, 64K context, 8-bit KV,
--spec 4 --spec-min-p 0.5, one slot. Engine: the officialwindows-x86_64-hip-rdna2package 0.1.48 unchanged, fetched bystrata launchfrom the update feed, except the last two rows.…-687e512e…-7dc83265dwm.exerestarted…-8f3712c4--vram-reserve-mib 700, the monitor on the card…-84b6d25c--vram-reserve-mib 1536 --kv-resident 32768, rebooted with the monitor on the iGPU…-1daf1da0STRATA_SH_STREAM(list below)…-6886b54atools/hip/tune_rocblas…-0e04f3ea--pcie-frac 0.2 --prefill 8192…-c97e2108main7dd5cf1 + #4005 built on this PC (build_windows.bat), its switches on,--prefill auto(6144)…-9b72e2b1--prefill 8192(added 2026-10-25)Prompt and decode in tok/s, medians of three, the engine's own timings. Switches:
STRATA_HIP_PROMPT_F16=1 STRATA_HIP_ADAPT_KERNEL_COPY=1 STRATA_PREFILL_CPU_SHARE=auto STRATA_HC_PERSIST=1 STRATA_PIPED_CONCURRENT=1 STRATA_PREFILL_STREAM_MIN=2048 STRATA_IO_THREADS=128. Each run'sconfig.jsonhas every setting.What the rows show
strata launchpicked0.1.48 windows-x86_64-hip-rdna2by itself, the test start passed, and every run below finished its 21 required requests.…-0e04f3ea, one cold start each):--vision cpu) answers a test image (an invoice number, an amount, two shapes) and a slide (six facts, bar colours) correctly; big pictures are cut to 300 image tokens.--vision gpuquietly falls back to the CPU reader on this card ([Engine] Windows rdna2 package 0.1.48: the GPU picture reader (strata-vision-hip.exe) is built for gfx1200/gfx1201 only, so --vision gpu falls back to the CPU on RX 6000 #4017).6f8800aefe27,tools/visionunchanged) for gfx1030/gfx1031, the GPU reader runs next to the official engine: 4/4 answers correct, the slide read at 1,059 image tokens in 7.6 s (2.2 s asked again), the small image in 3.5 s (1.1 s). It takes about 1.3 GB of VRAM, which the engine gives up from the expert cache by itself: 3,479 slots instead of 4,166; Strata'sbenchmark.py4K prompt 582 / decode 44.4 tok/s against 589 / 44.5 with pictures off.…-8f3712c4, 0/12, kept here as measured). 1,536 is the lowest stable value found.--pcie-frac0 / 0.1 / 0.2 / 0.3 / 0.35 (benchmark.py, two runs each) peaked at 0.2, decode +29%, and Strata's own refinement (STRATA_PCIE_FRAC_DEFAULT=auto) arrives at 0.20 too. Details and a Linux check in [Engine] HIP gfx103x: the start-up pcie_frac (bandwidth only) is too high when the CPU pool is fast; the PcieAuto refinement (opt-in there) finds 0.20 — enable it by default on gfx103x? #4007.--prefill autostops at 6,144 on Windows HIP because of Windows HIP (RX 7900 XTX): a long prompt with--prefill 8192/automakes the commit charge jump ~70 GB in one second, the engine dies at the commit limit (0xC0000409); 7500 and below stay flat #1630 (7900 XTX). On this card 8,192 ran clean in six cold starts, including three at--max-context 262144with 27K and 100K prompts (Windows HIP (RX 7900 XTX): a long prompt with--prefill 8192/automakes the commit charge jump ~70 GB in one second, the engine dies at the commit limit (0xC0000409); 7500 and below stay flat #1630's setting), and reads 16K in two chunks instead of three (…-0e04f3ea: 798 → 1,076).…-c97e2108reads 4K at 793 tok/s with it; the same-build comparison (10 interleaved pairs, switches off vs on) is in [Engine] prefill: opt-in sparse copied events and deduplicated slot waits (Windows HIP prompt reads +36% at 4K, +15% at 32K) #4005: 4K +36%, 32K +15%.…-c97e2108ran at the auto chunk (6,144), so its 16K is below…-0e04f3ea;…-9b72e2b1is the same build at 8,192: 4K 808 / 16K 1,125 against the package's 586 / 1,076 at the same chunk (+38% / +5%; the copy-event gain shrinks at 8,192 because fewer chunks mean fewer waits).STRATA_SH_STREAMis left out of every run: on Windows it lowered decode and, with KV streaming, stopped the engine ([Docs] AMD_HIP: why STRATA_SH_STREAM goes both ways, and leave it off on Windows #3895).…-6886b54awas tuned on this PC and helps only prompts under ~1K new tokens.Failed, skipped or not measured
…-687e512ecarriesENGINE-NOT-STOPPED.txt: run from a Scheduled Task, the bench's finaltaskkillwas denied and the engine kept the card until stopped by hand; the measurements are complete. Later runs were started from an interactive session.…-8f3712c4failed its sanity checks (0/12) because of VRAM paging, as above.…-c97e2108and…-9b72e2b1are a local build ofmain+ [Engine] prefill: opt-in sparse copied events and deduplicated slot waits (Windows HIP prompt reads +36% at 4K, +15% at 32K) #4005, not a release; its engine reports 0.1.49.2. The two differ only in--prefill(config.json).stratadesktop app path.results.jsonsha256:Engine logs are not included (they carry local paths); available on request.
Developed with an AI coding assistant; every number above was measured on the PC described.
🤖 Generated with Claude Code