Skip to content

[Benchmark] standard draft pilot: RX 6900 XT 16 GB on Windows 11 / Qwen3.8-Flash-Next / IQ3_S / strata-qwen38-thinking-v1-draft.1 (9 runs) - #4012

Closed
Vop3p wants to merge 2 commits into
Niko1221:mainfrom
Vop3p:bench-windows-rx6900xt
Closed

Vop3p wants to merge 2 commits into
Niko1221:mainfrom
Vop3p:bench-windows-rx6900xt

Conversation

@Vop3p

@Vop3p Vop3p commented Oct 24, 2026 •

Copy link
Copy Markdown
Contributor

Results only (no engine change). Nine runs of strata bench run on one Windows 11 PC with one RX 6900 XT, all complete, every scheduled request kept. The 0.2.3 notes call the Windows rdna2 package "built but untried"; these are runs of it on a real card, plus two runs of main with #4005. The same card under Linux is in #3790.

PC: Windows 11 (10.0.26300), i9-10900K, 64 GB DDR4-3600, RX 6900 XT 16 GB on PCIe 3.0 x16 (driver 32.0.21045.16010), model files on an NVMe SSD, 64 GB fixed page file. Qwen3.8-Flash-Next GSQ-RCO IQ3_S, 64K context, 8-bit KV, --spec 4 --spec-min-p 0.5, one slot. Engine: the official windows-x86_64-hip-rdna2 package 0.1.48 unchanged, fetched by strata launch from the update feed, except the last two rows.

run track what differs from the row above prompt 4K prompt 16K decode short / 4K / 16K first token (short) sanity
…-687e512e default setup defaults (reserve 2,560 MiB; a 5120x2160 monitor on the card) 451.8 479.3 28.8 / 28.3 / 28.4 2.81 s 12/12
…-7dc83265 custom the monitor moved to the iGPU, dwm.exe restarted 445.2 470.0 29.2 / 29.1 / 30.1 2.64 s 12/12
…-8f3712c4 custom defaults with --vram-reserve-mib 700, the monitor on the card 460.4 487.2 17.2 / 18.7 / 24.8 2.52 s 0/12
…-84b6d25c custom --vram-reserve-mib 1536 --kv-resident 32768, rebooted with the monitor on the iGPU 467.1 488.9 36.6 / 33.3 / 36.3 2.44 s 12/12
…-1daf1da0 custom + the opt-in prompt switches without STRATA_SH_STREAM (list below) 591.1 797.9 35.2 / 35.4 / 37.3 1.14 s 12/12
…-6886b54a custom + a rocBLAS table tuned on this PC with tools/hip/tune_rocblas 594.6 799.0 38.0 / 35.5 / 35.9 0.97 s 12/12
…-0e04f3ea custom + --pcie-frac 0.2 --prefill 8192 585.6 1,075.5 44.5 / 42.3 / 41.3 1.11 s 12/12
…-c97e2108 custom main 7dd5cf1 + #4005 built on this PC (build_windows.bat), its switches on, --prefill auto (6144) 793.1 978.9 48.3 / 42.6 / 44.1 1.06 s 12/12
…-9b72e2b1 custom the same build and settings with --prefill 8192 (added 2026-10-25) 808.5 1,125.1 43.9 / 45.5 / 45.3 1.11 s 12/12

Prompt and decode in tok/s, medians of three, the engine's own timings. Switches: STRATA_HIP_PROMPT_F16=1 STRATA_HIP_ADAPT_KERNEL_COPY=1 STRATA_PREFILL_CPU_SHARE=auto STRATA_HC_PERSIST=1 STRATA_PIPED_CONCURRENT=1 STRATA_PREFILL_STREAM_MIN=2048 STRATA_IO_THREADS=128. Each run's config.json has every setting.

What the rows show

Failed, skipped or not measured

  • …-687e512e carries ENGINE-NOT-STOPPED.txt: run from a Scheduled Task, the bench's final taskkill was denied and the engine kept the card until stopped by hand; the measurements are complete. Later runs were started from an interactive session.
  • …-8f3712c4 failed its sanity checks (0/12) because of VRAM paging, as above.
  • …-c97e2108 and …-9b72e2b1 are a local build of main + [Engine] prefill: opt-in sparse copied events and deduplicated slot waits (Windows HIP prompt reads +36% at 4K, +15% at 32K) #4005, not a release; its engine reports 0.1.49.2. The two differ only in --prefill (config.json).
  • Not measured: background work, other RX 6000 cards (6800 / 6700 XT), a fresh PC from zero, the pictures under the protocol (only by hand, above), the strata desktop app path.

results.json sha256:

e190c4ee3d72bd9a09df94274b982394df57ed81c68cf8d21ca9b73dd02b1af1  2026-10-23-standard-1x-rx-6900xt-windows-687e512e
faa37b892080e989fd275471fe5c4267aa727b24f830fa43b40bc912fc0bedc5  2026-10-23-standard-1x-rx-6900xt-windows-7dc83265
d099f5fbc39af4838f0352b8200b232958e8f41ead0ead12832d03433fe95573  2026-10-23-standard-1x-rx-6900xt-windows-84b6d25c
4ad2eba8f325d700bfaa3f852fdc96a6119c3ef1d7322249284594054d335e12  2026-10-23-standard-1x-rx-6900xt-windows-8f3712c4
68fec9079f106a777f5940bf41ca3169455ae5c27a4cc9a75a6e7cd5ba4cae0c  2026-10-24-standard-1x-rx-6900xt-windows-0e04f3ea
288c9520cf7792e857707cbb46a49d4387fe81c3e2e33924d77ebc56b7293c3f  2026-10-24-standard-1x-rx-6900xt-windows-1daf1da0
dc1d8d026eed20802e6e6bcda33cfe6e2bdeb8c0ad0490ab0074c7e2b3b5e839  2026-10-24-standard-1x-rx-6900xt-windows-6886b54a
cb9c268fd78e66a16b63f0c00765815e3477598c9cbda596d8d06a245f10cc8e  2026-10-24-standard-1x-rx-6900xt-windows-c97e2108
965b401ea30b183f203f6b15d263e09f1d9217e2da07f48d3921a4803b18981e  2026-10-25-standard-1x-rx-6900xt-windows-9b72e2b1

Engine logs are not included (they carry local paths); available on request.

Developed with an AI coding assistant; every number above was measured on the PC described.

🤖 Generated with Claude Code

…S / strata-qwen38-thinking-v1-draft.1 (8 runs)

Eight complete standard draft runs on one Windows 11 PC: the official windows-x86_64-hip-rdna2 package 0.1.48 at
setup defaults and with measured settings (VRAM reserve, KV residency, opt-in prompt switches, a rocBLAS table tuned
on the PC, --pcie-frac 0.2, --prefill 8192), and one run of main 7dd5cf1 + Niko1221#4005. README, results.json, config.json,
outputs.jsonl and provenance per run; engine logs left out.

Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
…at --prefill 8192

The same local build and settings as ...-c97e2108 with --prefill 8192 instead of auto (6,144), so the last step is
comparable with the package run at 8,192 (...-0e04f3ea): complete, 12/12, prompt 4K 808.5 / 16K 1,125.1 tok/s, decode
43.9 / 45.5 / 45.3. README, results.json, config.json, outputs.jsonl and provenance; engine log left out.

Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
@Vop3p Vop3p changed the title [Benchmark] standard draft pilot: RX 6900 XT 16 GB on Windows 11 / Qwen3.8-Flash-Next / IQ3_S / strata-qwen38-thinking-v1-draft.1 (8 runs) [Benchmark] standard draft pilot: RX 6900 XT 16 GB on Windows 11 / Qwen3.8-Flash-Next / IQ3_S / strata-qwen38-thinking-v1-draft.1 (9 runs) Oct 25, 2026
@Niko1221

Copy link
Copy Markdown
Owner

Thank you for measuring this and writing it up. We are building a Strata website with a page for community benchmarks, and results like these will be added there when it launches, so we are closing this pull request here; the numbers are not lost. If your numbers change with a new version, you are welcome to send them again.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants