Repository navigation
[Benchmark] RX 6900 XT (gfx1030) on Windows 11: the released rdna2 package on a real card - #4780
Jupiterxia553 wants to merge 1 commit into
Conversation
…ckage on a real card No report existed for the Windows `rdna2` package on any Windows machine. `docs/AMD_HIP.md` has the RX 6000 section marked as built but untested on a real card, and Niko1221#4723 covers only the Linux `rx6000` package. This adds the Windows side: engine 0.1.54, 262,144-token context, Qwen3.8-Flash-Next IQ3_S with a native pack and an MTP draft layer, eleven environment switches and the arguments as the server ran them. Results: 869.0 tok/s prompt (9,699 tokens) and 68.5 tok/s decode (400 tokens) with 78.6 % draft acceptance, one run each on 2026-10-31. This is not the standard protocol: `strata bench run` was not executed and there is no `results.json`; README.md says so in its first paragraph and lists what was not measured. Two conditions a Windows reader should know about, both from the engine's own startup lines: 15,570 of the card's 16,368 MiB reach the process (WDDM), and large pages are refused (VirtualAlloc error 1314), so the expert arena runs on 4 KB pages. One open question, recorded rather than diagnosed: `--expert-cache auto` prints an estimate that the slot count it finishes with contradicts (2,601 -> 3,369 slots here, 2,669 -> 3,302 on another startup, with the "shrinking" line not followed by a shrunken figure). I did not change anything to find out which number is wrong. Results only. No engine change, no default touched.
跟进:PR 正文里「槽位口径不一致」的问题已定位到源码先更正我自己在正文里留的那个问号。三行看起来自相矛盾的日志,其实是两个不同的量:
所以 一个很小的建议:把 真正卡住的不是
|
--vram-reserve-mib |
预估槽数 | 最终槽数 | prefill tok/s | prompt 借槽 |
|---|---|---|---|---|
| 默认(2560 地板) | 2601 | 3272–3369 | 866.6 | 2315 |
| 1900 | 2861 | 3603 | 936.3 | — |
| 1500 | 3019 | 3783–3824 | 1214.4 | 2617 |
- 按
2560 → 1900 → 2560 → 1500 → 2560 → 1500换序 ABBA 跑,区间不重叠(2560 给 859.6–871.5,1500 给 1209–1220),排除顺序偏置。prefill +39.6%,decode 64.2–68.4(+3%)。 - 提速机制就是借槽:prompt 路径借走的槽从 2315 涨到 2617(4.98 GiB),prefill 期间少取专家。
- 质量:14 题客观电池 13/14,与 reserve 2560 时逐题相同(唯一挂的仍是 47 人容斥,IQ3 两档历史同挂)。
- 这一轮日志里零分页、零逐出告警。
结论:--expert-cache auto 在 Windows 上偏保守,默认值按最坏情况的 WDDM 开销定价;显存有余量时显式给 --vram-reserve-mib 收益可观。代价要讲清楚——1500 这一档跑起来只剩 1.1–1.3 GiB 空闲,桌面端显存吃紧(浏览器硬解、另一个 GPU 程序)时有被 WDDM 换页的风险,所以我它是当「愿意盯着看」的档位,不是无脑推荐值。保守取 1900 也能拿到 +8% prefill。
|
Thank you for the benchmark. We have collected these results for the benchmarks page on the Strata website, so we are closing this pull request instead of adding the files to the repository. If you measure again, for example on 0.2.11, you are welcome to open a new report. The Strata project |
No report existed for the Windows
rdna2package on any Windows machine.docs/AMD_HIP.mdhas the RX 6000 section marked as built but untested on a real card, and #4723 covers only
the Linux
rx6000package. This adds the Windows side: engine 0.1.54, 262,144-token context,Qwen3.8-Flash-Next IQ3_S with a native pack and an MTP draft layer, eleven environment
switches and the arguments as the server ran them.
Results: 869.0 tok/s prompt (9,699 tokens) and 68.5 tok/s decode (400 tokens) with 78.6 %
draft acceptance, one run each on 2026-10-31. This is not the standard protocol:
strata bench runwas not executed and there is noresults.json; README.md says so in itsfirst paragraph and lists what was not measured.
Two conditions a Windows reader should know about, both from the engine's own startup lines:
15,570 of the card's 16,368 MiB reach the process (WDDM), and large pages are refused
(VirtualAlloc error 1314), so the expert arena runs on 4 KB pages.
One open question, recorded rather than diagnosed:
--expert-cache autoprints an estimatethat the slot count it finishes with contradicts (2,601 -> 3,369 slots here, 2,669 -> 3,302 on
another startup, with the "shrinking" line not followed by a shrunken figure). I did not change
anything to find out which number is wrong.
Results only. No engine change, no default touched.