Repository navigation
bench: dual V100 official usage comparison with Strata v0.1.42 - #8
Merged
MistVVK merged 3 commits intoOct 11, 2026
Merged
Conversation
Owner
|
ありがとうございます。 マルチGPU関係は雑に作っただけなので遅いと思います。 これからリモートマルチGPU対策をしようかなと思っているので、今後ともどうかよろしくお願いします。 P.S. |
Author
|
ご依頼のV100 1枚のスコアを、このPRに追加しました。 GPU0(PCIeが速い方)だけを使用し、150 W・IQ3_SでXeStrata xe0.1.40.2.2とStrata v0.1.42を同日に交互に各2回測定しています。公式の
1GPUでは日本語と短い固定入力のdecodeはかなり近い結果でした。会話は32K・1枠(前の2GPU測定は2枠)、実際の同時リクエストは1本です。本家のデフォルトのPCIe自動調整とroute tail skipは有効のままです。 Voltaコード確認の参考として、 カーネル診断の生ログ、起動経路、ターン別記録も添付しました。既定のdense-bf16は約2,726 us、no-xmxは約22,512 usでした。経路ラベルはcuBLAS / joint_matrixと出ますが、命令レベルの検証ではありません。 |
MistVVK
added a commit
that referenced
this pull request
Oct 11, 2026
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
This follows the request in #3 to remeasure using the new benchmark implementation.
XeStrata xe0.1.40.2.2 vs Strata v0.1.42, same-day runs on Ryzen 9 9950X / 128 GB RAM / 2× V100 PCIe 32 GB at 150 W each. IQ3_S, 32K, INT8 KV, MTP spec 4 / min-p 0.5, 24+24 layers, two slots / one active request.
Uses unmodified tools/bench_core.py ab_usage, conversations, sampling and aggregation: two alternating rounds, warm-ups excluded, all 68 measured turns completed.
Method caveat: this is not an unmodified --bench --original-strata invocation. At the measured tag, bench.py usage_cfg drops split_pci, layer_split, parallel and env during comparison, and upstream preparation selects the first GPU. Complete per-engine configurations were passed directly to official ab_usage to preserve the dual-GPU setup. No standalone generate/serve tiers, concurrency load test or quality evaluation.
Includes Japanese/English reports, commits and conditions, actual sanitized configs, per-turn records, and sanitized engine logs. XeStrata reports a two-GPU split and oneMath (cuBLAS) / joint_matrix. These logs alone do not establish the cause of the slowdown. No engine changes.
Validation: all 68 turns completed; maximum GPU core temperature 52 C. Markdown, offline links, spelling, secret scan and whitespace checks passed for added report files. Repository-wide REUSE still reports pre-existing missing notices in docs/BATCHING.ja.md, BENCH.ja.md, DETAILS.ja.md, MULTIGPU.ja.md, ORCA.ja.md and XE.ja.md; new files are covered. Production services restored.