Repository navigation
bench: existing RoPE vs YaRN at 512K and 1M, with setup guide - #1692
Closed
CC-David-CC wants to merge 2 commits into
Closed
CC-David-CC wants to merge 2 commits into
CC-David-CC wants to merge 2 commits into
Conversation
This was referenced Oct 9, 2026
Niko1221
pushed a commit
that referenced
this pull request
Oct 10, 2026
Owner
|
Thank you, in v0.1.42 with your two commits, with a row in bench/results/COMMUNITY.md. The 1M ordinary-RoPE result (0/3 pairs) against YaRN (3/3) is a clear data point. |
giridhart
pushed a commit
to giridhart/Strata
that referenced
this pull request
Oct 15, 2026
giridhart
pushed a commit
to giridhart/Strata
that referenced
this pull request
Oct 15, 2026
…21#1638 Niko1221#1647 Niko1221#1655 Niko1221#1681 Niko1221#1692 Niko1221#1695 Niko1221#1716 Niko1221#1717 Niko1221#1657 Niko1221#1640; the 6900 XT 0.1.40.1 row now has the numbers Niko1221#1657 added
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Measures Strata's existing YaRN on untouched main
fb58e0db; no inference changes or converter dependency.ISTA IQ3_XXS, FP16 KV, RTX PRO 6000 Blackwell. One fresh three-code retrieval prompt per condition:
The 1M input hashes and executable match. Ordinary RoPE retained the names/numbers but swapped their associations; exact answers are shown in the figure. Replies were only 22 tokens.
Use existing YaRN
Linux:
./setup.sh --setup --context 1048576 --rope-scaling yarn --rope-scale 4Windows:
START-HERE.bat --setup --context 1048576 --rope-scaling yarn --rope-scale 4Stop the running server first.
--setupsaves these settings and starts the selected model; later launches use./setup.shorSTART-HERE.bat.Includes engine flags, a 128-token API example, output headroom and cache compatibility guidance in the setup and reproduction guide.
Scope
This is a small reproducible probe, not a validated 512K switching cutoff or general 1M quality guarantee. Retain normal defaults within the declared 262K context; beyond that, follow setup's existing experimental YaRN policy. Fresh YaRN is not cache migration.
Adds raw measurements/hashes, the standalone probe, PNG/SVG figure and plot source. No weights, saved sessions, or credentials. Related measurements: #348 and #781.