Repository navigation
prefill: --prefill-help and --prefill-help-frac as the official flags for the idle-stage helper - #1247
Closed
anon761 wants to merge 1 commit into
Closed
prefill: --prefill-help and --prefill-help-frac as the official flags for the idle-stage helper#1247anon761 wants to merge 1 commit into
anon761 wants to merge 1 commit into
Conversation
… for the idle-stage helper (the envs stay honoured)
anon761
force-pushed
the
prefill-help-flag
branch
from
October 6, 2026 20:01
6f0c186 to
fea3bf4
Compare
fragtion
pushed a commit
to fragtion/StrataPool
that referenced
this pull request
Oct 7, 2026
…-help-frac as the official flags for the idle-stage helper (the envs stay honoured) prefill: --prefill-help and --prefill-help-frac as the official flags for the idle-stage helper (the envs stay honoured) Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_0157fjixQD2nRxvCvtXq66DD
Owner
|
Thanks. The idle-stage helper is already in as STRATA_PREFILL_HELP / STRATA_PREFILL_HELP_FRAC; the PR only adds flags for them, so it is outside the speed round. We would take the flags in a small rebased PR. |
Owner
|
Thanks for the pull request. We're resetting the tracker for 0.2.0-beta. There are more than 1,300 open issues and pull requests, too many for us to review properly, so we're closing everything that isn't being worked on right now. Closed here does not mean rejected. To reopen it takes about two minutes:
The rules are in CONTRIBUTING.md. |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
STRATA_PREFILL_HELP/STRATA_PREFILL_HELP_FRACalready do the work, but env-only is awkward when every other knob has a flag. These two set them before Prefill reads them, so the behavior is identical and repeatable; the envs stay honoured for existing configs.\n\nMeasured on a two-card layer split (2x RTX 3090): about +30% prompt-read time on small prompts (~1.4K tokens), where the second card otherwise sits idle during the first chunk.