Add yolo-auto/yolo and yolo-auto/yolo-small model metadata and settings - #5749
Draft
harryvgiunta wants to merge 1 commit into
Draft
harryvgiunta wants to merge 1 commit into
harryvgiunta wants to merge 1 commit into
Conversation
Register the two stable public aliases of Yolo-Auto (https://yolo-auto.com), a flat-rate OpenAI-compatible router, as first-class aider models: diff edit format, repo map, and a yolo-auto/yolo-small weak+editor pairing. Metadata (262K context, zero per-token cost, vision on yolo only) matches the model rows proposed for litellm in BerriAI/litellm#42545; the yolo-auto/ provider prefix only routes once that registration ships, so treat this as blocked on it until litellm releases a version containing it.
This branch has not been deployed
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
This PR adds model metadata and settings for the two stable public aliases of Yolo-Auto, a flat-rate OpenAI-compatible inference router:
yolo-auto/yolo(vision + reasoning) andyolo-auto/yolo-small(text-only). Supersedes #5747, which usedopenai/keys; I re-keyed them to the real provider prefix.This PR is blocked on BerriAI/litellm#42545 (registering
yolo-autoin litellm, which is exactly the pattern this PR needs for routing). Theyolo-auto/prefix only routes once that registration ships in a litellm release. Until then this PR is harmless-but-inert (entries only add--list-modelsmatches and metadata); marking it draft on purpose.If this change required a real-world end-to-end manual test using a real LLM API, here are the details explaining how you did this and what you found:
With a litellm checkout containing BerriAI/litellm#42545 and
YOLO_AUTO_API_KEYset:aider --model yolo-auto/yoloresolves: context 262144, vision true, weak/editor modelyolo-auto/yolo-small--list-models | grep yololistsyolo-auto/yoloandyolo-auto/yolo-smallhttps://yolo-auto.com/v1/chat/completions(model echoes content,finish_reason: stop, real usage counts)Without the litellm registration (released litellm today), step 1 warns and step 3 fails with
LLM Provider NOT provided, which is why this is a draft.Summary
aider/resources/model-metadata.json: exact-key rows foryolo-auto/yoloandyolo-auto/yolo-small(262144 context, 32768 output cap, zero per-token cost; the service is subscription flat-rate).litellm_provider: yolo-auto, so both--list-modelsfuzzy matching andget_model_from_cached_json_dbfind them.aider/resources/model-settings.yml: diff edit format, repo map, examples-as-system-message, withyolo-auto/yolo-smallas the weak + editor model for both entries (same pairing style as the other diff-format entries in the file).Relevant issues
None; new provider models. Related: BerriAI/litellm#42545