You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
Keep an offline endpoint's models in /v1/models, flagged endpoint_offline #35
As an operator, I want relayLLM to keep an offline endpoint's models in its model list, flagged offline, so that relay can answer "endpoint unavailable" instead of "model not found" during a short outage.
Acceptance criteria
GET /v1/models keeps each last-known model of an offline endpoint, with endpoint_offline set to the endpoint name.
GET /v1/models keeps each modelMap key whose target is such a model, with the same endpoint_offline value.
Managed and virtual rows never carry endpoint_offline.
The offline mark clears within the existing 15 s probe window.
What I'd notice
A clearer error during a brief endpoint outage, once relay reads the flag.
Activity
barelyworkingcode commentedon Oct 20, 2026
The relay half merged in barelyworkingcode/relay#522: relay reads
endpoint_offlineand answers 503 naming the endpoint.