You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
chat: an error sent inside the stream is dropped and the answer is shown as complete #516
the result is the text partial followed by a clean end-of-stream event. No error is surfaced, so a truncated answer is presented as though it were complete.
Expected behavior
An in-band error ends the stream as an error, and the user is told the answer was cut short.
Inconsistency worth noting
The Anthropic stream parser in the same module does stop on its error event type. The two parsers disagree about whether a mid-stream error is fatal.
Steps to reproduce
Feed the parser the three lines above. A reproducer is written as a property test (in_band_stream_errors_are_not_reported_as_a_clean_finish).
Caveat
The error shapes in the reproducer were written from vLLM's streaming handler, not captured from a live failing response. Both a nested {"error":{...}} object and a bare error object were tested. If an engine is known to emit a different shape, the fix should cover it.
Why this is filed rather than fixed
Whether a mid-stream error should discard the partial text, keep it with a warning, or keep it silently is a product decision about what rocm chat shows. The defect is only that it is currently invisible.
Environment
Built from main. Platform-independent.
How it was found
Property-testing the stream readers. Parsing itself is chunking-invariant — every one- and two-point split of the repo's fixture bodies, including splits mid-UTF-8 and between \r and \n, produced identical events — so this is a semantic gap, not a framing bug.
Activity
test: property-test --gpu selection and the SSE line emitters
docs(testing): state when a known-gap reproducer may be committed ign…
test: property-test --gpu selection and the SSE line emitters
docs(testing): state when a known-gap reproducer may be committed ign…
test: property-test --gpu selection and the SSE line emitters
docs(testing): state when a known-gap reproducer may be committed ign…
test(sse): pin each fixture's exact events and sweep pairs for both e…
test: property-test --gpu selection and the SSE line emitters
docs(testing): state when a known-gap reproducer may be committed ign…
test(sse): pin each fixture's exact events and sweep pairs for both e…
test: property-test --gpu selection and the SSE line emitters
docs(testing): state when a known-gap reproducer may be committed ign…
test(sse): pin each fixture's exact events and sweep pairs for both e…
test: property-test --gpu selection and the SSE line emitters (ROCMAI…
fix(providers): fail an OpenAI-compatible stream on an in-band error …