Skip to content

The opencode lane sometimes reviews and then emits the verdict template instead of a verdict #248

Description

@pseudoseed

The opencode lane (xai/grok-4.6) sometimes performs a full review and then emits the verdict
template
instead of a verdict:

VERDICT: [APPROVE | REQUEST_CHANGES | COMMENT]

It reads the files, reasons about them, says things like "previous findings look fixed" — and then
echoes the instruction back rather than answering it.

Three instances, all 2026-08-29/30

Where Shape
PR #221 round 10 Ended mid-exploration, no verdict
PR #221 round 10 retry Died on a permission rejection mid-run, no verdict
Spec 236 phase 7 iter 2 Full review performed, verdict template emitted verbatim

Why it matters more than a flaky lane

A review with no verdict line would be read as a non-blocking COMMENT — that is, counted as an
approval — if nothing caught it. The lane's own guard does catch it and refuses to write the
artifact, with the message opencode produced a review with no VERDICT line. That guard is working
and is the only reason this is an outage rather than a silent pass.

This is the failure this repo keeps meeting from other directions: a process that did not answer,
spelled the same way as a process that answered "fine". consult's opencode lane is documented as
never skipping — every failure loud, including a review that states no verdict — and that
documentation is load-bearing here.

What would help

  • Record the no-verdict outcome in the review artifact as an explicit LANE OUTAGE, rather than
    only refusing to write. A missing file is itself ambiguous: it does not distinguish "the lane was
    never run" from "the lane ran and would not answer".
  • One retry is reasonable. Retrying indefinitely is not — a lane that reviews and then declines to
    state a verdict is an outage, and dressing it as a pending result hides a real availability
    problem with the provider.
  • Worth measuring how often this happens before treating opencode as one of three dependable
    lanes. Tonight it produced no usable verdict on 3 of its attempts.

Observed by the architect on #221 and by builder-aspir-236 on spec 236.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    area/consultMulti-agent consultation CLI

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions