Skip to content

Supported recovery workflow after a managed run escalates without a concrete human question #40

Open

Description

@espada1201

I am trying to resolve a human-input escalation while keeping Foreman’s normal safeguards and genuine completion requirement.

With foreman-core 0.4.1, a managed foreman run can stop with ESCALATED and the generic reason semantic assessment requires human input. The saved assessment contains a needs_human value, but no specific question describing the judgment, credentials, clarification or permission required. The active worker is stopped before its review finishes.

The installed CLI exposes hook, run, demo, inspect, runs and extension, with no managed-run answer, approve or resume command. inspect displays the saved result. The hook route appears to manage a separate attached session. TypeSafe’s System One documentation says that the model does not generate reasoning explanations.

What is the supported operator workflow to:

  1. Identify the concrete human input that is needed after this generic escalation?
  2. Supply that input while preserving the escalated run as a historical result?
  3. Continue through a fresh or resumed managed review that still has to satisfy the unchanged verification and completion checks?

Is there an existing state, input or extension mechanism for this workflow that I have missed? If the workflow is not supported yet, which minimal diagnostic information would help investigate it, and would a provider request ID be useful?

I want to retain the human-input safeguard, existing thresholds and genuine FINISHED requirement. This question includes no application source, prompts, request payloads, logs, credentials or account information.

Activity

  1. JARosen commented on Oct 5, 2026

    @JARosen
    Contributor

    Thanks for the clear report. You haven’t missed an existing command: managed runs currently have no answer or resume workflow, and the generic human-input assessment doesn’t identify a specific question.

    Today, recovery means resolving an identifiable blocker outside Foreman, then starting a fresh managed run with that resolution included in the job. The escalated run remains historical, and the new run must satisfy the normal safeguards and completion checks.

    I have higher-priority work at the moment, but contributions are welcome. A focused PR improving escalation diagnostics in inspect by showing the responsible check, score, and effective threshold, and documenting the current recovery workflow, would be a useful starting point.

    Please preserve the existing escalation behavior and thresholds. A full answer/resume workflow needs a separate lifecycle design, so let’s discuss that before implementing it.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions