Atlas · skill

Human-in-the-Loop AI

Human-in-the-Loop AI places a person's judgment at a defined point in an AI process, such as approving an action, resolving ambiguity or correcting a result. The skill is designing an effective decision handoff with relevant evidence, clear authority and reliable continuation after the person responds.

conceptAgent Control & Oversight

What it is

The system pauses or routes work when a condition requires human input. It presents the state needed for a decision, receives an authorized response and resumes under a defined transition. The person may approve a proposed effect, supply missing information or revise an intermediate artifact. This differs from passive monitoring or an optional feedback button: human involvement changes the process at an operational point. Durable state is often needed because the response may arrive after the original worker stops. Responsibility remains explicit: the model prepares a proposal, while the human decides within the scope assigned to that role.

What the work involves

The practitioner determines which decisions require review and what reviewers must see to make them competently. A handoff should show the proposed action, affected object, relevant evidence and available alternatives. Timeouts and rejection behavior need explicit handling. Useful outputs include a review interface, decision record and tested resume path. Review workload should be measured so people are not overwhelmed with low-value approvals. Recovery tests check that an approved action happens once and that a rejected proposal cannot continue through another path.

Illustrative example

A procurement assistant prepares a purchase request and pauses before submission. The reviewer sees the supplier, quantity, price, comparison evidence and the exact request to be sent. They change the quantity and approve the revised proposal. The agent resumes with that decision recorded and submits the approved version. A test interrupts the process after approval but before acknowledgement, then verifies that recovery reconciles the existing request rather than submitting a duplicate.

Limits and common mistakes

Human review can become ceremonial when people lack time, context or authority to challenge the proposal. A confirmation requested after an irreversible effect provides little control. Reviewers can also accept confident but unsupported explanations. Quality requires a decision that is understandable, timely and enforceable, with the relevant evidence available. Human involvement should address a specific uncertainty or responsibility; adding approval prompts to every step can increase fatigue and reduce attention to consequential decisions.

Prerequisites

  • HITL designs approval gates WITHIN agent workflows — you must understand the workflow to know where to insert checkpoints

Related skills

Sources and further reading

  • LangGraph interrupts

    Documents durable pause-and-resume execution, approval payloads and replay considerations around human decisions.

Last updated: 2026-10-10