Skip to content

Shipping agent-written code safely rests on five controls built in order: an evidence bundle that CI enforces on every pull request, routing by risk class through code owners, a review agent that triages before a human decides, pipeline gates the agent cannot weaken, and progressive delivery with automatic rollback. Nobody reads every line of every diff; only high-risk changes get a human code reader.

This section is for developers who merge what their agents write and for tech leads who own the review policy. When agents open more pull requests than you can read, you either stall the queue or approve on trust; the pages below replace both with evidence.

Which review-and-ship guide fits your problem?

Section titled “Which review-and-ship guide fits your problem?”
Your situationStart with
Agent PR descriptions contain nothing verifiableThe evidence bundle
The review queue is the bottleneckAgent PR review
You want separate review agents per concernLayered pull-request review
PRs loop between agent and reviewerA bounded review-fix loop
An agent edits CI, or the pipeline is slowPipeline automation
You merge changes nobody read line by lineProgressive delivery
Nobody has rolled back production in monthsRehearsed rollback
You must decide who approves production changesProduction approval
The agent writes Dockerfiles, manifests or TerraformContainerization and infrastructure as code

This section follows testing and hands over to operations once the change is live.

In what order should you build the ship path?

Section titled “In what order should you build the ship path?”
  1. Require an evidence bundle on every pull request. It maps each acceptance criterion to a check that ran and declares the risk class; CI fails the pull request when it is incomplete. See the evidence bundle.
  2. Route by risk class through CODEOWNERS. low and standard changes are approved on the bundle; high changes (auth, money, schema, migrations, a loosened test) get a named code reader. See the risk-class policy.
  3. Run a review agent before any human. It reports against a committed checklist; the human then runs the six-step triage in agent PR review.
  4. Keep the pipeline out of the agent’s reach. Require checks and put code owners on .github/workflows/; see pipeline automation and protecting the oracle.
  5. Ship behind a flag or a canary with automatic rollback, and rehearse the rollback. See progressive delivery.

Where does the review agent run in each tool?

Section titled “Where does the review agent run in each tool?”

The bundle, triage and risk classes are the same in every tool; only the review agent’s location differs.

In a session, run /code-review. In CI, run your committed checklist with claude -p and a read-only tool allowlist. For high changes, claude ultrareview 482 runs a cloud multi-agent review of pull request 482: three one-time free runs on Pro and Max, then typically $5 to $25 each. It is not available on Bedrock, Google Cloud, Foundry or with Zero Data Retention. The managed Code Review service (Team and Enterprise; generally available per Anthropic, checked 2026-10-16) reads a repository-root REVIEW.md. See review and ship with Claude Code.

Start with the audit: it shows which of the five controls your repository already has.

Run the second prompt on a finished branch, before you open the pull request.

How do you prove a change is safe to ship?

Section titled “How do you prove a change is safe to ship?”

Each control leaves machine-produced evidence with a named owner: the bundle check on the head commit, the review-agent report with triage notes, a code owner’s reading for high changes, and canary or flag metrics inside a pre-set guardrail. The evidence bundle page lists who signs off on each. Track the escape rate by risk class and the share of bundles that pass on the first attempt; see metrics frameworks.

  • Green checks from an older commit. Recovery: require the commit SHA with every result; trust CI over the agent.
  • The agent loosens a test to pass the build. Recovery: give test and CI paths a code owner, and classify any loosened check as high.
  • Every pull request escalates. Recovery: narrow sensitive paths to code where mistakes are costly and slow to detect.
  • The rollback needs a build. Recovery: ship behind a flag or canary that aborts in seconds, and rehearse it.
  • The review agent buries real findings in style comments. Recovery: limit it to production-relevant findings, ranked by severity.

Start with the evidence bundle, then the agent PR review triage. If your team still reads every diff, see helping the team stop reading every diff and running the review queue.