Review and ship
PLShipping agent-written code safely rests on five controls built in order: an evidence bundle that CI enforces on every pull request, routing by risk class through code owners, a review agent that triages before a human decides, pipeline gates the agent cannot weaken, and progressive delivery with automatic rollback. Nobody reads every line of every diff; only high-risk changes get a human code reader.
This section is for developers who merge what their agents write and for tech leads who own the review policy. When agents open more pull requests than you can read, you either stall the queue or approve on trust; the pages below replace both with evidence.
Which review-and-ship guide fits your problem?
Section titled “Which review-and-ship guide fits your problem?”| Your situation | Start with |
|---|---|
| Agent PR descriptions contain nothing verifiable | The evidence bundle |
| The review queue is the bottleneck | Agent PR review |
| You want separate review agents per concern | Layered pull-request review |
| PRs loop between agent and reviewer | A bounded review-fix loop |
| An agent edits CI, or the pipeline is slow | Pipeline automation |
| You merge changes nobody read line by line | Progressive delivery |
| Nobody has rolled back production in months | Rehearsed rollback |
| You must decide who approves production changes | Production approval |
| The agent writes Dockerfiles, manifests or Terraform | Containerization and infrastructure as code |
This section follows testing and hands over to operations once the change is live.
In what order should you build the ship path?
Section titled “In what order should you build the ship path?”- Require an evidence bundle on every pull request. It maps each acceptance criterion to a check that ran and declares the risk class; CI fails the pull request when it is incomplete. See the evidence bundle.
- Route by risk class through
CODEOWNERS.lowandstandardchanges are approved on the bundle;highchanges (auth, money, schema, migrations, a loosened test) get a named code reader. See the risk-class policy. - Run a review agent before any human. It reports against a committed checklist; the human then runs the six-step triage in agent PR review.
- Keep the pipeline out of the agent’s reach. Require checks and put code owners on
.github/workflows/; see pipeline automation and protecting the oracle. - Ship behind a flag or a canary with automatic rollback, and rehearse the rollback. See progressive delivery.
Where does the review agent run in each tool?
Section titled “Where does the review agent run in each tool?”The bundle, triage and risk classes are the same in every tool; only the review agent’s location differs.
In a session, run /code-review. In CI, run your committed checklist with claude -p and a read-only tool allowlist. For high changes, claude ultrareview 482 runs a cloud multi-agent review of pull request 482: three one-time free runs on Pro and Max, then typically $5 to $25 each. It is not available on Bedrock, Google Cloud, Foundry or with Zero Data Retention. The managed Code Review service (Team and Enterprise; generally available per Anthropic, checked 2026-10-16) reads a repository-root REVIEW.md. See review and ship with Claude Code.
codex exec review --base main -o review.md reviews the branch against main and writes the findings to a file (Codex CLI 0.157.1). For your own checklist, pass it as the prompt instead of --base; the two do not combine. On GitHub, comment @codex review on the pull request, and put the review rules in AGENTS.md. See review and ship with Codex.
Bugbot reviews pull requests for bugs, security and code quality issues. PR Routing & Approval assigns reviewers by code ownership and can approve low-risk pull requests that meet your rules; make “no high risk class touched” one of them. See review and ship with Cursor.
Copy-paste prompts for review and ship
Section titled “Copy-paste prompts for review and ship”Start with the audit: it shows which of the five controls your repository already has.
Run the second prompt on a finished branch, before you open the pull request.
How do you prove a change is safe to ship?
Section titled “How do you prove a change is safe to ship?”Each control leaves machine-produced evidence with a named owner: the bundle check on the head commit, the review-agent report with triage notes, a code owner’s reading for high changes, and canary or flag metrics inside a pre-set guardrail. The evidence bundle page lists who signs off on each. Track the escape rate by risk class and the share of bundles that pass on the first attempt; see metrics frameworks.
What breaks when agents ship code?
Section titled “What breaks when agents ship code?”- Green checks from an older commit. Recovery: require the commit SHA with every result; trust CI over the agent.
- The agent loosens a test to pass the build. Recovery: give test and CI paths a code owner, and classify any loosened check as
high. - Every pull request escalates. Recovery: narrow sensitive paths to code where mistakes are costly and slow to detect.
- The rollback needs a build. Recovery: ship behind a flag or canary that aborts in seconds, and rehearse it.
- The review agent buries real findings in style comments. Recovery: limit it to production-relevant findings, ranked by severity.
Where to go next with review and ship
Section titled “Where to go next with review and ship”Start with the evidence bundle, then the agent PR review triage. If your team still reads every diff, see helping the team stop reading every diff and running the review queue.