aq.dev / guides / reviewing-pull-requests-from-ai-agents

Reviewing Pull Requests From AI Agents Without Drowning

The way to review AI agent pull requests without drowning is to change what you review: inspect the run that produced the diff, not just the diff, and verify behavior in a live preview instead of simulating the code in your head. Agents have made PRs cheap to produce; review is now the bottleneck, and a review process designed for human-authored PRs will not survive the volume.

"PR review fatigue" has become a recurring Ask HN topic in 2026 for a simple reason: a team that adopts coding agents can triple its PR count in a month while its review capacity stays flat. This guide is a practitioner's workflow for that world.

Why agent PRs break the normal review process

Human PRs arrive with context attached: you know who wrote it, you were in the design discussion, you can ask "why did you do it this way?" and get an answer grounded in intent. Agent PRs strip that away. The diff is often large, plausible-looking, and confidently wrong in one specific place. Three failure modes recur:

The fix is not heroic diff-reading. It is changing the unit of review.

Review the run, not just the diff

A diff tells you what changed. The run tells you why, and the why is where agent bugs live. Did the agent read the relevant code before editing it? Did it run the tests, and did it react to a failure by fixing the cause or by weakening the assertion? Did it thrash (a signal the task was underspecified) or move linearly?

Five minutes scanning the session transcript routinely surfaces what an hour of diff-reading misses: the moment the agent misread a requirement, silenced a failing test, or guessed at an API. This is the single highest-leverage habit in agent-PR review, and it requires that the run still exists when review happens. In AQ every agent runs in a persistent workspace session, so the reviewer can open the workspace and watch a run live or scroll back through what the agent did, rather than reconstructing intent from commit messages.

Keep the session open for a second reviewer

With human PRs, "get a second opinion" means forwarding a link. With agent PRs, the second opinion is most useful inside the session, where the reviewer can interrogate the author. AQ is the multiplayer workspace where engineering teams run AI coding agents like Claude Code and Codex together: shared live terminals, a code editor, and app previews, in your own cloud. Because the workspace is shared, a second reviewer enters the same live session, reads the same terminal history, and can prompt the agent directly: "why is this lock needed?" or "run the failing test and show me." The agent that wrote the code is still there to answer for it, which is a genuinely new review affordance; use it.

Handoffs work the same way. If the primary reviewer is out, the next person opens the workspace with full context intact instead of starting from a cold diff.

Review behavior, not just code: use the live preview

For anything with a surface (UI, API, CLI), the diff is a proxy; behavior is the ground truth. Reviewers approve visually broken changes all the time because the diff "looked right." Each AQ workspace runs its own dev server with a shareable preview URL, so reviewing behavior costs one click, not a local checkout, install, and env setup. Click through the actual feature the agent built. For UI changes, two minutes in the preview beats twenty in the diff, and non-engineers (design, PM) can join review through a guest preview link without touching the code.

Turn review comments into follow-up prompts

The traditional loop for requesting changes is lossy: reviewer writes a comment on GitHub, author reads it later, context evaporates in between. With an agent author you can close that loop directly. In AQ, reviewers pin comments on the preview itself (screenshots and attachments supported), anchored to the exact broken state, and send them to the agent as prompts. "This dropdown clips at 375px" goes from observation to instruction in one step, and the fix lands in the same workspace, on the same branch, in the same PR. Review stops being an after-the-fact gate and becomes part of the run.

Keep one PR per workspace, small and rebased

Everything above gets easier when the unit of work stays small:

Use CI as the floor, not the bar

Agents are good at making CI pass; that is precisely why a green check means less on an agent PR than it used to. Treat CI as the floor: red means the PR is not reviewable yet, green means the real review can begin. Two agent-specific checks belong in every review pass:

A workflow that survives the volume

Put together, a sustainable agent-PR review looks like this: scan the run for red flags (five minutes), click through the preview (five minutes), read the diff with tests first (ten to twenty minutes for a well-scoped PR), send fixes back to the agent as prompts, and merge only what stayed small and rebased. Anything that resists this shape (a giant diff, a run nobody can replay, a branch weeks behind main) is not a review problem; it is a scoping problem, and the fix is upstream: smaller tasks, one per workspace.

Review bandwidth is the scarce resource in the agent era. Spend it on judgment (does this change do the right thing?) and let the platform carry the mechanics: persistent runs to inspect, shared sessions to hand off, previews to click, and comments that turn into fixes without leaving the workspace.

Frequently asked questions

How is reviewing an AI agent's PR different from reviewing a human's?

The context is missing and the volume is higher. Agent code looks clean but can be confidently wrong in one spot, so you review the run (what the agent read, ran, and reacted to) and the behavior (in a live preview), not just the diff. And because agents produce PRs faster than humans review them, strict scoping (one small PR per workspace) is what keeps the process alive.

What does it mean to review the run instead of the diff?

It means inspecting the session that produced the code: whether the agent read the relevant files, how it handled test failures, and where it guessed. A few minutes in the transcript surfaces wrong assumptions that a diff hides. This requires persistent sessions; in AQ the workspace keeps the agent's terminal session available to watch live or scroll back through.

Should CI passing be enough to merge an agent PR?

No. Agents are specifically good at making CI green, sometimes by weakening tests rather than fixing code. Treat CI as the floor: it filters out unreviewable PRs. The bar is human review of the test diff, the behavior in a running preview, and the run that produced the change.

How do I send review feedback back to the agent?

Prompt it in its own session instead of round-tripping through GitHub comments. In AQ a reviewer opens the same workspace and types follow-up prompts into the live terminal, or pins comments on the dev-server preview (with screenshots) and sends them to the agent as prompts. The fix lands on the same branch and PR.

How big should an agent PR be?

Small enough for one reviewer to hold in their head in one sitting: one task, one branch, one PR, rebased onto the latest main before review. If the work grew beyond that, split it into separate workspaces rather than reviewing a monolith. Unrequested changes should be cut and done as their own PR.