Four Producer Verdicts for Resolving Reviewer Findings¶
The producer answers each reviewer finding with one verdict: fix, contest with readable evidence, escalate to the human, or decline a nit.
A reviewer finding needs a reply from the agent that wrote the work. In the critic agent pattern, the critic approves or rejects, and a rejected plan goes back for revision. The Elephant-Goldfish Model (EGM) gives its drafting agent four verdicts and five rules. The EGM resolve skill tells the agent to "Give each finding exactly one category" (egm-resolve).
The four verdicts¶
| Verdict | When it applies | What happens next |
|---|---|---|
| PROPOSE FIX | The finding is valid | The agent writes the exact replacement text |
| CONTEST | The finding is wrong, and a file and symbol, or a decision recorded in the document, shows it | The human can agree, overrule with a fix, or discuss |
| ESCALATE | The finding is wrong, but the evidence sits outside every file the reviewer could read | No fix. The human confirms, adds the fact to the document, or discusses |
| DECLINE | The finding is a Nit | Recorded and not fixed. A Nit may still get PROPOSE FIX if the fix is worth it |
The table follows the verdict list and the interactive breakdown. EGM's examples of outside evidence are a team convention and a verbal decision.
The commit that added ESCALATE and DECLINE explains ESCALATE. It states, "Some findings are wrong, but only facts outside the document show this" (commit 75d562c, PR #167).
Rules that keep a contest honest¶
The skill attaches five rules to the verdicts.
- A contest must be checkable. "This was intentional" is not evidence. Without readable evidence, the agent must ESCALATE or fix.
- Context goes into the document only when a human reader needs it. Context that only a zero-context reviewer needs goes to the human as ESCALATE. The skill states this rule without a reason.
- A comprehension gap cannot be contested: "If a fresh reader could not follow the document, the document is missing context."
- The agent may not change a severity. To argue that a Blocker is a Nit, it contests and states why. The skill does not say why severity stays fixed.
- The last rule names the author's bias: "A wish to contest is not evidence that the reviewer is wrong."
Evidence-grounded disagreement applies the same citation rule one step earlier, to a critic that audits the reviewer.
The failure mode it guards against¶
The resolver is the author. EGM runs the resolver in "the persistent conversation session that generated the target document" so that it recalls earlier reasoning (egm-resolve). The draft skill gives a reason to skip a self-check at draft time: "The session that wrote the draft agrees with it" (egm-draft). The same bias can affect the resolver, which shares that session (inference).
Inside the review loop, a contested finding is settled and stays closed when a later reviewer raises it again. A fixed finding does re-open (egm-review-loop). A settled finding does not block a clean round, and two clean rounds end the loop (clean round). An unchecked contest can therefore close a real defect for the rest of the loop (inference).
Batch accept applies fixes only¶
When the human replies "auto accept", the agent applies every PROPOSE FIX in one batch. CONTEST, ESCALATE, and DECLINE items are "explicitly bypassed" (auto accept). So every contest stands unless the human objects first (inference). DECLINE items are skipped in the item-by-item walkthrough (breakdown). Escalated findings appear first in the chat message, because "They need the user's knowledge, not only approval" (gate).
Costs and limits¶
- ESCALATE requires human attention because EGM routes it to the user.
- The rules are prompt text, and nothing in the skill checks that a cited file and symbol exist (inference).
- The loop skill settles a finding that is "contested or recorded without a fix (accepted risk)". That wording fits DECLINE (inference), and it does not name ESCALATE (egm-review-loop).
- The report template labels severity High, Medium, or Low, with no mapping to Blocker, Major, and Nit (template).
- Upstream reports no measurement of how often contests or escalations were right. See the EGM evidence section.
Key Takeaways¶
- Outside EGM, give the producer a closed verdict set. Accept a contest only when it cites a file or a recorded decision the reviewer could read.
- Read the contests before you batch-accept fixes. In EGM a batch accept skips contested findings, so each contest stands.
- Let the producer argue severity through a contest, never by relabeling the finding.
- When an outside fact refutes a finding, add it to the document only if a human reader needs it.
- If contested findings stay closed across review rounds, check the contests before the loop counts a round as clean.
Related¶
- Elephant-Goldfish Design Review — the full workflow this protocol belongs to
- Evidence-Grounded Disagreement in Agentic Code Review — a critic must cite code to object to a reviewer
- Critic Agent Pattern: Dual-Model Plan Review — approve-or-reject gating, with structured feedback to the planner
- The Yes-Man Agent — the opposite failure, where the agent accepts every request
- Capturing Dismissal Reasons for Agent Review Findings — a closed vocabulary for human dismissals
- LLM Code Review Overcorrection — reviewers that flag correct work