CCARF Practice Question

Paper 4 · Question 6

D1 Agentic Architecture & Orchestration · Paper 4

The moderation system handles appeals where users contest a moderation decision. Currently, the same agent that made the original decision re-evaluates the appeal. Appeal overturn rates are suspiciously low. What is the most effective architectural change?

• A.Automatically overturn decisions where the user provides any appeal justification to improve user trust
• B.Route appeals to a separate agent instance that cannot see the original reasoning, given only the content and the user's justification.
• C.Route every appeal to a human reviewer with full authority to overturn the automated decision, taking the original agent out of the appeal path entirely.
• D.Add stronger instructions to the appeal handler's prompt requiring it to weigh the user's perspective fairly and set aside its earlier decision.

Show answer & explanations

Correct answer: B

A: Automatic overturn on any appeal completely undermines moderation. Users who genuinely violated policies would simply appeal every decision.

B: A fresh agent instance without access to the original reasoning context evaluates the content independently. This avoids confirmation bias from the original decision. The appeal agent sees only the content and the user's argument, enabling a genuinely independent review.

C: Human review for every appeal does not scale and removes the benefit of automated moderation. Some appeals can be resolved automatically by a separate, unbiased instance.

D: Prompt instructions cannot overcome the bias of an agent reviewing its own decision. The original reasoning context still influences the re-evaluation regardless of instructions.

Related Agentic Architecture & Orchestration questions

More: Paper 4 · All practice questions