CCARF Practice Question

Paper 2 · Question 4

D4 Prompt Engineering & Structured Output · Paper 2

Your CI/CD code review pipeline has a 40% false positive rate on 'documentation mismatch' findings, causing developers to ignore ALL review categories. What is the most effective fix?

• A.Add 'only report high-confidence documentation issues' to the system prompt
• B.Temporarily disable the documentation mismatch category while refining its prompts with explicit criteria and code examples
• C.Increase the model temperature to get more varied results and filter outliers
• D.Add a second model pass to verify each finding before reporting

Show answer & explanations

Correct answer: B

A: Vague confidence instructions do not improve precision. The model has no concrete criteria for what 'high- confidence' means.

B: This restores trust in other categories immediately while you iterate on the problematic category with specific criteria.

C: Temperature affects randomness, not precision. This would likely increase false positives.

D: A second pass without better criteria will have the same false positive problem. Fix the criteria first.

More: Paper 2 · All practice questions