CCARF Practice Question

Paper 1 · Question 18

D4 Prompt Engineering & Structured Output · Paper 1

Your extraction pipeline validates that line item amounts sum to the stated total. For Document A, the sum is £450 but the stated total is £500. For Document B, the 'department' field is missing entirely from the source text. Which retry strategy is correct?

• A.Retry both: send the validation error for Document A and instruct the model to find the missing department for Document B
• B.Retry Document A with the discrepancy error; flag Document B for human review since the information is absent from the source
• C.Retry both documents with the same prompt since extraction is non-deterministic
• D.Skip retries for both and flag them for human review

Show answer & explanations

Correct answer: B

A: Document B's department is absent from the source. Retrying will not make information appear that does not exist.

B: Document A has a fixable discrepancy (the model may have missed a line item). Document B has genuinely absent information — retries are ineffective.

C: Non-determinism does not create information that is absent. Document A may benefit from retry; Document B will not.

D: Document A's discrepancy is likely fixable with error feedback. Skipping the retry wastes the model's self- correction capability.

Related Prompt Engineering & Structured Output questions

More: Paper 1 · All practice questions