CCARF Practice Question

Paper 4 · Question 16

D4 Prompt Engineering & Structured Output · Paper 4

Your CI/CD pipeline processes code reviews using the Message Batches API. After a batch completes, you need to match each review result back to the corresponding pull request. What is the correct mechanism for correlating batch results with their original requests?

• A.Parse the review content to identify which pull request it refers to based on file names mentioned in the review
• B.Use the custom_id field in each batch request to store the pull request identifier, then match results by custom_id
• C.Submit each pull request as a separate batch of one item to maintain correlation through the batch ID
• D.Rely on the batch API returning results in the same order they were submitted

Show answer & explanations

Correct answer: B

A: Content parsing is fragile and error-prone. The Batches API provides a built-in mechanism for result correlation.

B: The custom_id field exists specifically for correlating batch request/response pairs. Setting it to the pull request identifier provides reliable, direct correlation without relying on result ordering or content parsing.

C: Submitting individual batches defeats the purpose of batch processing and does not leverage the custom_id mechanism designed for exactly this use case.

D: Batch results are not guaranteed to return in submission order. The custom_id field is the correct correlation mechanism.

Related Prompt Engineering & Structured Output questions

More: Paper 4 · All practice questions