CCARF Practice Question

Paper 5 · Question 7

D2 Tool Design & MCP Integration · Paper 5

[Scenario: Multi-agent Research System] Production logs show a persistent pattern: requests like “analyze the uploaded quarterly report” are routed to the web-search agent 45% of the time instead of the document analysis agent. Reviewing tool definitions, you find that the web-search agent has a tool `analyze_content` described as “analyzes content and extracts key information,” while the document analysis agent has a tool `analyze_document` described as “analyzes documents and extracts key information.” How should you fix the misrouting problem?

• A.Add a pre-routing classifier that detects whether the user refers to uploaded files or web content before the coordinator decides on delegation.
• B.Rename the web-search tool to `extract_web_results` and update its description to “processes and returns information retrieved from web search and URLs.”
• C.Add few-shot examples to the coordinator prompt showing correct routing: “User uploads a quarterly report → document analysis agent” and “User asks about a web page → web-search agent.”
• D.Expand the document analysis tool description with usage examples like “Use for uploaded PDFs, Word docs, and spreadsheets,” leaving the web-search tool unchanged.

Show answer & explanations

Correct answer: B

A: A pre-router papers over two tools whose names and descriptions both say they analyze content and extract key information.

B: Renaming the web-search tool to `extract_web_results` and updating its description to explicitly reference web search and URLs directly removes the root cause by eliminating semantic overlap between the two tool names and descriptions. This makes each tool’s purpose unambiguous, enabling the coordinator to reliably distinguish document analysis from web search.

C: Few-shot routes fight the overlapping descriptions and miss phrasings that were not in the examples.

D: Clarifying only the document tool leaves analyze_content overlapping it, so an uploaded report can still match the web tool.

Related Tool Design & MCP Integration questions

More: Paper 5 · All practice questions