AI RESEARCH
How Many Tools Should an LLM Agent See? A Chance-Corrected Answer
arXiv CS.AI
•
ArXi:2605.24660v1 Announce Type: cross Before an LLM agent can use a tool, a retrieval system must decide which candidate tools to show to the agent. How long should that shortlist be? Show too many tools and the model struggles to choose. Show too few and the correct tool may not appear. Most systems apply a fixed shortlist size to every query, but no standard metric exists to evaluate whether that size was appropriate.