Learning Latency-Aware Orchestration for Multi-Agent Systems
arXiv CS.AI
•
Generative AI
AI Research
Multi-agent systems (MAS) coordinate multiple LLM-powered agents through structured workflows, gaining reasoning power but incurring high inference latency from multi-step execution and repeated model invocations. Existing orchestration methods primarily optimize task performance and inference cost, leaving latency largely unaddressed.