AI RESEARCH
BenchTrace: A Benchmark for Testing Reflection Ability and Controlled Evolution in LLM Agents
arXiv CS.AI
•
ArXi:2605.29225v1 Announce Type: new Self-evolving agents improve over time by reflecting on past failures, but existing evaluation is limited in two ways: it measures only task scores, leaving reflection quality unknown, and it relies on agents' own episode runs, offering no mechanism to target specific failure patterns. We present \textbf{BenchTrace}, a benchmark for evaluating self-evolution ability in LLM agents.