AI RESEARCH
METATR: A Multilingual, Evolving Benchmark for Automatic Text Recognition
arXiv CS.CV
•
ArXi:2605.26712v1 Announce Type: new Benchmarks that reflect the diversity and complexity of real-world documents are essential for accurately evaluating Automatic Text Recognition (ATR) systems, especially Vision-Large Language Models (vLLMs). Although recent models nstrate impressive performance, they are often evaluated on datasets containing modern, printed texts mostly written in English, which limits their relevance to many practical applications. Therefore, selecting a model for a specific use case requires evaluating it on data that matches the target documents.