AI RESEARCH

SLU-2K: A Question-Based Benchmark for Semantic Evaluation of Sign Language Translation

arXiv CS.CV

ArXi:2606.03788v1 Announce Type: new Sign Language Translation (SLT) is typically evaluated with surface-form metrics such as BLEU and ROUGE, which reward lexical overlap but do not directly measure whether a translation preserves the meaning of the source sign sequence. This is in contrast with the final objective of integrating SLT in assistive technology. In this work, we shift the focus from Sign Language Translation (SLT) to Sign Language Understanding (SLU), with particular emphasis on semantic understanding.