AI RESEARCH

DuDi: Dual-Signal Distillation with Cross-Lingual Verbalizer

arXiv CS.CL

ArXi:2606.04694v1 Announce Type: new Small language models (SLMs) are efficient and scalable, but their multilingual capabilities degrade severely at sub-billion scales, especially for Southeast Asian (SEA) languages. We