AI RESEARCH
RotMoLE: Enhancing Mixture of Low-Rank Experts through Rotational Gating Mechanism
arXiv CS.LG
•
ArXi:2605.25565v1 Announce Type: new While Large Language Models (LLMs) are commonly fine-tuned to handle domain-specific tasks before being applied to vertical applications, adapting them to complex scenarios with diverse specialized knowledge remains challenging. Meanwhile, Mixture-of-Experts (MoE) architecture has risen as a crucial paradigm for