AI RESEARCH
Unraveling LoRA Interference: Orthogonal Subspaces for Robust Model Merging
arXiv CS.AI
•
ArXi:2505.22934v2 Announce Type: replace-cross Fine-tuning large language models (LMs) for individual tasks yields strong performance but is expensive for deployment and storage. Recent works explore model merging to combine multiple task-specific models into a single multi-task model without additional