AI RESEARCH
SLAD : Shared LoRA Adapters for Task Specific Distillation
arXiv CS.CV
•
ArXi:2605.29726v1 Announce Type: new In the context of resource-constrained environments such as embedded systems, adapting reduced-size foundation models to downstream tasks has become increasingly popular. This has recently motivated the emerging setting of task-specific distillation, where a larger and a smaller version of the same foundation model are both adapted to the same downstream task, with the goal of transferring knowledge from the former to the latter.