AI RESEARCH
LLM Zeroth-Order Fine-Tuning is an Inference Workload
arXiv CS.LG
•
ArXi:2605.28760v1 Announce Type: new Zeroth-order (ZO) fine-tuning is attractive for large language models because it replaces backpropagation with forward objective evaluations. Existing implementations nevertheless execute ZO algorithms inside conventional