AI RESEARCH
Escaping the Mode Lottery: Multi-Response Training Improves Language Model Generalization
arXiv CS.LG
•
ArXi:2606.00544v1 Announce Type: new Modern language-model fine-tuning typically pairs each prompt with a single response, even though many prompts admit multiple valid completions. This effectively reduces a multi-modal conditional distribution to a one-sample view, a phenomenon we call the "mode lottery," where