AI RESEARCH
OmniOPD: Logit-Free On-Policy Distillation via Speculative Verification
arXiv CS.LG
•
ArXi:2606.01476v1 Announce Type: new On-Policy Distillation (OPD) trains a student model on its own generative trajectories under dense token-level feedback from a stronger teacher, mitigating both the off-policy distribution shift of Supervised Fine-Tuning (SFT) and the sparse credit assignment of Reinforcement Learning (RL). However, standard OPD faces two coupled limitations. First, it requires direct access to the teacher's token-level logits, excluding a broad class of capable