AI RESEARCH
Denoise First, Orthogonalize Later: Understanding Momentum in Muon via Spectral Filtering
arXiv CS.LG
•
ArXi:2606.03899v1 Announce Type: new Muon has recently nstrated strong empirical performance in large language model