AI RESEARCH

Muon in Vision Transformers: Optimizer-Recipe Interactions and Gradient Spectra

arXiv CS.LG

ArXi:2605.24770v1 Announce Type: new Muon is a recently developed matrix-aware optimizer that has shown strong results in transformer