AI RESEARCH
Reparametrizing Shampoo and SOAP for Subspace Basis Updates and BFloat16 Storage
arXiv CS.LG
•
ArXi:2605.26327v1 Announce Type: new Shampoo-based methods, such as KL-Shampoo and SOAP, have nstrated strong performance in