Every AI Model Trains on a Curved Surface.

Towards AI
Machine Learning Generative AI AI Research

You have been visualizing the loss landscape wrong. Not slightly wrong. Geometrically wrong. The space where neural networks learn is not…