AI RESEARCH

Do Deep Networks Forget Initialization? A Forgetting-Time View of Practical Inductive Bias

arXiv CS.LG

ArXi:2605.29152v1 Announce Type: new Randomly initialized neural networks induce a prior over functions, but the predictor used in practice is produced only after