There Will Be a Scientific Theory of Deep Learning
Jamie Simon and 13 coauthors posted a 41-page arXiv paper arguing that a scientific theory of deep learning is emerging. The abstract groups evidence into five strands, including solvable settings, tractable limits, simple mathematical laws, hyperparameter theory, and universal behaviors. The key claim is a falsifiable, quantitative “learning mechanics” for training dynamics, representations, weights, and performance, not a loose manifesto.
Why it matters: Fourteen authors group existing deep learning theory into five threads and argue a testable quantitative theory is emerging, giving scattered results a shared outline.