SOURCE-LINKED INTELLIGENCE

Teacher Geometry Shapes Learnability in Teacher-Student Networks

arXiv · AI, language, vision and robotics · article · Sep 9, 2026 · UTC

Teacher-student systems, in which a teacher neural network generates training labels so that a student neural network can learn to implement the same function, are widely used as an abstract setting to study learning. However, the structure of the teachers is often overlooked by assuming randomly-generated, normally-distributed parameters. This hides substantial variation in how learnable different teachers are. We formalize learnability as the success rate of converging to the global minimum, as a function of overparameterization, learning algorithm, student initialization distribution, and t

Read original source ↗ Open in workspace

recordType

paper

region

Global