SOURCE-LINKED INTELLIGENCE

A Fragility Spectrum for Recursive Language-Model Training

arXiv · AI, language, vision and robotics · article · Sep 10, 2026 · UTC

Model-generated text is finding its way back into training corpora, and there is plenty of evidence that training on such data over and over collapses output diversity. Prior work has studied the phenomenon itself: which protocols and which data mixtures cause collapse. But different models behave very differently under the same process. We fix one recursive contamination protocol and let 13 publicly released checkpoints form an ecosystem that shares a common corpus for five generations. The unique 4-gram outcome after five generations ranges from 0.187 to 0.940 across checkpoints, a roughly f

Read original source ↗ Open in workspace

recordType

paper

region

Global