What Is Model Collapse? I Trained a Model on Its Own Output, Three Times
The claim is everywhere: if AI systems keep training on text that other AI systems wrote, they get worse. It usually arrives as a warning about the future, with a photocopy-of-a-photocopy analogy attached and no numbers. It is testable at small scale, so I tested it. I trained a language model on a million characters…


