2023/06/12

Researchers Warn of ‘Model Collapse’ as AI Trains on AI-Generated Content

“Just as we’ve strewn the oceans with plastic trash and filled the atmosphere with carbon dioxide, so we’re about to fill the Internet with blah.”
– Security engineering expert Ross Anderson, on the dangers of model collapse as AI trains on AI-generated content. In a new paper, Anderson and team demonstrate a rapid degenerative AI feedback loop where “true underlying data distribution” is forgotten. “This will make it harder to train newer models by scraping the web,” Anderson warns, “giving an advantage to firms that already did, or that control access to human interfaces at scale.”
Metadata: People: / Contributors:
$40 USD