Generative AI Polluted the Data

Generative AI has polluted the data I don't think anyone has reliable information about post-2021 language usage by humans. The open Web (via OSCAR) was one of wordfreq's data sources. Now the Web at large is full of slop generated by large language models, written by no one to communicate nothing. Including this slop in the data skews the word frequencies. Sure, there was spam in the wordfreq data sources, but it was manageable and often identifiable. Large language models generate text that masquerades as real language with intention behind it, even though there is none, and their output crops up everywhere.

A screenshot of a text post titled “Generative AI has polluted the data.” It argues that AI-generated web content has contaminated language datasets, making post-2021 word-frequency information unreliable because synthetic text imitates meaningful human language without genuine intent. The meme is shared as a reaction to AI slop overwhelming the internet and corrupting data. EN: A screenshot of a text post titled “Generative AI has polluted the data.” It argues that AI-generated web content has contaminated language datasets, making post-2021 word-frequency information unreliable because synthetic text imitates meaningful human language without genuine intent. The meme is shared as a reaction to AI slop overwhelming the internet and corrupting data.

• @gentoomemes / 13433 2024-09-19