In case you didn’t know, you can’t train an AI on content generated by another AI because it causes distortion that reduces the quality of the output. It is also very difficult to filter out AI text from human text in a database. This phenomenon is known as AI collapse.

So if you were to start using AI to generate comments and posts on Reddit, their database would be less useful for training AI and therefore the company wouldn’t be able to sell it for that purpose.

  • FaceDeer@kbin.social
    link
    fedilink
    arrow-up
    1
    ·
    9 months ago

    Academic Torrents has Reddit data up to December 2023. This data isn’t live-updated, my understanding is that it’s scraped when it’s first posted. That’s how services like removeddit worked, it would show the “original” version of a post or comment from when it was scraped rather than the edited or deleted version that Reddit shows now.

    The age isn’t really the most important thing when it comes to training a base AI model. If you want to teach it about current events there are better ways to do that than social media scrapes. Stuff like Reddit is good for teaching an AI about how people talk to each other.