Reddit is blocking The Internet Archive from indexing its posts
Reddit is putting in measures to prevent The Internet Archive from scraping its content and backing it up. Reddit officials say this new change is a result of AI scrapers being able to parse through The Wayback Machine's content, even when Reddit blocks them from scraping their own site. Currently, Reddit allows AI to be trained off of its data, but only through paid access, such as its deal with Google in 2024. There's further concern from Reddit's side, as they also believe that The Internet Archive should better respect privacy and not host content that users choose to remove, such as deleted comments.
The new changes have already gone out, and for now, The Wayback Machine can only preserve the front page of Reddit, and not specific subreddits or user profiles.














