Reddit Limits Search Engine Access, Google Remains Exception
Reddit has recently tightened its grip on who can access its content, blocking major search engines from indexing recent posts and comments.
This move has sparked discussions in the SEO and digital marketing communities about the future of content accessibility and AI training data.
What’s Happening?
First reported by 404 Media, Reddit updated its robots.txt file, preventing most web crawlers from accessing its latest content.
Google, however, remains an exception, likely due to a $60 million deal that allows the search giant to use Reddit’s content for AI training.
Brent Castors, founder of Search Engine Journal, offers some context:
“Since taking on new investors and starting their pathway to IPO, Reddit has moved away from being open-source and allowing anyone to scrape their content and use their APIs without paying.”
The Google Exception
Currently, Google is the only major search engine able to display recent Reddit results when users search with “site:reddit.com.”
This exclusive access sets Google apart from competitors like Bing and DuckDuckGo.
Lady Gaga announces ‘Harlequin’ album for new film ‘Joker
Ranbir Kapoor in ‘Dhoom 4’
Nepal will play a series against Sri Lanka in 2025
The teaser of movie Actor released
President Hotel Airport’s new branch launch
Top 10 hotels in Nepal
Alia’s debut at Paris Fashion Week
Robert Downey Jr. confirms his return to MCU, but not as Iron Man, to play Marvel villain Dr. Doom.
The iPhone Apple has always desired to create is the iPhone 17 Slim.
HOW JULIAN ALVAREZ OF ARGENTINA COULD “COMPLETE” HEADING THE PARIS FOOTBALL LEAGUE IN 2024
