Google Spam Guide Adds “Only Index Content Meant for Search”: The robots.txt Route Can Leave URLs Indexed
On October 26 Google added a section called “Only index content meant for Search” to its guide on preventing user-generated spam. It tells platforms to keep…