Buy Hosting

Your browser does not seem to support JavaScript. As a result, your viewing experience will be diminished, and you have been placed in read-only mode.

Please download a browser that supports JavaScript, or enable it if it's disabled (i.e. NoScript).

@mr_whateley @remoquete @ChacheNeguer @activitypugtest it could, but it has been demonstrated multiple times that AI crawlers ignore robots.txt - so I’m just not sure how effective it would be

Uncategorized

1 Posts 1 Posters 7 Views

J This user is from outside of this forum

J This user is from outside of this forum
John O'Nolan
wrote last edited by

#1

@mr_whateley @remoquete @ChacheNeguer @activitypugtest it could, but it has been demonstrated multiple times that AI crawlers ignore robots.txt - so I’m just not sure how effective it would be
1 Reply Last reply
0