You are going to block this site. This will do the following:
- You will no longer see this site in searches.
- Site will no longer see your site in searches.
- Site will not be able to comment on your site profile.
- Any comments this site has posted to your profile will not be displayed.
Are you sure you want to do this?
it doesn't look like you have a robots.txt file in your index directory. that'll take care of a lot of the AI bots (not all of them, but most of them). you can use mine as a reference if you like.
how do you see an index directory on purpose, (aside from site editor) i only get that when i half break a link
since the homepage of every website is in the index (or root) directory, you can add "/robots.txt" after anyone's root URL and it will either display one or it'll return 404. you can't view the entire directory this way, but you can see if someone's got a file of a particular name.
In general I still want my site to be scraped for search engines but my settings disallow scraping for AI: https://wren.zone/robots.txt