Neocities.org
blackrabbitden
1 year ago
Anybody who wants to block ai scrapers, you can make a robots.txt file and block these user agents: https://github.com/ai-robots-txt/ai.robots.txt/blob/main/robots.txt
1 like
