$> BREAKING RADIO SILENCE TO POST THIS PSA: if your site is older than ~2 months (made before ~october 2025), and ever since the site's creation you blocked AI crawlers using the robots.txt file, you might want to update it. details in reply
9 likes
![[N6] avatar](/site_screenshots/22/24/blankbarrel/index.html.50x50.webp)
my site used a version from february 2025, which had blocked 37 crawlers. the most recent version of the text file that neocities uses (according to a post from january 2025) (https://github.com/ai-robots-txt/ai.robots.txt/blob/main/robots.txt) currently blocks 129 crawlers. it does not remove any blocks present in the february version, so the most recent file blocks an additional 92 crawlers
thanks boss! 🫡