I saw the recent site rip i'm so sorry :(( if you want to block ai crawlers from your site you might want to look into cloudflare protection. For site's our size and personal projects its completely free and lets you block all AI crawlers and other crawlers and gives you reports on what it blocked. Its what I use and i'm really happy with it
thanks sarah :( i'll definitely look into it, and those robots.txt files (even though there's a limit to them too)