@malcriada DO IT!! It's surprisingly fun (for me at least) just be aware it can take a lot of patience ahah
Its funny, bc nekowebs devs and community is just as pro AI as drake lol, reason why I know is bc their discord is full of pro ai brats.
also the devs there on that discord server supporting it too, and doing nothing about the pro ai kids.
inb4 someone complains about Subway Kyle: every fucking professional web developer uses AI to some extent, it's literally industry standard. Kinda sad that that's the case lmao
https://file.garden/ZXGTjTtcLzaPWNqI/robots.txt default robots.txt for those wondering
and it's just a suggestion too, nobody -has- to honor it and a lot of AI scrapers simply don't bother as far as i've seen... hell, it's been my eternal disdain for archive.org, also ignoring robots.txt and forcing me to email them every time i get a new account because i don't want my stuff archived...
@silverheart as much as I love IA I will say that ignoring robots.txt is pretty uncool of them.