u can opt out though! you need to create a robots.txt file inside ur site folder and then copy and paste the contents of this pastebin inside and remove all the # symbols in the list to stop said crawlers from whipping shitties all over ur webzone: https://raw.githubusercontent.com/neocities/neocities/refs/heads/master/views/templates/robots.txt
i'm slightly concerned that if another crawler comes out that's not on this list i'll have to update it manually, but if i just do the User-agent: * and Disallow: \ that should work on everything right? not concerned with showing up on search engines personally
i have a robots.txt but do the #'s need to be removed to work? just to double check on some things
@mr-pibbs-site um! i believe if you remove the # at the very bottom with the "Disallow: /" it should block all crawling, yes. you may wanna remove the "Allow: /" line near the top as well!!
@seashrine yes, the # symbols are commenting out those lines! removing them will make the robots.txt block the bot on that line (i removed all of them, but left "Disallow: /" with its # so my website will still show up on google searches)
@daikonet thank you! i saw a different one going around and wasn't sure if they were to be removed or not, thanks for clearing that up!
update i did it and one of my drawings got blasted with downvotes.............. i undastand........
thank you so much daiko!!! i've done likewise :D super humbled to be buttoned, gotta work harder on my site! ;_;
THIS IS HAPPENING TO ME TOO I’m kinda nervous
might be from this freak who finds neocities/personal websites and smears them with AI writing on facebook. dunno what their endgame is https://www.facebook.com/groups/indieweb
@rinnegani dont think thats ai.. maybe they just write like that on purpose? like some of the images on personal posts are ai but its just a site highlight page? those exist
the group's description even says it doesn't support the ai takeover
actually only one image there is ai generated, i thought the other was, but i found their site and its just an edited pic of their sona/logo. anyways their writing isnt ai they just type like that
I'm among the newbies! :D I think I found you through the 'global activity' tab (I'm probably an outlier). Love how you laid your site out!
considering that their personal website uses AI for almost every graphic and that they’ve openly endorsed chatgpt in a reply, i wouldn’t be surprised if they use AI for their shoutouts as well, and it certainly looks like it. even if it is just their writing style, every shoutout is near identical with a few words swapped out.
i'm not shitting on them for using AI, it's their website and i would just not care but i am puzzled as to why you would want to use AI if you support the indie web and claim to be against AI
i saw your site through the game dev tag in neocities and it looked so sick!!!