Neocities.org
3 likes
Here’s a friendly reminder to all you wonderful web masters out there to add/update a robots .txt file to your site if you don’t fancy bots scraping everything you’ve made.
7 likes
3 likes
3 likes
2 likes
sorbier
10 months ago
looking forward to your new creative direction!!! well put about that distinct feeling during a transition
2 likes
mikegrindle
10 months ago
cheers guys. I feel like I've set unrealistic expectations by using the word "experimental."
2 likes
colexdev
10 months ago
Love all of your stuff and excited to see everything new that you decide to do!
4 likes
Thought I'd let you know that it looks like your menu links are broken from within your blog posts. I think the issue is that everything is prefixed with '/posts/'. For example, on your 'Do We Truly Know Ourselves?' post, the [links] hyperlink that usually goes to https://colexdev.neocities.org/links is set as https://colexdev.neocities.org/posts/links (leading to a 404). Hope that makes sense and helps!
2 likes
colexdev
10 months ago
I didn't notice that mistake. Thank you so much for sharing. I will fix that up sometime soon. <3
2 likes
2 likes
1 like
>https://mikegrindle.com/posts/surf Regarding alternative search engines: consider mojeek. There are only a few unique search indexes. Of the obscure ones, Mojeek is relatively mature. I have an easier time finding obscure and interesting links on Mojeek than on any other search engine I've tried. Not good for finding a simple answer quickly, but good for finding links. https://www.mojeek.com/about/why-mojeek
4 likes
3 likes
1 like
kaa
10 months ago
colexdev: DuckDuckGo is good at finding a quick, simple answer. It's mostly Bing. https://duckduckgo.com/duckduckgo-help-pages/results/sources/ Mojeek is a janky, small project that's been ongoing for several years. It's a genuinely unique search index. It's bad at giving simple answers, and good at sharing obscure ones.
1 like
4 likes
7 likes
colexdev
10 months ago
Couldn't agree more. I found the vast majority of the small sites I visit frequency through other small sites. I started with just a few and now have dozens that I love. Blogrolls and link pages are the best.
5 likes
getoffmylawn
10 months ago
I agree, the linux community can be nice and we don't need to make Windows users feel bad.
1 like
A new enabler of mediocrity to add to your file: Applebot-Extended
Feel free to pinch mine: https://mikegrindle.com/robots.txt
Thank you, keep forgetting to create one and just did it!
One to add for you: User-agent: TurnitinBot
Thanks! I have one that is pretty extensive so far, I will add anything from yours that I do not have as well as the TurnitinBot that @owlroost mentioned! Thanks all
Do we just add it anywhere on our website?
Thanks for the recommendation, Owlroost. I’ll be sure to add that. @punk-tart, it should go in your site’ root directory (so, not in a “folder”, but the same place as you homepage - hope that makes sense). Cheers all.
Thanks for the clarification, added and good to go! Always appreciate dodging AI