Neocities.org

mr pibbs site

mr-pibbs-site.neocities.org

134,532 views
52 followers
796 updates
0 tips
what is Wibly's user agent. is it just Wibly. i want to allow only Wibly to crawl my site
1 like
1 like
mr-pibbs-site 2 months ago

there's conflicting information online about this robots.txt stuff, like robotstxt.org says to allow a crawler you just do "Disallow: " but the one Neocities dropped uses Allow

1 like

Website Stats

Last updated 3 weeks ago
CreatedDec 10, 2021
Site Traffic Stats

Tags

videogames music blog things tabletop