mr pibbs site

mr-pibbs-site.neocities.org

155,454 views
55 followers
807 updates
0 tips
what is Wibly's user agent. is it just Wibly. i want to allow only Wibly to crawl my site
1 like
1 like
mr-pibbs-site's avatar mr-pibbs-site 8 months ago

there's conflicting information online about this robots.txt stuff, like robotstxt.org says to allow a crawler you just do "Disallow: " but the one Neocities dropped uses Allow

1 like

Website Stats

Last updated 3 months ago
CreatedDec 10, 2021
Site Traffic Stats

Tags

videogames music blog things tabletop