mr pibbs site

mr-pibbs-site.neocities.org

154,027 views
54 followers
807 updates
0 tips
what is Wibly's user agent. is it just Wibly. i want to allow only Wibly to crawl my site
1 like
1 like
mr-pibbs-site's avatar mr-pibbs-site 7 months ago

there's conflicting information online about this robots.txt stuff, like robotstxt.org says to allow a crawler you just do "Disallow: " but the one Neocities dropped uses Allow

1 like

Website Stats

Last updated 2 months ago
CreatedDec 10, 2021
Site Traffic Stats

Tags

videogames music blog things tabletop