Neocities

mr-pibbs-site

4 months ago

what is Wibly's user agent. is it just Wibly. i want to allow only Wibly to crawl my site

1 like

mr-pibbs-site 4 months ago

WIBY

1 like

mr-pibbs-site 4 months ago

there's conflicting information online about this robots.txt stuff, like robotstxt.org says to allow a crawler you just do "Disallow: " but the one Neocities dropped uses Allow

1 like

Website Stats

Last updated 3 weeks ago

CreatedDec 10, 2021

Site Traffic Stats

Neocities.org

mr pibbs site

Website Stats

This site follows

Followers

Tags