You are going to block this site. This will do the following:
- You will no longer see this site in searches.
- Site will no longer see your site in searches.
- Site will not be able to comment on your site profile.
- Any comments this site has posted to your profile will not be displayed.
Are you sure you want to do this?
httrack and not a single mention of wget
;-(
wget is useful; here is a strong opinion on robots.txt: http://archiveteam.org/index.php?title=Robots.txt