Watch Out: How free dataset Is Taking Over and What to Do About It

https://www.instapaper.com/read/1690076694

This will allow Goggle (user-agent identify GoogleBot) to go to just about every web site and directory, even though simultaneously banning Ask Jeeves in the web site fully