augustf’s Twitter Archive—№ 59,256

Was just reminded today after seeing a bunch of Netcraft traffic on a site I run that @Netcraft remains a bad actor with bots that totally disregard robots.txt. @richardpoole/265456675710963712