February 27th 2001
More bots
Alexa’s bot is hitting us. Added to list of bots to stop it from crawling more than 4 levels deep in the browse hierarchy.
February 27th 2001
Alexa’s bot is hitting us. Added to list of bots to stop it from crawling more than 4 levels deep in the browse hierarchy.
February 7th 2001
I was wrong… AltaVista is still hitting us. I hope they stop before the demo!