July 6, 2006 at 6:48 pm
#697767
Inactive
I feel your pain Bonusgeek, many honest webmasters do.
Google bot is ignoring my robots.txt file and crawling in directories it specifically is disallowed. I have a bad-bot trap, and the ip’s were being logged and automatically blocked. I had to turn that off when I seen google bot in there.
Ignoring world wide standards means one of three things. Either google is busted, google is “do as we say not as we do,” or I’ve lost my mind and don’t know what the hell I’m doing anymore.
I guess it could be all three too.