August 14, 2005 at 6:24 pm
#670802
Inactive
Legit bots won’t, like Google, MSN, Yahoo, etc. But poorly coded bots that everyone and their mother seems to come up with nowadays really don’t work well enough to distinguish between things they should and should not visit (“click”). Most don’t obey robots.txt either.
That’s why I have many of them blocked from hitting my sites. At least the ones that identify themselves through the User-Agent field.