For example, there’s one called “nicebot”, a needless bot. It identifies itself as “nicebot” in the user-agent. There’s dozens out there like that and they’re useless.
What I find funny is I blocked “baidu” a year ago. Now theyre trading stock as of last week. Still means nothing to me, they do me no good and just eat up bandwidth.
There’s many bots who will not identify themselves. They keep things “browser-like” because they know more than likely they’ll get banned. I still watch behaviors, if they don’t identify themselves.