It seems retarded to have to list every single spider you don’t want entering your site when you would think you could just list the ones you do want to enter your site and give some kind of generic command like
Allow: google bot, msn bot, yahoo bot, ect….
Disallow: all others
It would just make sense to me that having some kind of script or generic command for disallowing the bs spiders should be the easy part in fighting these thiefts.
If you can’t give a generic command like the one above perhaps we can all share resources and contribute to a master list of blackhat spiders that we could copy and paste into our robots text file disallowing them.