Hmmm… Do you do that by adding a rule to the .htaccess file? Or to the robots.txt file?
Reply To: Is this a scraper or just an annoying spider?
-
For Advertisers
-
List Your Affiliate Program
iGaming Services
Find a Gaming Product and Service Provider-
Services Categories
- Business Consulting
- Copyright
- Domains
- Hosting
-
For Advertisers
-
Sell My Product or Service Now!