Yes, you can block spiders. But you have to know them to block them as far as I can tell. I’m not very talented here either.
The reason started this thread is that out of some 40,000 sites scraping me, almost all of them are out of Israel.
This has nothing to do with race or anything, it has to do with some syndicate that happens to be located in that country.
And they are stealing our hard work and capitalizing on it.
Yes, likely they will start using more proxies and then blocking IPs will be useless. :hmmm:
It also gets convoluted since if they can’t scrape me directly, they can scrape the Search engines for my listings and use those. As a matter of fact a ton of sites do that.
One thing I am hearing from several sides now is that there is a large grup of professional scrapers located in Israel that are being hired by certain programs.
If I can’t block these scrapers somehow, maybe one needs to get real serious with these programs. :banger: