- This topic is empty.
-
Posts
-
This sounds like an interesting idea. I might want to do this as well.
How do you block an entire country? I know how to block individual IPs; not so sure how to block a whole country or a “range” of IPs.
If anyone knows how, can you please share? Thanks. 😎
I echoe Dominique’s concern If you have people entering you site from Israel be concerned. The big time scrapers reside in that country, the names can be found on the 888.com scraper thread.
Blocking the IP will provide a partial solution. Be weary of any spider showing up in your stats. Also if possible record the IP deriving from Israel. I have a few and are a direct match for the scrapers names I have listed on the 888.com scraper thread.
The spider used I am still trying to firgure out. greek39
Sounds like a good idea, in theory. However, I would imagine that most of them use a proxy.
ISP block may help as well. I will takin the rest of the day off I am exhausted beyond believe. greek39
Interestingly enough, if you knew your history(real history that is, not CNN history)
You would know that the state of Israel is owned by America, it was annexed to them in 1948 as reward for entering the war on the side of the allies.
The deed to that Palestinian land reads “Rothschild”, the same one who owns the land you call America
I guess it sometimes pays to know these things
The Rothschild family owns the federal reserve and all the money in the world, including the world bank, they also decide what the price of gold will be, and when economic depression should hit, as well as controlling the world’s oil supply.
Rothschild also introduced the world to both the capitalist and communist governments which rule over the world
Quite a legacy, you should get better acquainted with it
I guess what i was trying to say is that by banning Israeli’s, you are in fact banning Americans, since they are the same, just look at the U.S. government, who is running the show…Israel
My political speel…don’t get me started
Almost all scrapers use proxies. The most popular seems to be Japanese
(DeleGate http://www.delegate.org/delegate/) if you block all Israeli IPs they will simply move to a different proxy in a different IP range.This is not an easy nut to crack.
We are talking about blocking specific Ip’s or isp’s if they move to a new proxy I will know about My program picks it up right away.
I have done a enormous amount of research on the matter. I have the names and IP’s Isp’s, adresses ect.. they are all posted on CAP. greek39
My work on this is not complete and won’t be for another two months. I am currently rebuilding my servers and network. I agree do not block the whole country but be cautious on some IP’s coming from Israel. I can name 10 major scrapers who reside in that Country. The same country 888.com began. This why I would not risk the prospect of having pepole coming from israel entering my site.
What’s the harm in blocking a few IP’s greek39
I think most of such “bad boys” use proxy servers. What about not to blocking whole country, but blocking users who are working via proxy? There are a lot of good sides and bad sides, but may be something good can be generated starting from this idea
didn’t they tell you there is no gold in the Federal Reserve President Kennedy used in all making those movies about Americans on the moon. Also it’s the aliens controlling the pressure in the center of the earth. By reducing the pressure it makes it much harder to extract oil. This affects the economy severely the aliens control everything. Forget about the Rothschilds ever since they took Elvis-and Howard Hughes, they’ve been very bored and playing with us. Aliens that the ones responsible thats the ones we have to watch:flush: :flush:
no no no
the freemasons are ruling the worldI am an idiot when it comes to this technical mumbo jumbo, but maybe someone can break this down for me. Since mostly all of everyones traffic comes from google, msn and yahoo would it be possible to make your site just allow the spiders of these major search engines while disallowing all other bs spiders. My understanding is most of this scrapping occurs when blackhats send out automated spiders to grab our content, if we can stop those spiders from entering our site then it solves a large part of the problem.
Isn’t there a way on the robots.txt or meta tags robots file to allow only your selected spiders/robots to enter your site while disallowing all others. There are a lot of smart people out there and it would seem to me that someone could come up with a way to just enable the 20-30 spiders or whatever the number is you want entering your site and blocking all others. I understand this will only stop the automated scrapping, but I think that is at least half the battle. My point is there are only a handful of major search engines. All the rest are pretty much bs so any spider coming to your site other than those from the major search engines don’t help much and are potentially the scrapers spiders. I get the feeling when writing this that I truly don’t have a clue what I am talking about lol.Yes, you can block spiders. But you have to know them to block them as far as I can tell. I’m not very talented here either.
The reason started this thread is that out of some 40,000 sites scraping me, almost all of them are out of Israel.
This has nothing to do with race or anything, it has to do with some syndicate that happens to be located in that country.
And they are stealing our hard work and capitalizing on it.
Yes, likely they will start using more proxies and then blocking IPs will be useless. :hmmm:
It also gets convoluted since if they can’t scrape me directly, they can scrape the Search engines for my listings and use those. As a matter of fact a ton of sites do that.
One thing I am hearing from several sides now is that there is a large grup of professional scrapers located in Israel that are being hired by certain programs.
If I can’t block these scrapers somehow, maybe one needs to get real serious with these programs. :banger:
What is the best way to determine if your site is being scraped please?
It seems retarded to have to list every single spider you don’t want entering your site when you would think you could just list the ones you do want to enter your site and give some kind of generic command like
Allow: google bot, msn bot, yahoo bot, ect….
Disallow: all othersIt would just make sense to me that having some kind of script or generic command for disallowing the bs spiders should be the easy part in fighting these thiefts.
If you can’t give a generic command like the one above perhaps we can all share resources and contribute to a master list of blackhat spiders that we could copy and paste into our robots text file disallowing them.
