- This topic is empty.
-
Posts
-
Perhaps if you check your raw access logs and find who’s commanding “Get,” you can see which bots (or IPs) are scraping. After which point you can block the bot and IP. Also, do a google search for Israeli Ips, get ALL ranges and start blocking. For instance if their range is from 49.- 52. you can IP BLOCK: 49.* 50.* 51.* 52.*(just an example not a real range.)
Here is the real problem with blocking bots….
Not all bots (and especially scrapers) will say ‘hey, I am ScraperBot!’. Just like Google has many bots that do not say ‘hey, I am googlebot!’
So – without that information, you are back to blocking IP’s. However, there are so many proxies out there (have a look at the major site-type which sells at Sitepoint Marketplace – they are all proxies, directories, and myspace sites).
SO – You can look at your logs and block a proxy IP. That is all well and good, but if it is popular proxy, people may be using it from work so that they can check out your gambling site. Would you want to block them?
Sorry to kill the illusions out there, but this is fact. The only way to defend, IMO, is to watch Copyscape and either hire someone to bring you site names or spend all your time tracking them down instead of updating content.
In either case…. I think we lose.
It’s a tough nut to crack and it is going to take the help of the AFFILIATE PROGRAMS in order to fix the problem. They are the source of the income. If there is no income – there is no scraping in this industry.
Long enough for ya? :blahblah:
This thread is relevant too:
http://www.casinoaffiliateprograms.com/bb/showthread.php?p=66465#post66465
What is the best way to determine if your site is being scraped please?
the best way is to determine if your site is published and accessible to the net.
we’re all being screwed and nobody is immune.
KW: great post and sums up the problem in a nutshell for me.
I’m sick of dancing around the petunias with these scumbag aff programs which feign to be doing something and in truth only are laughing at us.
blacklist their casinos and they’ll feel the pressure.
If we were to stick together and take the stance that if you’re caught supporting scrapers; and are not quick to provide satisfactory and just actions towards the offending aff; and this is seen to happen over and over again, as in the case with 888:
then the casinos promoted by these places should be blacklisted with the same vigor as everyone was willing to do against the aff programs which were breaking contracts.
these places are not just breaking contracts with you; but they are out and out stealing from you.
I often throwout bits of information in the hopes someone catches on to what I am trying to say. I do this because I do not want to demonstrate how these things are done and encourage people to follow suite.
But it would appear some are not understanding fully. In your stats whether it be aswats, webilzer or what ever. Install the auomatic whois, spamhouse or what ever you prefer. Through the course of the day The latest recorded visitors are recorded including spiders, webcrawlers, bot ect…
Next start highlighting the suspecious IP’s and click the whois or what ever to find out where it is coming from. If you determine it to be a threat block the IP or ISP.
I have mine set up so its on my desktop on the left hand side and is running constantly. I set the parameters to my liking and have it set to ping when something wierd comes through. I highlight click on my favorite program to check on the ip and find out who it is.
If I am anyway for the day I let the program run. when I return I retrieve the results.
So if they change proxy servers the program will note the change giving me a ping and I block the new ISP. This called program modification or can be viewed as a hack.
Another way is a little more work check and see the ip’s or isp’s entering your site, highlight the IP or ISP and click the whois that should be located in your toolbar. If you determine it to be threat block the Ip or isp.
Some more useful information is the Ip or ISP is a complete address telling you country, city, person, ports, computer, and a hole lot of other stuff. This you will have to learn on your own. I have posted numerous places to visit to figure this out.
This will not totally solve the problem of the scraper but it will slow them down. Some real answers are coming soon, the antiscrape script. greek39
With this said I do let some take the course, then I track them because now i have the IP. One scaper I tracked moving from Arizona to California with real time sateliite images. I couldn’t firgure out why he was moving very nice neighborhood he was leaving. Lots of backyard tennis courts, olympic size pools, ect.. His name is on this forum. Can anybody quess what his cultural heritage is? greek39
