In my humble opinion, it is dangerous to place too much faith in the results Google is telling you when looking at indexed pages. For one thing, just like the backlinks Google shows, they lie. Also, there are numerous indexes, not just one, so even if you have X number indexed in one, you may have a widely different number indexed in another. Same with the supplemental results.
As for your original question, I have no idea. I am glad I left when I did, at least from owning my own gambling related sites, but I may ease back in as a small part of my overall picture. From what you are saying though, it would be really hard not to buy it back.