Astronaut wrote:
If you are nervous about google, just add /links as restricted directory into your robots.txt and you’re good to go.
I am a little confused about the robots.txt file and blocking an entire directory and everything under it. Lets say I have a folder named links, and each page to the casino would be named something like /links/casino1.html , links/casino2.html ect… Where I get confused is if I want to block all of these pages, do I block it like
/links or /links/
I have checked a few of the more prominent gambling portals and I see that people do it differently. I thought if you used /links/ it would block everything in that directory and under it, but I think I might be wrong. Anyone know for sure the right way to do it?