Get exclusive CAP network offers from top brands

View CAP Offers

Reply To: Php and SQL – Things we can do to make life better

[bsa_pro_ad_space id=2]
#808280
supervince
Member

A search engine that follows robots.txt will never visit the pages or directories in your disallow list. Therefore it will never know your redirects even exist. So how does it give credit for those links when it doesn’t know they exist? On the other hand, a lot more search engines ignore rel=”nofollow” than robots.txt so robots.txt is still a better way to make sure all the major search engines don’t give credit for those links.