Get exclusive CAP network offers from top brands

View CAP Offers

Reply To: Question about Robots.txt file & "link no follow"

[bsa_pro_ad_space id=2]
#817431
Anonymous
Inactive

You should remove the “Allow: /” from your robots.txt file as it’s not necessary and even though you nofollow links, the SE spiders can still access them through toolbars, analytics, other links, etc.

You can “Disallow:” certain sections of your site but again that is only a recommendation to the search engines, not a guarantee.

Hope this helps.