Get exclusive CAP network offers from top brands

View CAP Offers

Reply To: Question about Robots.txt file & "link no follow"

[bsa_pro_ad_space id=2]
#817432
bluepironi
Member

Google webmaster tools recommends and suggests a robots txt file. That is why i added one. So do you say that robots txt file and nofollow links conflict each other ? Thanks

@Warren 230002 wrote:

You should remove the “Allow: /” from your robots.txt file as it’s not necessary and even though you nofollow links, the SE spiders can still access them through toolbars, analytics, other links, etc.

You can “Disallow:” certain sections of your site but again that is only a recommendation to the search engines, not a guarantee.

Hope this helps.