July 15, 2011 at 11:24 pm
#817432
Member
Google webmaster tools recommends and suggests a robots txt file. That is why i added one. So do you say that robots txt file and nofollow links conflict each other ? Thanks
@Warren 230002 wrote:
You should remove the “Allow: /” from your robots.txt file as it’s not necessary and even though you nofollow links, the SE spiders can still access them through toolbars, analytics, other links, etc.
You can “Disallow:” certain sections of your site but again that is only a recommendation to the search engines, not a guarantee.
Hope this helps.