Get exclusive CAP network offers from top brands

View CAP Offers

xml sitemap / robots meta tags

[bsa_pro_ad_space id=2]
  • This topic is empty.
Viewing 3 posts - 1 through 3 (of 3 total)
  • Author
    Posts
  • #672521
    Anonymous
    Inactive

    From my limited knowledge, you do not need to put anything in there for the robots UNLESS you want to disallow them. The bots will typically follow your site through the links without any help from you.

    Hope that helps.

    kw

    #672530
    Anonymous
    Inactive

    I have also read that it is not necessary to include them unless you don’t want the bots to follow the links or index the pages.

    But then, it can’t hurt to have the tags, can it? :eh:

    So all my pages still have robot tags.

    #672531
    Anonymous
    Inactive

    Nope, won’t hurt to have index, foll in. Only stops bots if you use disallow and that is only if you know the name of the bot AND if the bot follows the rules.

Viewing 3 posts - 1 through 3 (of 3 total)