From my limited knowledge, you do not need to put anything in there for the robots UNLESS you want to disallow them. The bots will typically follow your site through the links without any help from you.
Nope, won’t hurt to have index, foll in. Only stops bots if you use disallow and that is only if you know the name of the bot AND if the bot follows the rules.
Author
Posts
Viewing 3 posts - 1 through 3 (of 3 total)
News in the iGaming and Sports Betting affiliate world moves fast.
Don't miss a beat! Subscribe to the CAP newsletter now.