January 1, 2009 at 6:21 pm
#791365
Member
The robots file tells the spider that it cannot index the contents of that /partners directory. That’s the page where you can automatically add the links. This does not include the pages where the links are posted. /partners is not the same as /partners.php.