January 1, 2009 at 9:24 pm
#791374
Member
If you intend to only block the directory you should use a trailing slash else it will block everything that starts with partners, including partners.php
The following command will disable just the directory “partners” and all its contents:
Disallow: /partners/
…while the following command will disable both the “partners” directory and any file or directory path starting with the text “/partners” (so “/partners.php”, “/partners-links.html etc.):
Disallow: /partners
If you didnt intent to block your link resources page you should add that trailing slash at the end.