There is a specific meta tag designed for this situation. http://www.site.com/article” /> <-- this tells the search engines which is the correct page to index but i am unsure if it stops the alternate versions from bleeding link juice or factoring in other ways Regarding the robots.txt The problem is that the robots entry will stop the robots from visiting that page but it will still factor into things in a number of other ways. IMO your best solution, if possible, 301 redirect the /home/article pages to the /article pages. In theory you pass any pagerank and keyword relevance to the correct page this way as well.