SOLVED - How to disallow a category/menus in robots.txt ?
Posted 13 years 7 months ago
Can anyone tell me how to correctly put a disallow line in my robots.txt file so Google/Bing/Yahoo don't index articles in a particular category or menu on my RT site?
I want to prevent any duplicate content penalties from the search engines since some of the articles on one category/menu will be duplicates from other sections of my site.
Thanks for any advice!
NOTE to forum mods:Right-Click is disabled on my site but source code is visible. Unfortunately, I have some images on my site that are licensed and the agreement is that right-click be disabled. I use the F12 key for Firebug instead of right-click. Sorry for the inconvenience.
Re: SOLVED - How to disallow a category/menus in robots.txt ?
Posted 12 years 11 months ago
Tom,
Sorry for the very late reply. I don't login often to my RT account so I didn't know you needed an answer to my post.
I marked this post as "solved" because I didn't find a solution so I left the robots.txt as is. I didn't want to leave an unsolved post on the forum since I didn't need an reply to it anymore.
Sorry about the late reply!
NOTE to forum mods:Right-Click is disabled on my site but source code is visible. Unfortunately, I have some images on my site that are licensed and the agreement is that right-click be disabled. I use the F12 key for Firebug instead of right-click. Sorry for the inconvenience.