Restricting Search Bots on all pages accessed by reg'd users
-
-
- ckck
- Newbie
- Posts: 7
- Thanks: 0
-
I'm sure there is a relatively easy solution to this in the robots.txt file, but I'm not sure what the syntax would be.
I have a website that has obviously a public face and a few public pages, then a substantial number of pages (including a phpbb) accessible only to registered users and I don't want any search bots accessing or archiving that information.
What is the most efficient way to accomplish this? All my previous Joomla sites have been all publicly accessible.
Thanks!
-
-
-
- Ragdata
- Elite Rocketeer
- Posts: 614
- Thanks: 0
- Software Engineer
-
Check here:
www.google.com/support/webmasters/bin/an...hl=en&answer=40360#1 - Ragdata's Rubber Duck
www.ragdata.net/
-
Time to create page: 0.054 seconds