ROCKETTHEME IS CLOSING ON JUNE 30, 2025. As a thank-you to our community, enjoy 50% off all themes with the promo code THANKYOU before we shut down.
Read our Farewell Blog Post for more details.
Restricting Search Bots on all pages accessed by reg'd users
Posted 16 years 2 months ago
I'm sure there is a relatively easy solution to this in the robots.txt file, but I'm not sure what the syntax would be.
I have a website that has obviously a public face and a few public pages, then a substantial number of pages (including a phpbb) accessible only to registered users and I don't want any search bots accessing or archiving that information.
What is the most efficient way to accomplish this? All my previous Joomla sites have been all publicly accessible.