/component/ being indexed?
-
-
- mooney101
- Hero Rocketeer
- Posts: 305
- Thanks: 2
-
Google is indexing my /component/ directory which doesn't even exist and this is causing some weird links like http://smokymountainportraits[DOT]com/component/content/section/3?layout=blog which I don't want. How should I prevent this and/or should I?
My current robots.txt
User-agent: *
Disallow: /administrator/
Disallow: /cache/
Disallow: /components/
Disallow: /images/
Disallow: /includes/
Disallow: /installation/
Disallow: /language/
Disallow: /libraries/
Disallow: /media/
Disallow: /modules/
Disallow: /plugins/
Disallow: /templates/
Disallow: /tmp/
Disallow: /xmlrpc/
Disallow: /misc/
Disallow: /cgi-bin/
Disallow: /404-error/
Disallow: /login/
Disallow: /sitemap/
Sitemap: http://smokymountainportraits[dot]com/index.php?option=com_xmap&sitemap=1&view=xmll - Last Edit: 14 years 7 months ago by mooney101.
- Gatlinburg Pigeon Forge Photography
-
-
-
- Charles99
- Jr. Rocketeer
- Posts: 31
- Thanks: 0
- You can use your htaccess file to stop another website from linking to you and the files Google are permitted to indexed! Putting the type of components you have out there could open up your site to a hacker. Especially if any of your components are out of date...
-
-
-
- mooney101
- Hero Rocketeer
- Posts: 305
- Thanks: 2
-
Did a google search I'm a little confused. Should i also add
Disallow: /component/
to the robots.txt? I don't' want it to effect my SEO.
Thanks so much - Gatlinburg Pigeon Forge Photography
-
-
-
- Charles99
- Jr. Rocketeer
- Posts: 31
- Thanks: 0
-
Yes put a disallow for components... You do not want Google or anyone else knowing the type of components you have.
## DISABLE HOTLINKING
RewriteEngine on
Options +FollowSymlinks
RewriteCond %{HTTP_REFERER} !^$
RewriteCond %{HTTP_REFERER} !^http://(www\.)?yourdomain.com/.*$ [NC]
RewriteCond %{HTTP_REFERER} !^http://(www\.)?yourotherdomain.com/.*$ [NC]
RewriteRule \.(gif|jpg|jpeg|png|js|css)$ - [F]
## PREVENT VIEWING OF .HTACCESS
<Files .htaccess>
order allow,deny
deny from all
</Files>
This will protect your htaccess file from being index or being link to or reviewed. Plus stop anyone from linking to your images or stealing your bandwidth... Make sure to place your domain name above. This goes into your HTACCESS file.
## SITE REFERRER BANNING
RewriteEngine on
Options +FollowSymlinks
RewriteCond %{HTTP_REFERER} badsite\.com [NC,OR]
RewriteCond %{HTTP_REFERER} badsite\. [NC,OR]
RewriteCond %{HTTP_REFERER} sub\.badsite\.com [NC]
RewriteRule .* - [F]
This is for banning a site thats trying to hack into yoursite or spam you. You should start looking at you logs files to see who is visiting your site... Not everyone is trying to index your pages but trying to find a way to hack your system... If you notice any I.P. Addresses or Website thats requesting system files you would place their names in referrer. Block them... [F] will generate a 404 error which is blocking them.
When you put it together it should look like the following, starting at the top of the page:
Options +FollowSymlinks
RewriteEngine on
## DISABLE HOTLINKING
RewriteCond %{HTTP_REFERER} !^$
RewriteCond %{HTTP_REFERER} !^http://(www\.)?yourdomain.com/.*$ [NC]
RewriteCond %{HTTP_REFERER} !^http://(www\.)?yourotherdomain.com/.*$ [NC]
RewriteRule \.(gif|jpg|jpeg|png|js|css)$ - [F]
## SITE REFERRER BANNING
RewriteCond %{HTTP_REFERER} badsite\.com [NC,OR]
RewriteCond %{HTTP_REFERER} badsite\. [NC,OR]
RewriteCond %{HTTP_REFERER} sub\.badsite\.com [NC]
RewriteRule .* - [F]
## PREVENT VIEWING OF .HTACCESS
<Files .htaccess>
order allow,deny
deny from all
</Files>
-
-
-
- mooney101
- Hero Rocketeer
- Posts: 305
- Thanks: 2
- I have a Disallow: /components/ already but your saying also add Disallow: /component/ Just want to make :cheesy:
- Gatlinburg Pigeon Forge Photography
-
-
-
- Charles99
- Jr. Rocketeer
- Posts: 31
- Thanks: 0
- Don't change it leave it as is... just pointing out that you need to place it there in order to control the good bots, the bad bots is going to index your site no matter what you have, thats why you have to ban the bad bots...
-
-
-
- mooney101
- Hero Rocketeer
- Posts: 305
- Thanks: 2
- thank you for the advice
- Gatlinburg Pigeon Forge Photography
-
-
-
- Tyndie
- Preeminent Rocketeer
- Posts: 8803
- Thanks: 3
-
It would be a better practice if you use a 301 redirect in htaccess file for old url's that your want to redirect to new ones.
You can find these out by doing a site search on your domain with google.
-
-
-
- Cazzeggio Libero
- Sr. Rocketeer
- Posts: 152
- Thanks: 0
-
/component is an "abstract directory" used by Joomla SEO for components accessing by router.php files (if the component has that file). Briefly, it is used by Joomla for SEO urls building.
It's different from /components folder,where are stored components files and it exists as real folder.
An example
/component/content/xxx-aliasarticle.
Nothing to worry about it.
- Joomla 1.5.20
PhpBB 3.0.7 PL1
p8pBB Bridge 1.3.4.
Apache 2.2,MySQL 5.1,PHP 5.2.13.
-
Time to create page: 0.055 seconds