Robots
-
-
- Penn Wooding
- Elite Rocketeer
- Posts: 873
- Thanks: 0
-
Is it a good sign if you see quite a few robots on your site at regular intervals?
These seem to be on my site more than often
Alexa
Cull
Google AdSense
Google
MSN
Yahoo
Yandex - http://www.Oscarfishlover.com - the website for great Oscar Fish advice and help
-
-
-
- The Wingman
- Elite Rocketeer
- Posts: 1208
- Thanks: 0
-
If you wan to be found (indexed) in search engines. The robots (spiders) are indexing your site and adding it to their search database.
A good thing if you site is completely done and SEO'd, :cheesy: a bad thing if your still working on it.
Other than that - if you don't want to be indexed. You can adjust the robot code or I think I saw a plugin or module at Ninjoomla.com where you can use it to block robots.
Hope that helped,
Wingman - Last Edit: 15 years 8 months ago by The Wingman.
- "You can learn a lot from a dummy. So, pay attention to yourself." Quote by me.
-
-
-
- Penn Wooding
- Elite Rocketeer
- Posts: 873
- Thanks: 0
- I often read about people not wanting the robots on their site so I just wanted to clarify a few things. Why people wouldn't want their websites indexed is a little puzzling, but anyway.I have just revamped and migrated my website and it is all finished now. It was doing very well before, so we will continue that trend.
- http://www.Oscarfishlover.com - the website for great Oscar Fish advice and help
-
-
-
- The Wingman
- Elite Rocketeer
- Posts: 1208
- Thanks: 0
-
People are ignorant for the most part, there might be a legitimate reason here or there, but for the most part - ignorance and stupidity.
#1) Take deep linking. An idiotic term for the most part. A link is a link is a link...just as an address, is an address, is address. There to get people to what they want see. But some see that as the term "deep linking" when you try to connect to anything but the homepage.
They consider it unethical and that it takes away from the user experience that they want to provide or cuts into their homepage profits. A Danish paper sued Google last year saying that Google has to pay a commission to them to index deep links or just send the users to the front page.
They also, stated the proper etiquette for users is when reading an article is to never send their family or friend to the article itself via email or pm or any form, but to send them to the front page so they can enjoy the experience that they, the newspaper, has set up via the web site.
Of course your family or friend would then have to scour the entire web to figure out where you were talking about. This is the equivalent of the New York Times instructing its paper readers, never clip out an article and send it via mail to your family and friends, the proper etiquette is to buy additional copies for them, mail it to them and then they can find the article themselves.
Please Note: Pretty much every article in that Danish paper has Google Deep Links in it from the Reporters reporting on the web.
#2) People think that when someone is informing others about a specific article and/or content they think it is a copyright violation. (LMAO) Hence, they have no understanding of "Fair Use" or why "Fair Use" is important. They feel that a thumbnail of the image and sample text from their website violates their rights and they should be paid or compensated.
If the CNN News came out with cameras and did a report on them - using video, pictures and sample text to do that report would be, in there mind, a copyright violation. Even though that falls under the "Fair Use" act. Hence, search engines provide a viable source of information and service to the public that they fall under the fair use act just like the news does, but again people are ignorant and stupid.
Closing -
A public address is freely available to everyone...if you can drive or walk by it without restrictions (like a closed community) - you can tell anyone the address. Hence, if you can see it on the web freely then - Yahoo.com is the street address and Yahoo.com/anything is the house numbers.
And if you want a closed community - put subscription on it...but wait - a lot of idiots found out the hard way (went out of business on the web) that you have to be really well established or have something extra special, cause why would consumers pay for a subscription when they can go else where and get it free by searching Google.
Hope that helps and Peace out,
Wingman - "You can learn a lot from a dummy. So, pay attention to yourself." Quote by me.
-
Time to create page: 0.075 seconds