| Hub You |
Hubs | Hubbers | Topics | Request |
| #1 in Business | Subscribe Email Print |
|
You are here: Home > Internet and Businesses Online > Web Development > Effectively Using Robots Meta Tags |
|
Hub You - Effectively Using Robots Meta Tags
The Annoyance of Duplicate Content ngines, but any links on that page will not be followed.You want to know what's annoying to the average Internet user? Typing something into Google, Yahoo, or MSN and getting a whole slew of entries to check -- and then realizing that half of them are the exact same article, posted in dozens of different venues. On Usenet newsgroups, it's called cross-posting, and people hate it. On the Web at large, it's even more damaging to the user, because instantly their favorite research resource becomes half as useful as it might have been. Many netizens view it as somewhat akin to spamming, and it surely isn't going to persuade them to spend money at your site. Recently, search engines have come to recognize the effects of duplicate content on the Web, and -- with Google in the lead -- have made serious efforts to crack down on it and clean up their search returns.Unique Co 4. (meta name="robots" content="noindex,nofollow") When using this tag, the search engine spiders will not include this page in their directory and will not follow any links on the page either. Where does the "robots" tag belong? The "robots" meta tag should be used within the (head) and (/head) tags of your page. These tags are located at the top of the html coding. It will look something like this: (html) Blog Profiting From Article Marketing The "robots" meta tag, when used properly, will tell the search engine spiders whether or not to index and follow a particular page. For the purposes of this article, we will be using the "( )" symbols to represent the "< >" in html coding.There are many ways to use article marketing to increase traffic to your blog and thereby increasing the possibilities of more sales including promoting your own products, good affiliate marketing results and even generating more Adsense clicks on your blog.Placing your articles in popular article directories will give you the opportunity to direct traffic to your blog using your author's bio to link to your site.Writing insightful, quality content gives you a better chance of having someone reprint your article on their site with your link in the bio. Others may like your article so much they will send it to their list and overnight you could receive a lot of traffic and make a lot of sales.One thing you want to be sure to do is have the content on your blog related to the article you are having pu Some examples of robot usage are as follows: (meta name="robots" content="index,follow") (meta name="robots" content="noindex,follow") (meta name="robots" content="index,nofollow") (meta name="robots" content="noindex,nofollow") Let us first examine what these terms mean before we explain the usage for each one: "index"- This directive tells the search engine robots (or spiders) that it is okay to index the page. Another words, you are allowing the search engine to include your page within their search directory. "noindex"- Using this tag, you are informing the robots that this page should not be indexed. Simply put, this page will not appear in their search directory. "follow"- When you use this tag, you are telling the search engines that you want their robot to follow any links that are found on that page. "nofollow"- The opposite of the above definition, this directive will tell the robots not to follow any links on your page. Putting It All Together: With the robots tags explained, let's examine the usage for each one. 1. (meta name="robots" content="index,follow") This tag will be used when you want the search engine spiders to index the page and follow the links to other pages. Most search engines use this setting as a "default" setting. It is possible that you may not even need to use this tag if you want the search engines to follow and index the page. However, an article at Search Engine World (searchengineworld.com/metatag/robots.htm) suggests that Inktomi does not use this as their default setting. Instead, they use the "index, nofollow" tag. Better safe than sorry! There has been much debate over whether or not it is necessary to use this tag. If there is even a slight possibility that some search engines do not use this as the default setting, then it would only make sense to include this tag if you want your page included in their search directory AND your links to be followed. Do the research and decide for yourself. 2. (meta name="robots" content="noindex,follow") This tag can be used to tell the search engines that you do not want the page included in their directory, but you DO want them to follow the links that lead to other pages. A good example of its usage would be your disclaimer or privacy policy pages. You may not want these pages to show up in the search engines if they are only important to your actual visitors. However, if the links on these pages point to other pages that you want the search engines to find, then you would still want the spiders to "follow" those links. 3. (meta name="robots" content="index,nofollow") This tag will allow your page to be indexed in the search engines, but any links on that page will not be followed. 4. (meta name="robots" content="noindex,nofollow") When using this tag, the search engine spiders will not include this page in their directory and will not follow any links on the page either. Where does the "robots" tag belong? The "robots" meta tag should be used within the (head) and (/head) tags of your page. These tags are located at the top of the html coding. It will look something like this: (html) Ebay Business Opportunity - When The Money Comes Rolling In include your page within their search directory.Why are so many people turning to the Ebay business opportunity in hope that it will help turn their lives around? Let us take away the word hope and replace it with - HOW the Ebay business opportunity has helped people worldwide and is still continuing to do so with their offerings of a no risk Ebay business opportunity.Living day to day struggling to make ends meet - wondering how the next bill is going too paid has caused many people unnecessary stress - forcing them to pill pop to rid headaches. Well if you have decided enough is enough and going to make a stand to put all that in the past- then your choice to run your very own Ebay business was a wise one.No up front fees - no 9 to 5 commitment - no refusal from an employer for extra overtime to help with the bills - well no kidding, believe it or not "noindex"- Using this tag, you are informing the robots that this page should not be indexed. Simply put, this page will not appear in their search directory. "follow"- When you use this tag, you are telling the search engines that you want their robot to follow any links that are found on that page. "nofollow"- The opposite of the above definition, this directive will tell the robots not to follow any links on your page. Putting It All Together: With the robots tags explained, let's examine the usage for each one. 1. (meta name="robots" content="index,follow") This tag will be used when you want the search engine spiders to index the page and follow the links to other pages. Most search engines use this setting as a "default" setting. It is possible that you may not even need to use this tag if you want the search engines to follow and index the page. However, an article at Search Engine World (searchengineworld.com/metatag/robots.htm) suggests that Inktomi does not use this as their default setting. Instead, they use the "index, nofollow" tag. Better safe than sorry! There has been much debate over whether or not it is necessary to use this tag. If there is even a slight possibility that some search engines do not use this as the default setting, then it would only make sense to include this tag if you want your page included in their search directory AND your links to be followed. Do the research and decide for yourself. 2. (meta name="robots" content="noindex,follow") This tag can be used to tell the search engines that you do not want the page included in their directory, but you DO want them to follow the links that lead to other pages. A good example of its usage would be your disclaimer or privacy policy pages. You may not want these pages to show up in the search engines if they are only important to your actual visitors. However, if the links on these pages point to other pages that you want the search engines to find, then you would still want the spiders to "follow" those links. 3. (meta name="robots" content="index,nofollow") This tag will allow your page to be indexed in the search engines, but any links on that page will not be followed. 4. (meta name="robots" content="noindex,nofollow") When using this tag, the search engine spiders will not include this page in their directory and will not follow any links on the page either. Where does the "robots" tag belong? The "robots" meta tag should be used within the (head) and (/head) tags of your page. These tags are located at the top of the html coding. It will look something like this: (html) Sales And Crawlers, Update! Update! Update! links to other pages. Most search engines use this setting as a "default" setting. It is possible that you may not even need to use this tag if you want the search engines to follow and index the page. However, an article at Search Engine World (searchengineworld.com/metatag/robots.htm) suggests that Inktomi does not use this as their default setting. Instead, they use the "index, nofollow" tag.The importance to the algorithmic web crawlers that speed throughout the web is crucial to the successful marketing campaign of your site. Your site would simply be a pretty compilation of HTML, XML, Java and the sort if search engine crawlers did not come around and look over your site. These amazing little creatures are absolutely incredible software inventions those only purpose in life is to “crawl” the web.Jumping from site to site through links, as though in a web, (hence the WWW) these programs evaluate not only the relative importance of your site, but also have the uncanny ability to know whether or not you’ve been updating. Updating your site is one of the most crucial things you can do for your internet marketing. The crawlers love updates, they love fresh new content, and from EnkiTel.com experience, t Better safe than sorry! There has been much debate over whether or not it is necessary to use this tag. If there is even a slight possibility that some search engines do not use this as the default setting, then it would only make sense to include this tag if you want your page included in their search directory AND your links to be followed. Do the research and decide for yourself. 2. (meta name="robots" content="noindex,follow") This tag can be used to tell the search engines that you do not want the page included in their directory, but you DO want them to follow the links that lead to other pages. A good example of its usage would be your disclaimer or privacy policy pages. You may not want these pages to show up in the search engines if they are only important to your actual visitors. However, if the links on these pages point to other pages that you want the search engines to find, then you would still want the spiders to "follow" those links. 3. (meta name="robots" content="index,nofollow") This tag will allow your page to be indexed in the search engines, but any links on that page will not be followed. 4. (meta name="robots" content="noindex,nofollow") When using this tag, the search engine spiders will not include this page in their directory and will not follow any links on the page either. Where does the "robots" tag belong? The "robots" meta tag should be used within the (head) and (/head) tags of your page. These tags are located at the top of the html coding. It will look something like this: (html) Promotional Umbrellas - Quality Counts d. Do the research and decide for yourself.If you’ve decided to use promotional umbrellas to publicize your company, you’ll want to opt for the highest quality that your budget can stand. When it comes to a promotional item that will get the use – and give your company the exposure that you get – with promotional umbrellas, you don’t want to skimp by handing out a poor quality product. Opting for a cheap promotional umbrella can actually cost your business more in the long run, and it certainly won’t give you all the benefits you get from choosing a better quality product in the first place.These days, when corporate gift-giving is such a common practice, business men have become far more discerning than they used to be. Cheap plastic pens have been replaced by stylish, sleek metal ones, and printed key rings by embossed leather fobs. Why reverse the proce 2. (meta name="robots" content="noindex,follow") This tag can be used to tell the search engines that you do not want the page included in their directory, but you DO want them to follow the links that lead to other pages. A good example of its usage would be your disclaimer or privacy policy pages. You may not want these pages to show up in the search engines if they are only important to your actual visitors. However, if the links on these pages point to other pages that you want the search engines to find, then you would still want the spiders to "follow" those links. 3. (meta name="robots" content="index,nofollow") This tag will allow your page to be indexed in the search engines, but any links on that page will not be followed. 4. (meta name="robots" content="noindex,nofollow") When using this tag, the search engine spiders will not include this page in their directory and will not follow any links on the page either. Where does the "robots" tag belong? The "robots" meta tag should be used within the (head) and (/head) tags of your page. These tags are located at the top of the html coding. It will look something like this: (html) Original Website Articles: Is It Worth Investing In Original Website Articles? ngines, but any links on that page will not be followed.It is a well known fact that unique content is the key to building quality websites. These websites can stand the test of time and search engine algorithm changes and bring your revenue year after year. But how does one go about getting the best original websites articles? It may be difficult to find a single writer on the web to satisfy your entire article writing needs. You want to look for a service company that employs writers that are well trained and experts on creating unique website articles for its customers. When using a service, you should be guaranteed to receive high quality and original articles as well as adherence to deadlines and project management.The best custom web article writing businesses will employ diverse writers from all walks of life. The writers should have exceptional experience in 4. (meta name="robots" content="noindex,nofollow") When using this tag, the search engine spiders will not include this page in their directory and will not follow any links on the page either. Where does the "robots" tag belong? The "robots" meta tag should be used within the (head) and (/head) tags of your page. These tags are located at the top of the html coding. It will look something like this: (html) More Robots Tags Google automatically archives a page as it crawls it. This is called a "cached" version of the page. Visitors can retrieve the archived version of the page by clicking on the "cached" link within Google's search results. If you do not want your content to be archived, you can use the following tag: (meta name="robots" content="noarchive") *This will only prevent your page from being "cached". If you do not want your page to be indexed at all, you will still need to include the "noindex" tag. Another alternative to the above tag is the tag that specifically addresses Google only. If you want other search engine robots to archive your site, but you would like to prevent Google from doing so, then you can use the following tag: (meta name="googlebot" content="noarchive") The Misuse of Robots Tags Something that has been popping up on websites everywhere is the Google indexing tag. This is a silly little tag that is not necessary. Some people think this tag helps Google to spider your site, but this simply isn't true. The tag looks like this: (meta name="googlebot" content="index,follow"). Some website owners believe that by specifying "googlebot" that their site has the advantage of being spidered faster and listed by Google. According to Google's web crawler information, you may use the noindex, nofollow, or noarchive tags when you DO NOT want Google to cache, index, or follow that page. Google's default setting is to index and follow the links on the page, so this "so called" googlebot index/follow tag that some site owner made up one day is completely unnecessary. Another silly little tag--- The "Revisit-After" Tag (meta name="revisit-after" content="90 days") I'm not sure where this myth was started. Today, you will find this tag all over the Internet. Webmasters have even promoted it, claiming that it actually works. Are we so naive to believe the search engine spiders need to know when to come back? I have never used this tag, and my site has no problem with being crawled on a regular basis. Even some SEO (search engine optimization) sites are claiming its value. This comes back to the importance of researching the topic thoroughly first. My research came from some interesting information on WebmasterWorld. It is important to examine the correct usage of the "robots" tag before applying it to your website. Incorrect usage of tags could result in spidering errors that cause robots to completely ignore the page all together. If you are interested in learning more about web robots, this great little site will provide you with the information you need to use them effectively: www.robotstxt.org/wc/robots.html
HTTP = HTML link (for blogs, profiles,phorums):
Related Articles:Business Owners: 5 of the Many Ways How Blogging Can Help Your Business 5 Tips To Write AdWords Like A Pro What is PR? A Guide for Newbees
|