Home | Developer Articles | Web Design Tips | Web Design Topics     
Software Reviews | Resources | Directory | Site Map     
Web Design Smart Tips:
  • Never Delete a Webpage

  • Links That Don't Look Like Links

  • Shrink Image Sizes

  • Design for the Smallest Screen Size

  • Aid Those who Can't See Images

  • Don't Ignore White Space

  • Always Interlace your GIF(c) Images
More Resources:


Need help developing websites? Looking for HTML tips and tricks? You've come to the right place. We have many great web development tips revolving around HTML, design, and more!

Articles

How To Use The Robotstxt File To Increase Your Web Ranking

Sometimes we rank well on one engine for a particular keyphrase and assume that all search engines will like our pages, and hence we will rank well for that keyphrase on a number of engines. Unfortunately this is rarely the case. All the major search engines differ somewhat, so what's get you ranked high on one engine may actually help to lower your ranking on another engine. It is for this reason that some people like to optimize pages for each particular search engine.

Usually these pages would only be slightly different but this slight difference could make all the difference when it comes to ranking high. However because search engine spiders crawl through sites indexing every page it can find, it might come across your search engine specific optimizes pages and because they are very similar, the spider may think you are spamming it and will do one of two things, ban your site altogether or severely punish you in the form of lower rankings. The solution is this case is to stop specific Search Engine spiders from indexing some of your web pages. This is done using a robots.txt file which resides on your webspace.

A Robots.txt file is a vital part of any webmasters battle against getting banned or punished by the search engines if he or she designs different pages for different search engine's. The robots.txt file is just a simple text file as the file extension suggests.

It's created using a simple text editor like notepad or WordPad, complicated word processors such as Microsoft Word will only corrupt the file. You can insert certain code in this text file to make it work. This is how it can be done.

User-Agent: (Spider Name) Disallow: (File Name) The User-Agent is the name of the search engines spider and Disallow is the name of the file that you don't want that spider to index. You have to start a new batch of code for each engine, but if you want to list multiply disallow files you can one under another. For example User-Agent: Slurp (Inktomi's spider) Disallow: xyz-gg.html Disallow: xyz-al.html Disallow: xxyyzz-gg.

html Disallow: xxyyzz-al.html The above code disallows Inktomi to spider two pages optimized for Google (gg) and two pages optimized for AltaVista (al). If Inktomi were allowed to spider these pages as well as the pages specifically made for Inktomi, you may run the risk of being banned or penalized. Hence, it's always a good idea to use a robots.

txt file. The robots.txt file resides on your webspace, but where on your webspace? The root directory! If you upload your file to sub-directories it will not work. If you wanted to disallow all engines from indexing a file, you simply use the "*" character where the engines name would usually be. However beware that the "*" character won't work on the Disallow line. Here are the names of a few of the big engines: Excite - ArchitextSpider AltaVista - Scooter Lycos - Lycos_Spider_(T-Rex) Google - Googlebot Alltheweb - FAST-WebCrawler Be sure to check over the file before uploading it, as you may have made a simple mistake, which could mean your pages are indexed by engines you don't want to index them, or even worse none of your pages might be indexed.

The SEO Company offers a complete Search Engine Optimization service and right now you can get a comprehensive ranking report for your website for free by clicking here



Web Design






Google The Internet Emperor - The whole world has now centralized in six letters GOOGLE, the internet search giant.

The Full Adsense Formula Google Adsense - There is no product or service to promote.

How to Start an Internet Business Blueprint To Your First Online Part - Learn how to research a niche, get ideas and get started on your way to creating a successful internet business that makes thousands on autopilot.

Choosing a Web Hosting Provider - There are literally thousands of web hosting providers on the Internet and it can be extremely difficult to decide on the right one.

Blushing Wholesale Business Secrets To Rustle - The real golden gem traits for starting and keeping a prestigious eBay re-selling business and e-commerce financial long term success.

more...
GravitateDesignStudio.com © Copyright 2018, All Rights Reserved.