.: The role of the robots.txt file to improve site ranking!
Category:Home / Internet Marketing / Search Engine Optimization
Not many web master take the time to use a robots.txt file for their website. For search engine spiders that use the robots.txt to see what directories to search through, the robots.txt file can be very helpful in keeping the spiders indexing your actual pages and not other information, such as looking through your stats!
The robots.txt file is useful in keeping your spiders from accessing parts folders and files in your hosting directory that are totally unrelated to your actual web site content. You can choose to have the spiders kept out of areas that contain programming that search engines cannot parse properly, and to keep them out of the web stats portion of your site.
Many search engines cannot view dynamically generated content properly, mainly created by programming languages, such as PHP or ASP. If you have an online store programmed in your hosting account, and it is in a seperate directory, you would be wise to block out the spiders from this directory so it only finds relevant information.
The robots.txt file should be placed in the directory where your main files for your hosting are located. So you would be advised to create a blank text file, and save it as robots.txt, and then upload it to your web hosting to the same directory your index.htm file is located.
Here is examples of the use of the robots.txt file:
To block out a directory in a robots.txt file, such as a subdirectory for your online store called /store/ you would do the following: Disallow: /store/
Another example to block out your stats directory: Disallow: /stats/
You may also want to disallow individual files that you do not want searched by the search engines. For example you dont want search.php to be parsed by the Search Engines. To do this you type in the following on its own line:
Disallow: /search.php
Following the rules outlined and creating the robots.txt file, you will keep search engine spiders out of unwanted files and directories, and letting them go through the important files to see what your web site is all about!
Article keywords: robots.txt, seo, search engine optimization, higher rankings
Article Source: http://www.articles32.com
Michael Kralj is owner of Emenki Web Solutions and Domains at Retail. Emenki Web Solutions are web site designers and programmers based in Hamilton, Ontario, providing businesses with an informative and strategic approach to establishing an online presence on the web.
Please visit Emenki Web Solutions on the web www.emenki.com Please visit Domains at Retail on the web: www.domainsatretail.com
.: New Search Engine Optimization Articles
1). How to Improve Search Engine Ranking
Powerful 4-step process to improve search engine ranking
2). How to Make Websites that Search Engines Love
How you can apply the fundamental basics to create a website that the search engines will love to spider.
3). Articles Are Seeds of Knowledge - A Biblical Look at Duplicate Content
Article Marketing compared to the successful distributon of the Christian Bible.
The Christian Bible is the Worlds most successful publication, with over 6 billion copies printed, similar to the total World Population.
4). Content Management Systems Equal Business Suicide!
One of the fastest way to minimise your chances of web business success is to use a Content Management System (CMS).
5). Importance of Search Engine Marketing Firms
Literally speaking, there is no business in todays world of World Wide Web, which doesnt have online business. To reach ever growing population of internet all across the world it is mandatory to have a good online presence for any business. Moreover, meeting customers online is the cheapest possible way.
6). Internet Search Engines, Important Details Everybody Should Know
Internet Search Engines see something totally different than what we see when we look at a webpage. It is all in the webpage code. Have you ever seen webpage code? Place one of your webpages into your browser.
7). Why Websites Get Banned From Search Engines
These are methods and techniques that end up getting websites banned from Google and other search engines.
.: Top Search Engine Optimization Articles
1). SEO Contests: Good or Bad?
As a webmaster you probably already know what a SEO Contest is or you surely came across some of them or even participated in. Some of the major SEO contests organized are the v7ndotcom elursrebmem (by v7n.com), Ambachdotcom, Carcasherdotcom, and more recently the Cpayscom2 Online Casino where the winner gets $10,000 for ranking number one on MSN. Now the big question is whether it is good or bad to organize SEO Contests.
2). High Paying Lateral Keywords
If you run AdSense on your site you know that some words pay more than others, much more in fact. More than likely you have also learned that terms like "structured settlements" and "mesothelioma" can produce incredibly high PPC revenue, if they show up on your site at all. Unfortunately hundreds of thousands of other webmasters are "on" to this practice judging by the number of sites created regularly to capitalize on the phenomenom.
3). Is Your Website Invisible? The Google Sandbox Solution
What is the Google Sandbox? How Do You Know if You’re Stuck in the Sandbox? Does the Sandbox Really Exist, or is it Just the Google Algorithm? Why Do You Get Sandboxed? Is There a Way to Trick the Sandbox Filter?
4). An SEO Glossary - Common SEO Terms Defined
Search Engine Optimization (SEO) has become an essential weapon in the arsenal of every online business. Unfortunately, for most business owners and marketing managers (and even many webmasters), it's also somewhat of an enigma. This is partly due to the fact that it's such a new and rapidly changing field, and partly due to the fact that SEO practitioners tend to speak in a language all of their own which, without translation, is virtually impenetrable to the layperson.
5). Creating Sitemaps For Google, MSN AND Yahoo! - The Easy Way
If you own or maintain a website or intend to own one, wouldn’t it be great if you get frequent visitors who find satisfaction in getting exactly the information they need from your page?
While that satisfaction largely depends on the contents of your website, how you get to be accessed by website users is the most critical factor of website development.
6). How to Make a Sitemap For Your Website In Five Steps.
A website's sitemap can be compared to the table of contents of a book. The sitemap is important because it guides visitors to the parts of the website in which they are interested. The sitemap allows surfers to reach their destination without wasting time.
Sitemaps are also important from the point of view of search engines. If the search engine finds a sitemap it is much more likely that your page will be fully visited (spidered) and indexed; allowing web surfers to find your pages in their searches.
7). 301 Redirect - The SEO way to rename or move files or folders
In this article I will discuss page redirection techniques, what works and what to avoid.
What is page redirection and why would you want to use it?
Let’s say you rename a page on your website, for whatever reason. Perhaps you decided to revamp your entire naming convention, perhaps you decided to restructure your site and need to move pages into different folders, or you just realized that you are missing valuable keywords.