A comprehensive index of the Web will contain over a billion documents, foreseeable by the year 2000. At the same time, the number of queries search engines handle has grown remarkably also. In March and April 1994, the World Wide Web Worm received an average of about 1500 queries per day. In November 1997, Altavista claimed to have handled about 20 million queries per day.

By the year 2000, with the growing number of users on the web and automated systems which query search engines, it seems likely that top search engines will deal with hundreds of millions of queries per day. The goal of our system is to address the various problems, both in quality and scalability, introduced by scaling search engine technology to such extraordinary numbers.

Search engines include websites like Google and Yahoo. When a user searches the internet using specific keywords, the sites that are most optimized for this certain keyword show up closer to the top. The goal of search engine optimization is to get the website as close to the top as possible, thereby increasing te possibility that a potential client will click on the site and be directed to their specific website offering information, a product or a service.

There are many methods that are used to optimize the website and enable the website to appear closer to the number one results. These methods include the use of specific keywords being used in the content of the website and the search engines will “crawl” these websites and index them close to the top if the keywords are used in the most successful manner possible.

Aside from keywords, there are other techniques that can help to increase the rankings of the website. Links to other websites as well as other pages within the website are also an effective way to increase the verity of the website in the search engine.