Increase Web Site Traffic: Spider-Based Search Engines Web Site Promotion
  Home   Get the eBook  


Chapter 2: Search Engines

Idea 1: Spider-Based Search Engines

I think that it's fair to say that when the average person thinks about search engines, even if they don't know it, they are thinking about to Spider-Based search engines.

Spider-Based search engines use automated software programs ("spiders" or "robots") which visit web sites, retrieve their content, and build a database ("index") of the pages visited.

When the user enters a search into one of these search engines, the data in the index is compared, analyzed and sorted to produce the search results.

Achieving success with Spider-Based search engines requires several things:
  1. Getting the spider to visit your site and index your pages. Usually this is achieved either by "submitting" your URL (Note: most services which offer submission to thousands of "search engines" include both search engines and FFAs in their overall totals - for info on FFAs, see Idea 54: Posting To FFAs), or by placing a link on a site/page that is already in the index.
    • You generally do not need to submit all your pages, spiders will usually find additional pages on your site by following links between your web pages.
    • You generally do not need to re-submit on a regular basis. Most spiders will automatically periodically revisit pages that already in the index, and thus pick up changes to your site without any action by you.

  2. Designing your pages to contain your most important and relevant keywords. This is to ensure that your page will be included in the search results for searches on those keywords.

  3. Designing your pages to contain your most important keywords in the most important places (for example, most spiders will usually pay more attention to a keyword that is used in the title of a page, than one that is hidden away in a tiny font at the bottom of a page). This process (variously known as "search engine positioning", "search engine ranking", "search engine optimization" or "SEO") is to ensure that your pages come up near the top of the search results - which of course makes it far more likely that people will see your site in the results and click on it.

  4. Optimizing things which although not part of your page design ("off-page"), can also affect your search engine ranking, for example:

Related Resources:
  • 1StopSubmit
    Offers free and paid submissions to search engines.

  • Traffic Equalizer
    Software to help you get more traffic from search engines.

  • EasySEO Software
    This software is designed to help you find the right keywords to promote your site, and then "reverse engineer" other pages which have already achieved good results - so you can then similarly optimize your pages for improved ranking.

  • Guide to Obtaining a #1 Ranking in the Search Engines
    A step-by-step guide to optimizing your site for achieving a high search engine ranking.

  • The New Search Engine Secrets Exposed
    Another guide to achieving a high rank in search engine results.

    Free information about search engine marketing.

  • SearchEngineWatch
    Latest news and tips from the search engine marketing world.

  • Talk SEO
    Discussion board focused on search engine marketing. For additional forums, some of which cover search engine marketing, please see Appendix B.

< < Previous Next > >

Spider-Based Search Engines

Copyright © 2000-2015, Answers 2000 Limited

Contact Us     About/Terms Of Use     Privacy     Advertising/Endorsements Disclosures

With any business, it is up to the individual owner of said business to ensure the success of the business. You may make more or less than any sample figures or results that might be quoted on our web sites or other publications. All business involves risk, and many businesses do not succeed. Further, Answers 2000 Limited does NOT represent that any particular individual or business is typical, or that any results or experiences achieved by any particular individual/business is necessarily typical.

All third party content and adverts are copyright of their respective owners.

In Association With
Answers 2000 Limited is a participant in the Amazon Services LLC Associates Program, an affiliate advertising program designed to provide a means for sites to earn advertising fees by advertising and linking to

Disclosure: Advertising Link(s): Our company may receive a payment if you purchase a product/service after following this link.

Disclosure: Our company's websites' content (including this website's content) includes advertisements for our own company's websites, products, and services, and for other organization's websites, products, and services. In the case of links to other organization's websites, our company may receive a payment, (1) if you purchase products or services, or (2) if you sign-up for third party offers, after following links from this website. Unless specifically otherwise stated, information about other organization's products and services, is based on information provided by that organization, the product/service vendor, and/or publicly available information - and should not be taken to mean that we have used the product/service in question. Additionally, our company's websites contain some adverts which we are paid to display, but whose content is not selected by us, such as Google AdSense ads. For more detailed information, please see Advertising/Endorsements Disclosures

Our sites use cookies, some of which may already be set on your computer. Use of our site constitutes consent for this. For details, please see Privacy.