Infertility Home > Professionals > Business Mgt. > Web Site > Promotion

Understanding Search Indexing Robots and Spiders

The following Web pages explain how search indexing robots and spiders work:

• Search Engine Robots
   
• All About Search Indexing Robots and Spiders - The title says it all -- an excellent article covering everything you ever wanted to know about search engine crawlers and how they work, with extensive links for more information.
   
• SpiderSpotting - If you have access to your server logs, you can ferret out which spiders or crawlers have visited your site, and exactly what they've fetched. Here's how to do it.
   
• The ABCi/IAB Master Industry List Of Spiders And Robots - The Interactive Advertising Bureau (IAB) and ABCi announced that they will create and maintain the ABCi/IAB master industry list of spiders and robots. The list will be updated monthly and is available to IAB members and ABCi clients free of charge. They also offer an informative FAQ about robots at <http://www.abcinteractiveaudits.com/abci_iab_spidersandrobots/faqs.html>.
   

Copyright 2000-2008 Internet Health Resources
Developed by IHR | Contact IHR

Other IHR Web sites:
Consumers: Infertility Resources
Consumers: InfertilityBooks.com
Professionals: InfertilityProfessionals.com