smaller reset larger         

Main Menu

All times are in GMT -5 :: The time is now 5:40 am.
  1. Helpdesk Home
  2. Knowledgebase
  3. Planet
  4. Lycos Search
  5. HotBot
  6. Why doesn't my site get indexed?

Sub Menu

Knowledgebase Sections
Article Data
Article Ref
7856-QDHK-5010
Written By
Mike
Date Created
Wed, 24th May 2006
Article Actions
 
(Lost?)

   Why doesn't my site get indexed?

Question 

Why doesn't my site get indexed?

Answer 

There are three main reasons submissions fail:
  • The Host server is non-operational during spidering.
  • The URL is submitted without the "http://" prefix.
  • The host server contains the robots.txt exclusion tag.
Other reasons submissions may fail:
  • Pages containing frames require special formatting. See this URL for information on how to structure your tags.
  • Pages requiring a cookie will not be indexed.
  • Inktomi must be able to resolve the DNS name. If there is a problem resolving the DNS name, use an IP address.
  • The URL contains special characters such as: ?, =, %, &.
  • HotBot accepts 50 pages per domain per day from the Submit a Web Site page. As a result, submissions from large domains with user homepages often experience problems becoming indexed. HotBot ignores submissions over (the limit of) 50.

How Useful Was This Article?      (Rating: 0    Votes: 1)  

Select a Rating