smaller reset larger         

Main Menu

All times are in GMT -5 :: The time is now 5:13 am.
  1. Helpdesk Home
  2. Knowledgebase
  3. Planet
  4. Lycos Search
  5. HotBot
  6. How does HotBot know when I remove my site?

Sub Menu

Knowledgebase Sections
Article Data
Article Ref
8782-RPZV-4653
Written By
Mike
Date Created
Wed, 24th May 2006
Article Actions
 
(Lost?)

   How does HotBot know when I remove my site?

Question 

How does HotBot know when I remove my site?

Answer 

HotBot automatically removes the old URL during the regular 60-day crawling schedule. When HotBot revisits your domain and sees that the information for your old Web page no longer exists, or has a robots.txt file, it removes the information from the database. To secure the URLs already in the database, we do not manually remove URLs.

How Useful Was This Article?      (Rating: 80%    Votes: 1)  

Select a Rating