Using sensors in the web crawling process
Information Retrieval
2007-05-23 v1 Digital Libraries
Abstract
This paper offers a short description of an Internet information field monitoring system, which places a special module-sensor on the side of the Web-server to detect changes in information resources and subsequently reindexes only the resources signalized by the corresponding sensor. Concise results of simulation research and an implementation attempt of the given "sensors" concept are provided.
Keywords
Cite
@article{arxiv.cs/0312033,
title = {Using sensors in the web crawling process},
author = {Ilya Zemskov},
journal= {arXiv preprint arXiv:cs/0312033},
year = {2007}
}
Comments
4 pages, 4 figures. The article was accepted for the IADIS International WWW/Internet 2003 Conference but not published in the proceedings due to the lack of financial support