English

WWW Spiders: an introduction

Computers and Society 2007-10-29 v1

Abstract

In recent years, the study of complex networks has received a lot of attention. Real systems have gained importance in scientific publications, despite of an important drawback: the difficulty of retrieving and manage such great quantity of information. This paper wants to be an introduction to the construction of spiders and scrapers: specifically, how to program and deploy safely these kind of software applications. The aim is to show how software can be prepared to automatically surf the net and retrieve information for the user with high efficiency and safety.

Keywords

Cite

@article{arxiv.0710.5054,
  title  = {WWW Spiders: an introduction},
  author = {Massimiliano Zanin},
  journal= {arXiv preprint arXiv:0710.5054},
  year   = {2007}
}

Comments

41 pages, 6 figures

R2 v1 2026-06-21T09:36:48.045Z