English

Duplicate detection methodology for IP network traffic analysis

Networking and Internet Architecture 2017-10-26 v1

Abstract

Network traffic monitoring systems have to deal with a challenging problem: the traffic capturing process almost invariably produces duplicate packets. In spite of this, and in contrast with other fields, there is no scientific literature addressing it. This paper establishes the theoretical background concerning data duplication in network traffic analysis: generating mechanisms, types of duplicates and their characteristics are described. On this basis, a duplicate detection and removal methodology is proposed. Moreover, an analytical and experimental study is presented, whose results provide a dimensioning rule for this methodology.

Keywords

Cite

@article{arxiv.1311.4168,
  title  = {Duplicate detection methodology for IP network traffic analysis},
  author = {Inaki Ucar and Daniel Morato and Eduardo Magana and Mikel Izal},
  journal= {arXiv preprint arXiv:1311.4168},
  year   = {2017}
}

Comments

7 pages, 8 figures. For the GitHub project, see https://github.com/Enchufa2/nantools

R2 v1 2026-06-22T02:09:03.143Z