Dictionary based methods for information extraction
Statistical Mechanics
2009-11-10 v2 Other Condensed Matter
Information Retrieval
Genomics
Other Quantitative Biology
Abstract
In this paper we present a general method for information extraction that exploits the features of data compression techniques. We first define and focus our attention on the so-called "dictionary" of a sequence. Dictionaries are intrinsically interesting and a study of their features can be of great usefulness to investigate the properties of the sequences they have been extracted from (e.g. DNA strings). We then describe a procedure of string comparison between dictionary-created sequences (or "artificial texts") that gives very good results in several contexts. We finally present some results on self-consistent classification problems.
Cite
@article{arxiv.cond-mat/0402581,
title = {Dictionary based methods for information extraction},
author = {A. Baronchelli and E. Caglioti and V. Loreto and E. Pizzi},
journal= {arXiv preprint arXiv:cond-mat/0402581},
year = {2009}
}
Comments
7 pages, Latex, elsart style