English

Improved Fast Similarity Search in Dictionaries

Information Retrieval 2010-08-19 v2 Data Structures and Algorithms

Abstract

We engineer an algorithm to solve the approximate dictionary matching problem. Given a list of words W\mathcal{W}, maximum distance dd fixed at preprocessing time and a query word qq, we would like to retrieve all words from W\mathcal{W} that can be transformed into qq with dd or less edit operations. We present data structures that support fault tolerant queries by generating an index. On top of that, we present a generalization of the method that eases memory consumption and preprocessing time significantly. At the same time, running times of queries are virtually unaffected. We are able to match in lists of hundreds of thousands of words and beyond within microseconds for reasonable distances.

Keywords

Cite

@article{arxiv.1008.1191,
  title  = {Improved Fast Similarity Search in Dictionaries},
  author = {Daniel Karch and Dennis Luxen and Peter Sanders},
  journal= {arXiv preprint arXiv:1008.1191},
  year   = {2010}
}

Comments

Full version of a short paper accepted for Spire 2010, 13 pages