English

Document Similarity from Vector Space Densities

Computation and Language 2020-09-03 v1 Data Structures and Algorithms

Abstract

We propose a computationally light method for estimating similarities between text documents, which we call the density similarity (DS) method. The method is based on a word embedding in a high-dimensional Euclidean space and on kernel regression, and takes into account semantic relations among words. We find that the accuracy of this method is virtually the same as that of a state-of-the-art method, while the gain in speed is very substantial. Additionally, we introduce generalized versions of the top-k accuracy metric and of the Jaccard metric of agreement between similarity models.

Keywords

Cite

@article{arxiv.2009.00672,
  title  = {Document Similarity from Vector Space Densities},
  author = {Ilia Rushkin},
  journal= {arXiv preprint arXiv:2009.00672},
  year   = {2020}
}

Comments

12 pages, 3 figures

R2 v1 2026-06-23T18:15:02.208Z