English

A Quantized Johnson Lindenstrauss Lemma: The Finding of Buffon's Needle

Information Theory 2015-07-23 v6 Data Structures and Algorithms math.IT Probability

Abstract

In 1733, Georges-Louis Leclerc, Comte de Buffon in France, set the ground of geometric probability theory by defining an enlightening problem: What is the probability that a needle thrown randomly on a ground made of equispaced parallel strips lies on two of them? In this work, we show that the solution to this problem, and its generalization to NN dimensions, allows us to discover a quantized form of the Johnson-Lindenstrauss (JL) Lemma, i.e., one that combines a linear dimensionality reduction procedure with a uniform quantization of precision δ>0\delta>0. In particular, given a finite set SRN\mathcal S \subset \mathbb R^N of SS points and a distortion level ϵ>0\epsilon>0, as soon as M>M0=O(ϵ2logS)M > M_0 = O(\epsilon^{-2} \log S), we can (randomly) construct a mapping from (S,2)(\mathcal S, \ell_2) to (δZM,1)(\delta\mathbb Z^M, \ell_1) that approximately preserves the pairwise distances between the points of S\mathcal S. Interestingly, compared to the common JL Lemma, the mapping is quasi-isometric and we observe both an additive and a multiplicative distortions on the embedded distances. These two distortions, however, decay as O((logS)/M)O(\sqrt{(\log S)/M}) when MM increases. Moreover, for coarse quantization, i.e., for high δ\delta compared to the set radius, the distortion is mainly additive, while for small δ\delta we tend to a Lipschitz isometric embedding. Finally, we prove the existence of a "nearly" quasi-isometric embedding of (S,2)(\mathcal S, \ell_2) into (δZM,2)(\delta\mathbb Z^M, \ell_2). This one involves a non-linear distortion of the 2\ell_2-distance in S\mathcal S that vanishes for distant points in this set. Noticeably, the additive distortion in this case is slower, and decays as O((logS)/M4)O(\sqrt[4]{(\log S)/M}).

Keywords

Cite

@article{arxiv.1309.1507,
  title  = {A Quantized Johnson Lindenstrauss Lemma: The Finding of Buffon's Needle},
  author = {Laurent Jacques},
  journal= {arXiv preprint arXiv:1309.1507},
  year   = {2015}
}

Comments

27 pages, 2 figures (note: this version corrects a few typos in the abstract)