English
Related papers

Related papers: Johnson-Lindenstrauss Lemma Beyond Euclidean Geome…

200 papers

The Johnson-Lindenstrauss transform allows one to embed a dataset of $n$ points in $\mathbb{R}^d$ into $\mathbb{R}^m,$ while preserving the pairwise distance between any pair of points up to a factor $(1 \pm \varepsilon)$, provided that $m…

Data Structures and Algorithms · Computer Science 2022-07-08 Ora Nova Fandina , Mikael Møller Høgsgaard , Kasper Green Larsen

We consider the problem of efficient randomized dimensionality reduction with norm-preservation guarantees. Specifically we prove data-dependent Johnson-Lindenstrauss-type geometry preservation guarantees for Ho's random subspace method:…

Machine Learning · Statistics 2017-05-19 Nick Lim , Robert J. Durrant

Johnson--Lindenstrauss Transforms are powerful tools for reducing the dimensionality of data while preserving key characteristics of that data, and they have found use in many fields from machine learning to differential privacy and more.…

Data Structures and Algorithms · Computer Science 2021-03-02 Casper Benjamin Freksen

In 1984, Johnson and Lindenstrauss proved that any finite set of data in a high-dimensional space can be projected to a lower-dimensional space while preserving the pairwise Euclidean distance between points up to a bounded relative error.…

Discrete Mathematics · Computer Science 2018-03-15 Michael Burr , Shuhong Gao , Fiona Knoll

Statistical distance measures have found wide applicability in information retrieval tasks that typically involve high dimensional datasets. In order to reduce the storage space and ensure efficient performance of queries, dimensionality…

Computational Geometry · Computer Science 2010-03-09 Arnab Bhattacharya , Purushottam Kar , Manjish Pal

We present a theory for Euclidean dimensionality reduction with subgaussian matrices which unifies several restricted isometry property and Johnson-Lindenstrauss type results obtained earlier for specific data sets. In particular, we…

Information Theory · Computer Science 2014-02-18 Sjoerd Dirksen

We study the effect of Johnson-Lindenstrauss transforms in various projective clustering problems, generalizing recent results which only applied to center-based clustering [MMR19]. We ask the general question: for a Euclidean optimization…

Data Structures and Algorithms · Computer Science 2023-07-11 Moses Charikar , Erik Waingarten

In the recent paper [Jin, Kolda & Ward, arXiv:1909.04801], it is proved that the Kronecker fast Johnson-Lindenstrauss transform (KFJLT) is, in fact, a Johnson-Lindenstrauss transform, which had previously only been conjectured. In this…

Numerical Analysis · Mathematics 2020-05-19 Osman Asif Malik , Stephen Becker

Let $\Phi\in\mathbb{R}^{m\times n}$ be a sparse Johnson-Lindenstrauss transform [KN14] with $s$ non-zeroes per column. For a subset $T$ of the unit sphere, $\varepsilon\in(0,1/2)$ given, we study settings for $m,s$ required to ensure $$…

Data Structures and Algorithms · Computer Science 2015-08-27 Jean Bourgain , Sjoerd Dirksen , Jelani Nelson

In this paper, we study a fast approximation method for {\it large-scale high-dimensional} sparse least-squares regression problem by exploiting the Johnson-Lindenstrauss (JL) transforms, which embed a set of high-dimensional vectors into a…

Statistics Theory · Mathematics 2015-07-21 Tianbao Yang , Lijun Zhang , Qihang Lin , Rong Jin

The Johnson-Lindenstrauss lemma is one of the corner stone results in dimensionality reduction. It says that given $N$, for any set of $N$ vectors $X \subset \mathbb{R}^n$, there exists a mapping $f : X \to \mathbb{R}^m$ such that $f(X)$…

Functional Analysis · Mathematics 2017-11-09 Casper Benjamin Freksen , Kasper Green Larsen

The famous Johnson-Lindenstrauss lemma states that for any set of n vectors, there is a linear transformation into a space of dimension O(log n) that approximately preserves all their lengths. In fact, a Haar random unitary transformation…

Quantum Physics · Physics 2018-07-25 Pranab Sen

Let $\varepsilon\in(0,1)$ and $X\subset\mathbb R^d$ be arbitrary with $|X|$ having size $n>1$. The Johnson-Lindenstrauss lemma states there exists $f:X\rightarrow\mathbb R^m$ with $m = O(\varepsilon^{-2}\log n)$ such that $$ \forall x\in X\…

Data Structures and Algorithms · Computer Science 2018-10-23 Shyam Narayanan , Jelani Nelson

The Johnson-Lindenstrauss Lemma (J-L Lemma) is a cornerstone of dimension reduction techniques. We study it in the one-bit context, namely we consider the unit sphere $ \mathbb S ^{N-1}$, with normalized geodesic metric, and map a finite…

Functional Analysis · Mathematics 2019-03-07 Amadou Bah , Bryson Kagy , Emily Smith

We develop a novel methodology based on the marriage between the Bhattacharyya distance, a measure of similarity across distributions of random variables, and the Johnson-Lindenstrauss Lemma, a technique for dimension reduction. The…

Trading and Market Microstructure · Quantitative Finance 2019-07-15 Ravi Kashyap

Random projections are random linear maps, sampled from appropriate distributions, that approx- imately preserve certain geometrical invariants so that the approximation improves as the dimension of the space grows. The well-known…

Optimization and Control · Mathematics 2017-06-12 Ky Vu , Pierre-Louis Poirion , Leo Liberti

The Johnson-Lindenstrauss lemma is a fundamental result in probability with several applications in the design and analysis of algorithms in high dimensional geometry. Most known constructions of linear embeddings that satisfy the…

Data Structures and Algorithms · Computer Science 2015-03-17 Raghu Meka

In this paper we propose the creation of generic LSH families for the angular distance based on Johnson-Lindenstrauss projections. We show that feature hashing is a valid J-L projection and propose two new LSH families based on feature…

Data Structures and Algorithms · Computer Science 2017-05-03 Luis Argerich , Natalia Golmar

The \emph{Sparse Johnson-Lindenstrauss Transform} of Kane and Nelson (SODA 2012) provides a linear dimensionality-reducing map $A \in \mathbb{R}^{m \times u}$ in $\ell_2$ that preserves distances up to distortion of $1 + \varepsilon$ with…

Data Structures and Algorithms · Computer Science 2023-05-08 Jakob Bæk Tejs Houen , Mikkel Thorup

The $l_2$ flattening lemma of Johnson and Lindenstrauss [JL84] is a powerful tool for dimension reduction. It has been conjectured that the target dimension bounds can be refined and bounded in terms of the intrinsic dimensionality of the…

Computational Geometry · Computer Science 2015-06-09 Lee-Ad Gottlieb , Robert Krauthgamer