English
Related papers

Related papers: Almost Optimal Unrestricted Fast Johnson-Lindenstr…

200 papers

The sparse Johnson-Lindenstrauss transform is one of the central techniques in dimensionality reduction. It supports embedding a set of $n$ points in $\mathbb{R}^d$ into $m=O(\varepsilon^{-2} \lg n)$ dimensions while preserving all pairwise…

Data Structures and Algorithms · Computer Science 2023-02-14 Mikael Møller Høgsgaard , Lion Kamma , Kasper Green Larsen , Jelani Nelson , Chris Schwiegelshohn

Dimension reduction is a key algorithmic tool with many applications including nearest-neighbor search, compressed sensing and linear algebra in the streaming model. In this work we obtain a {\em sparse} version of the fundamental tool in…

Data Structures and Algorithms · Computer Science 2015-03-14 Anirban Dasgupta , Ravi Kumar , Tamás Sarlós

We give two different and simple constructions for dimensionality reduction in $\ell_2$ via linear mappings that are sparse: only an $O(\varepsilon)$-fraction of entries in each column of our embedding matrices are non-zero to achieve…

Data Structures and Algorithms · Computer Science 2014-02-07 Daniel M. Kane , Jelani Nelson

The Johnson-Lindenstrauss lemma is a fundamental result in probability with several applications in the design and analysis of algorithms in high dimensional geometry. Most known constructions of linear embeddings that satisfy the…

Data Structures and Algorithms · Computer Science 2015-03-17 Raghu Meka

We give a proof of the conjecture of Nelson and Nguyen [FOCS 2013] on the optimal dimension and sparsity of oblivious subspace embeddings, up to sub-polylogarithmic factors: For any $n\geq d$ and $\epsilon\geq d^{-O(1)}$, there is a random…

Data Structures and Algorithms · Computer Science 2025-11-18 Shabarish Chenakkod , Michał Dereziński , Xiaoyu Dong

In this paper, we study a fast approximation method for {\it large-scale high-dimensional} sparse least-squares regression problem by exploiting the Johnson-Lindenstrauss (JL) transforms, which embed a set of high-dimensional vectors into a…

Statistics Theory · Mathematics 2015-07-21 Tianbao Yang , Lijun Zhang , Qihang Lin , Rong Jin

The seminal Fast Johnson-Lindenstrauss (Fast JL) transform by Ailon and Chazelle (SICOMP'09) embeds a set of $n$ points in $d$-dimensional Euclidean space into optimal $k=O(\varepsilon^{-2} \ln n)$ dimensions, while preserving all pairwise…

Data Structures and Algorithms · Computer Science 2022-04-06 Ora Nova Fandina , Mikael Møller Høgsgaard , Kasper Green Larsen

We consider the problem of efficient randomized dimensionality reduction with norm-preservation guarantees. Specifically we prove data-dependent Johnson-Lindenstrauss-type geometry preservation guarantees for Ho's random subspace method:…

Machine Learning · Statistics 2017-05-19 Nick Lim , Robert J. Durrant

The Johnson-Lindenstrauss (JL) theorem states that a set of points in high-dimensional space can be embedded into a lower-dimensional space while approximately preserving pairwise distances with high probability Johnson and Lindenstrauss…

Data Structures and Algorithms · Computer Science 2026-01-01 Pierre Mackenzie

The celebrated dimension reduction lemma of Johnson and Lindenstrauss has numerous computational and other applications. Due to its application in practice, speeding up the computation of a Johnson-Lindenstrauss style dimension reduction is…

Data Structures and Algorithms · Computer Science 2010-11-12 Vladimir Braverman , Rafail Ostrovsky , Yuval Rabani

The Johnson-Lindenstrauss lemma is one of the corner stone results in dimensionality reduction. It says that given $N$, for any set of $N$ vectors $X \subset \mathbb{R}^n$, there exists a mapping $f : X \to \mathbb{R}^m$ such that $f(X)$…

Functional Analysis · Mathematics 2017-11-09 Casper Benjamin Freksen , Kasper Green Larsen

The \emph{Sparse Johnson-Lindenstrauss Transform} of Kane and Nelson (SODA 2012) provides a linear dimensionality-reducing map $A \in \mathbb{R}^{m \times u}$ in $\ell_2$ that preserves distances up to distortion of $1 + \varepsilon$ with…

Data Structures and Algorithms · Computer Science 2023-05-08 Jakob Bæk Tejs Houen , Mikkel Thorup

We study combinatorial group testing schemes for learning $d$-sparse Boolean vectors using highly unreliable disjunctive measurements. We consider an adversarial noise model that only limits the number of false observations, and show that…

Discrete Mathematics · Computer Science 2015-05-13 Mahdi Cheraghchi

The Johnson--Lindenstrauss (JL) lemma is a powerful tool for dimensionality reduction in modern algorithm design. The lemma states that any set of high-dimensional points in a Euclidean space can be flattened to lower dimensions while…

Probability · Mathematics 2024-11-08 Kwassi Joseph Dzahini , Stefan M. Wild

The Johnson-Lindenstrauss transform allows one to embed a dataset of $n$ points in $\mathbb{R}^d$ into $\mathbb{R}^m,$ while preserving the pairwise distance between any pair of points up to a factor $(1 \pm \varepsilon)$, provided that $m…

Data Structures and Algorithms · Computer Science 2022-07-08 Ora Nova Fandina , Mikael Møller Høgsgaard , Kasper Green Larsen

The Johnson-Lindenstrauss (JL) lemma is a fundamental result in dimensionality reduction, ensuring that any finite set $X \subseteq \mathbb{R}^d$ can be embedded into a lower-dimensional space $\mathbb{R}^k$ while approximately preserving…

Probability · Mathematics 2025-10-30 Rafael Chiclana , Mark Iwen

We introduce sparse random projection, an important dimension-reduction tool from machine learning, for the estimation of discrete-choice models with high-dimensional choice sets. Initially, high-dimensional data are compressed into a…

Machine Learning · Statistics 2016-04-21 Khai X. Chiong , Matthew Shum

Low-distortion embeddings are critical building blocks for developing random sampling and random projection algorithms for linear algebra problems. We show that, given a matrix $A \in \R^{n \times d}$ with $n \gg d$ and a $p \in [1, 2)$,…

Data Structures and Algorithms · Computer Science 2013-03-22 Xiangrui Meng , Michael W. Mahoney

There has been recently a lot of research on sparse variants of random projections, faster adaptations of the state-of-the-art dimensionality reduction technique originally due to Johsnon and Lindenstrauss. Although the construction is very…

Data Structures and Algorithms · Computer Science 2024-07-23 Maciej Skórski

The seminal result of Johnson and Lindenstrauss on random embeddings has been intensively studied in applied and theoretical computer science. Despite that vast body of literature, we still lack of complete understanding of statistical…

Machine Learning · Computer Science 2021-04-13 Maciej Skorski
‹ Prev 1 2 3 10 Next ›