English
Related papers

Related papers: Improving the Johnson-Lindenstrauss Lemma

200 papers

A refinement of so-called fast Johnson-Lindenstrauss transform, due to Ailon and Chazelle (2006), and Matou\v{s}ek (2008), is proposed. While it preserves the time efficiency and simplicity of implementation of the original construction, it…

Probability · Mathematics 2012-11-09 Paweł Wolff

This paper investigates theoretical properties of subsampling and hashing as tools for approximate Euclidean norm-preserving embeddings for vectors with (unknown) additive Gaussian noises. Such embeddings are sometimes called…

Data Structures and Algorithms · Computer Science 2022-09-05 Zhen Shao

We consider the problem of encoding a set of vectors into a minimal number of bits while preserving information on their Euclidean geometry. We show that this task can be accomplished by applying a Johnson-Lindenstrauss embedding and…

Information Theory · Computer Science 2022-04-12 Sjoerd Dirksen , Alexander Stollenwerk

We introduce a new technique for reducing the dimension of the ambient space of low-degree polynomials in the Gaussian space while preserving their relative correlation structure, analogous to the Johnson-Lindenstrauss lemma. As…

Computational Complexity · Computer Science 2017-08-15 Badih Ghazi , Pritish Kamath , Prasad Raghavendra

The Johnson-Lindenstrauss lemma is a fundamental result in probability with several applications in the design and analysis of algorithms in high dimensional geometry. Most known constructions of linear embeddings that satisfy the…

Data Structures and Algorithms · Computer Science 2015-03-17 Raghu Meka

Constrained least-squares regression problems, such as the Nonnegative Least Squares (NNLS) problem, where the variables are restricted to take only nonnegative values, often arise in applications. Motivated by the recent development of the…

Data Structures and Algorithms · Computer Science 2009-03-13 Christos Boutsidis , Petros Drineas

In this article, we consider the Euclidean dispersion problems. Let $P=\{p_{1}, p_{2}, \ldots, p_{n}\}$ be a set of $n$ points in $\mathbb{R}^2$. For each point $p \in P$ and $S \subseteq P$, we define $cost_{\gamma}(p,S)$ as the sum of…

Computational Geometry · Computer Science 2021-05-20 Pawan K. Mishra , Gautam K. Das

We give near-tight lower bounds for the sparsity required in several dimensionality reducing linear maps. First, consider the JL lemma which states that for any set of n vectors in R there is a matrix A in R^{m x d} with m = O(eps^{-2}log…

Data Structures and Algorithms · Computer Science 2012-11-07 Jelani Nelson , Huy L. Nguyen

Laplacian-based methods are popular for the dimensionality reduction of data lying in $\mathbb{R}^N$. Several theoretical results for these algorithms depend on the fact that the Euclidean distance locally approximates the geodesic distance…

Machine Learning · Computer Science 2025-09-24 Liane Xu , Amit Singer

This is a tutorial and survey paper on the Johnson-Lindenstrauss (JL) lemma and linear and nonlinear random projections. We start with linear random projection and then justify its correctness by JL lemma and its proof. Then, sparse random…

Machine Learning · Statistics 2021-08-10 Benyamin Ghojogh , Ali Ghodsi , Fakhri Karray , Mark Crowley

In this paper we give a lower bound for the least distortion embedding of a distance regular graph into Euclidean space. We use the lower bound for finding the least distortion for Hamming graphs, Johnson graphs, and all strongly regular…

Combinatorics · Mathematics 2007-11-14 Frank Vallentin

A celebrated unit distance conjecture due to Erd\H os says that that the unit distances cannot arise more than $C_{\epsilon}n^{1+\epsilon}$ times (for any $\epsilon>0$) among $n$ points in the Euclidean plane (see e.g. \cite{SST84} and the…

Combinatorics · Mathematics 2022-02-14 A. Gafni , A. Iosevich , E. Wyman

Lens spaces are a family of manifolds that have been a source of many interesting phenomena in topology and differential geometry. Their concrete construction, as quotients of odd-dimensional spheres by a free linear action of a finite…

Differential Geometry · Mathematics 2021-08-06 Brenden Balch , Chris Peterson , Clayton Shonkwiler

The problems of random projections and sparse reconstruction have much in common and individually received much attention. Surprisingly, until now they progressed in parallel and remained mostly separate. Here, we employ new tools from…

Data Structures and Algorithms · Computer Science 2010-06-01 Nir Ailon , Edo Liberty

Given a subset K of the unit Euclidean sphere, we estimate the minimal number m = m(K) of hyperplanes that generate a uniform tessellation of K, in the sense that the fraction of the hyperplanes separating any pair x, y in K is nearly…

Probability · Mathematics 2013-09-27 Yaniv Plan , Roman Vershynin

In this paper, we propose a unified algorithmic framework for solving many known variants of \mds. Our algorithm is a simple iterative scheme with guaranteed convergence, and is \emph{modular}; by changing the internals of a single…

Machine Learning · Computer Science 2010-03-31 Arvind Agarwal , Jeff M. Phillips , Suresh Venkatasubramanian

In this work, the relativistic phenomena of Lorentz-Fitzgerald contraction and time dilation are derived using a modified distance formula that is appropriate for discrete space. This new distance formula is different than the Pythagorean…

General Physics · Physics 2018-10-03 David Crouse , Joseph Skufca

Riemannian optimization uses local methods to solve optimization problems whose constraint set is a smooth manifold. A linear step along some descent direction usually leaves the constraints, and hence retraction maps are used to…

Statistics Theory · Mathematics 2023-01-19 Alexander Heaton , Matthias Himmelmann

This paper discusses the topic of dimensionality reduction for $k$-means clustering. We prove that any set of $n$ points in $d$ dimensions (rows in a matrix $A \in \RR^{n \times d}$) can be projected into $t = \Omega(k / \eps^2)$…

Artificial Intelligence · Computer Science 2011-05-05 Christos Boutsidis , Anastasios Zouzias , Petros Drineas

In this paper we study constrained subspace approximation problem. Given a set of $n$ points $\{a_1,\ldots,a_n\}$ in $\mathbb{R}^d$, the goal of the {\em subspace approximation} problem is to find a $k$ dimensional subspace that best…

Data Structures and Algorithms · Computer Science 2025-04-30 Aditya Bhaskara , Sepideh Mahabadi , Madhusudhan Reddy Pittu , Ali Vakilian , David P. Woodruff