English
Related papers

Related papers: Johnson-Lindenstrauss lemma for circulant matrices

200 papers

Consider an m by N matrix Phi with the Restricted Isometry Property of order k and level delta, that is, the norm of any k-sparse vector in R^N is preserved to within a multiplicative factor of 1 +- delta under application of Phi. We show…

Information Theory · Computer Science 2011-02-14 Felix Krahmer , Rachel Ward

Let $\varepsilon\in(0,1)$ and $X\subset\mathbb R^d$ be arbitrary with $|X|$ having size $n>1$. The Johnson-Lindenstrauss lemma states there exists $f:X\rightarrow\mathbb R^m$ with $m = O(\varepsilon^{-2}\log n)$ such that $$ \forall x\in X\…

Data Structures and Algorithms · Computer Science 2018-10-23 Shyam Narayanan , Jelani Nelson

We investigate two-sided bounds for operator norms of random matrices with unhomogenous independent entries. We formulate a lower bound for Rademacher matrices and conjecture that it may be reversed up to a universal constant. We show that…

Probability · Mathematics 2024-05-24 Rafał Latała , Witold Świątkowski

Let $X$ be a normed space that satisfies the Johnson-Lindenstrauss lemma (J-L lemma, in short) in the sense that for any integer $n$ and any $x_1,\ldots,x_n\in X$ there exists a linear mapping $L:X\to F$, where $F\subseteq X$ is a linear…

Functional Analysis · Mathematics 2008-07-29 William B. Johnson , Assaf Naor

The Johnson-Lindenstrauss transform is a fundamental method for dimension reduction in Euclidean spaces, that can map any dataset of $n$ points into dimension $O(\log n)$ with low distortion of their distances. This dimension bound is tight…

Data Structures and Algorithms · Computer Science 2026-02-20 Shaofeng H. -C. Jiang , Robert Krauthgamer , Shay Sapir , Sandeep Silwal , Di Yue

We prove a lower bound $\Omega\left(\frac{k+l}{k^2l^2}N^{2-\frac{k+l+2}{kl}}\right)$ on the maximal possible weight of a $(k,l)$-free (that is, free of all-ones $k\times l$ submatrices) Boolean circulant $N \times N$ matrix. The bound is…

Computational Complexity · Computer Science 2017-01-31 M. I. Grinchuk , I. S. Sergeev

We study the effect of Johnson-Lindenstrauss transforms in various projective clustering problems, generalizing recent results which only applied to center-based clustering [MMR19]. We ask the general question: for a Euclidean optimization…

Data Structures and Algorithms · Computer Science 2023-07-11 Moses Charikar , Erik Waingarten

The Johnson-Lindenstrauss (JL) lemma allows subsets of a high-dimensional space to be embedded into a lower-dimensional space while approximately preserving all pairwise Euclidean distances. This important result has inspired an extensive…

Data Structures and Algorithms · Computer Science 2025-01-27 Edem Boahen , March T. Boedihardjo , Rafael Chiclana , Mark Iwen

Uniform bounds on sketched inner products of vectors or matrices underpin several important computational and statistical results in machine learning and randomized algorithms, including the Johnson-Lindenstrauss (J-L) lemma, the Restricted…

Machine Learning · Computer Science 2025-09-29 Rohan Deb , Qiaobo Li , Mayank Shrivastava , Arindam Banerjee

Dimensionality reduction-based dictionary learning methods in the literature have often used iterative random projections. The dimensionality of such a random projection matrix is a random number that might not lead to a separable subspace…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 G. Madhuri , Atul Negi , Kaluri V. Rangarao

The Johnson-Lindenstrauss transform allows one to embed a dataset of $n$ points in $\mathbb{R}^d$ into $\mathbb{R}^m,$ while preserving the pairwise distance between any pair of points up to a factor $(1 \pm \varepsilon)$, provided that $m…

Data Structures and Algorithms · Computer Science 2022-07-08 Ora Nova Fandina , Mikael Møller Høgsgaard , Kasper Green Larsen

The Johnson-Lindenstrauss Lemma (J-L Lemma) is a cornerstone of dimension reduction techniques. We study it in the one-bit context, namely we consider the unit sphere $ \mathbb S ^{N-1}$, with normalized geodesic metric, and map a finite…

Functional Analysis · Mathematics 2019-03-07 Amadou Bah , Bryson Kagy , Emily Smith

The celebrated Johnson-Lindenstrauss lemma states that for all $\varepsilon \in (0,1)$ and finite sets $X \subseteq \mathbb{R}^N$ with $n>1$ elements, there exists a matrix $\Phi \in \mathbb{R}^{m \times N}$ with…

Metric Geometry · Mathematics 2024-03-08 Rafael Chiclana , Mark A. Iwen , Mark Philip Roach

We prove lower bounds of order $n\log n$ for both the problem to multiply polynomials of degree $n$, and to divide polynomials with remainder, in the model of bounded coefficient arithmetic circuits over the complex numbers. These lower…

Computational Complexity · Computer Science 2007-05-23 Peter Buergisser , Martin Lotz

In this paper, we propose a unified algorithmic framework for solving many known variants of \mds. Our algorithm is a simple iterative scheme with guaranteed convergence, and is \emph{modular}; by changing the internals of a single…

Machine Learning · Computer Science 2010-03-31 Arvind Agarwal , Jeff M. Phillips , Suresh Venkatasubramanian

In the recent paper [Jin, Kolda & Ward, arXiv:1909.04801], it is proved that the Kronecker fast Johnson-Lindenstrauss transform (KFJLT) is, in fact, a Johnson-Lindenstrauss transform, which had previously only been conjectured. In this…

Numerical Analysis · Mathematics 2020-05-19 Osman Asif Malik , Stephen Becker

We present a simplified and unified analysis of the Johnson-Lindenstrauss (JL) lemma, a cornerstone of dimensionality reduction for managing high-dimensional data. Our approach simplifies understanding and unifies various constructions…

Machine Learning · Statistics 2024-07-22 Yingru Li

For any integers $d, n \geq 2$ and $1/({\min\{n,d\}})^{0.4999} < \varepsilon<1$, we show the existence of a set of $n$ vectors $X\subset \mathbb{R}^d$ such that any embedding $f:X\rightarrow \mathbb{R}^m$ satisfying $$ \forall x,y\in X,\…

Information Theory · Computer Science 2017-11-10 Kasper Green Larsen , Jelani Nelson

In this paper, we study the restricted isometry property of partial random circulant matrices. For a bounded subgaussian generator with independent entries, we prove that the partial random circulant matrices satisfy $s$-order RIP with high…

Information Theory · Computer Science 2018-08-23 Meng Huang , Yuxuan Pang , Zhiqiang Xu

Let n\geq3 and J_{n}:=circ(J_{1},J_{2},...,J_{n}) and j_{n}:=\circ(j_{0},j_{1},...,j_{n-1}) be the n\timesn circulant matrices, associated with the nth Jacobsthal number J_{n} and the nth Jacobsthal-Lucas number j_{n}, respectively. The…

Numerical Analysis · Mathematics 2012-01-31 Durmuş Bozkurt , Tin-Yau Tam