English
Related papers

Related papers: New and improved Johnson-Lindenstrauss embeddings …

200 papers

When a matrix A with n columns is known to be well approximated by a linear combination of basis matrices B_1,..., B_p, we can apply A to a random vector and solve a linear system to recover this linear combination. The same technique can…

Numerical Analysis · Mathematics 2011-10-20 Jiawei Chiu , Laurent Demanet

Compressed Sensing aims to capture attributes of a sparse signal using very few measurements. Cand\`{e}s and Tao showed that sparse reconstruction is possible if the sensing matrix acts as a near isometry on all $\boldsymbol{k}$-sparse…

Information Theory · Computer Science 2009-10-18 Robert Calderbank , Stephen Howard , Sina Jafarpour

In this letter, we first construct a counter example to show that for any given positive integer $K\geq 2$ and for any $\frac{1}{\sqrt{K+1}}\leq t<1$, there always exist a $K-$sparse $\x$ and a matrix $\A$ with the restricted isometry…

Information Theory · Computer Science 2014-06-18 Jinming Wen , Xiaomei Zhu , Dongfang Li

In previous work, theoretical analysis based on the tensor Restricted Isometry Property (t-RIP) established the robust recovery guarantees of a low-tubal-rank tensor. The obtained sufficient conditions depend strongly on the assumption that…

Machine Learning · Statistics 2019-09-17 Feng Zhang , Wendong Wang , Jingyao Hou , Jianjun Wang , Jianwen Huang

Let $(M,g)$ be an $n$-dimensional compact boudaryless Riemannian manifold with nonpositive sectional curvature, then our conclusion is that we can give improved estimates for the $L^p$ norms of the restrictions of eigenfunctions to smooth…

Analysis of PDEs · Mathematics 2012-10-31 Xuehua Chen

The Johnson-Lindenstrauss Lemma (J-L Lemma) is a cornerstone of dimension reduction techniques. We study it in the one-bit context, namely we consider the unit sphere $ \mathbb S ^{N-1}$, with normalized geodesic metric, and map a finite…

Functional Analysis · Mathematics 2019-03-07 Amadou Bah , Bryson Kagy , Emily Smith

The field of compressed sensing has become a major tool in high-dimensional analysis, with the realization that vectors can be recovered from relatively very few linear measurements as long as the vectors lie in a low-dimensional structure,…

Information Theory · Computer Science 2020-04-30 Pete Casazza , Xuemei Chen , Richard Lynch

We study randomized algorithms for constrained optimization, in abstract frameworks that include, in strictly increasing generality: convex programming; LP-type problems; violator spaces; and a setting we introduce, consistent spaces. Such…

Computational Geometry · Computer Science 2019-06-04 Kenneth L. Clarkson , Bernd Gärtner , Johannes Lengler , May Szedlak

Dimension reduction algorithms are a crucial part of many data science pipelines, including data exploration, feature creation and selection, and denoising. Despite their wide utilization, many non-linear dimension reduction algorithms are…

Machine Learning · Statistics 2024-08-06 Ryan Murray , Adam Pickarski

In this paper, we prove that with high probability, random Reed-Solomon codes approach the half-Singleton bound - the optimal rate versus error tradeoff for linear insdel codes - with linear-sized alphabets. More precisely, we prove that,…

Information Theory · Computer Science 2024-07-11 Roni Con , Zeyu Guo , Ray Li , Zihan Zhang

The Restricted Isometry Property (RIP) introduced by Cand\'es and Tao is a fundamental property in compressed sensing theory. It says that if a sampling matrix satisfies the RIP of certain order proportional to the sparsity of the signal,…

Information Theory · Computer Science 2009-01-06 Leslie Ying , Yi Ming Zou

Arbitrary matrices $M \in \mathbb{R}^{m \times n}$, randomly perturbed in an additive manner using a random matrix $R \in \mathbb{R}^{m \times n}$, are shown to asymptotically almost surely satisfy the so-called {\sl robust null space…

Probability · Mathematics 2025-07-29 Elad Aigner-Horev , Dan Hefetz , Michael Trushkin

Low-distortion embeddings are critical building blocks for developing random sampling and random projection algorithms for linear algebra problems. We show that, given a matrix $A \in \R^{n \times d}$ with $n \gg d$ and a $p \in [1, 2)$,…

Data Structures and Algorithms · Computer Science 2013-03-22 Xiangrui Meng , Michael W. Mahoney

Consider the normalized adjacency matrices of random $d$-regular graphs on $N$ vertices with fixed degree $d\geq 3$, and denote the eigenvalues as $\lambda_1=d/\sqrt{d-1}\geq \lambda_2\geq\lambda_3\cdots\geq \lambda_N$. We prove that the…

Probability · Mathematics 2024-05-21 Jiaoyang Huang , Theo McKenzie , Horng-Tzer Yau

Given a large data matrix $A\in\mathbb{R}^{n\times n}$, we consider the problem of determining whether its entries are i.i.d. with some known marginal distribution $A_{ij}\sim P_0$, or instead $A$ contains a principal submatrix $A_{{\sf…

Computational Complexity · Computer Science 2015-02-24 Yash Deshpande , Andrea Montanari

Any closed, connected Riemannian manifold $M$ can be smoothly embedded by its Laplacian eigenfunction maps into $\mathbb{R}^m$ for some $m$. We call the smallest such $m$ the maximal embedding dimension of $M$. We show that the maximal…

Machine Learning · Statistics 2016-05-06 Jonathan Bates

We introduce and study the notion of an outer bi-Lipschitz extension of a map between Euclidean spaces. The notion is a natural analogue of the notion of a Lipschitz extension of a Lipschitz map. We show that for every map $f$ there exists…

Data Structures and Algorithms · Computer Science 2018-11-09 Sepideh Mahabadi , Konstantin Makarychev , Yury Makarychev , Ilya Razenshteyn

A sufficient condition reported very recently for perfect recovery of a K-sparse vector via orthogonal matching pursuit (OMP) in K iterations is that the restricted isometry constant of the sensing matrix satisfies…

Information Theory · Computer Science 2014-01-06 Ling-Hua Chang , Jwo-Yuh Wu

In this paper, we present a simple factor 6 algorithm for approximating the optimal multiplicative distortion of embedding a graph metric into a tree metric (thus improving and simplifying the factor 100 and 27 algorithms of B\v{a}doiu,…

Metric Geometry · Mathematics 2015-03-17 Victor Chepoi , Feodor Dragan , Ilan Newman , Yuri Rabinovich , Yann Vaxes

The goal of ordinal embedding is to represent items as points in a low-dimensional Euclidean space given a set of constraints in the form of distance comparisons like "item $i$ is closer to item $j$ than item $k$". Ordinal constraints like…

Machine Learning · Statistics 2016-06-24 Lalit Jain , Kevin Jamieson , Robert Nowak