English
Related papers

Related papers: Bulk Johnson-Lindenstrauss Lemmas

200 papers

We consider the moment space $\mathcal{M}_n^{K}$ corresponding to $p \times p$ complex matrix measures defined on $K$ ($K=[0,1]$ or $K=\D$). We endow this set with the uniform law. We are mainly interested in large deviations principles…

Probability · Mathematics 2011-10-17 Fabrice Gamboa , Jan Nagel , Alain Rouault , Jens Wagener

We establish risk bounds for Regularized Empirical Risk Minimizers (RERM) when the loss is Lipschitz and convex and the regularization function is a norm. In a first part, we obtain these results in the i.i.d. setup under subgaussian…

Statistics Theory · Mathematics 2021-01-07 Geoffrey Chinot , Guillaume Lecué , Matthieu Lerasle

Let $n>m$, and let $A$ be an $(m\times n)$-matrix of full rank. Then obviously the estimate $\|Ax\|\leq\|A\|\|x\|$ holds for the euclidean norm of $x$ and $Ax$ and the spectral norm as the assigned matrix norm. We study the sets of all $x$…

Rings and Algebras · Mathematics 2022-03-16 Harry Yserentant

We continue our study of the Johnson-Lindenstrauss lemma and its connection to circulant matrices started in \cite{HV}. We reduce the bound on $k$ from $k=O(\epsilon^{-2}\log^3n)$ proven there to $k=O(\epsilon^{-2}\log^2n)$. Our technique…

Functional Analysis · Mathematics 2010-02-16 Jan Vybíral

We use probabilistic, topological and combinatorial methods to establish the following deviation inequality: For any normed space $X=(\mathbb R^n ,\|\cdot\| )$ there exists an invertible linear map $T:\mathbb R^n \to \mathbb R^n$ with \[…

Functional Analysis · Mathematics 2018-05-21 Grigoris Paouris , Petros Valettas

We study uniqueness in the generalized lasso problem, where the penalty is the $\ell_1$ norm of a matrix $D$ times the coefficient vector. We derive a broad result on uniqueness that places weak assumptions on the predictor matrix $X$ and…

Statistics Theory · Mathematics 2019-05-14 Alnur Ali , Ryan J. Tibshirani

Multidimensional scaling (MDS) is the act of embedding proximity information about a set of $n$ objects in $d$-dimensional Euclidean space. As originally conceived by the psychometric community, MDS was concerned with embedding a fixed set…

Machine Learning · Statistics 2024-12-12 Michael W. Trosset , Carey E. Priebe

We study the $L_p$-discrepancy of random point sets in high dimensions, with emphasis on small values of $p$. Although the classical $L_p$-discrepancy suffers from the curse of dimensionality for all $p \in (1,\infty)$, the gap between…

Numerical Analysis · Mathematics 2025-12-10 Erich Novak , Friedrich Pillichshammer

We investigate the problem of recovering jointly $r$-rank and $s$-bisparse matrices from as few linear measurements as possible, considering arbitrary measurements as well as rank-one measurements. In both cases, we show that $m \asymp r s…

Numerical Analysis · Mathematics 2019-10-25 Simon Foucart , Rémi Gribonval , Laurent Jacques , Holger Rauhut

The $\lambda$-exponential family generalizes the standard exponential family via a generalized convex duality motivated by optimal transport. It is the constant-curvature analogue of the exponential family from the information-geometric…

Statistics Theory · Mathematics 2025-05-07 Xiwei Tian , Ting-Kam Leonard Wong , Jiaowen Yang , Jun Zhang

Statistical properties of non--symmetric real random matrices of size $M$, obtained as truncations of random orthogonal $N\times N$ matrices are investigated. We derive an exact formula for the density of eigenvalues which consists of two…

Statistical Mechanics · Physics 2010-10-21 Boris A. Khoruzhenko , Hans-Juergen Sommers , Karol Zyczkowski

We show how to sketch semidefinite programs (SDPs) using positive maps in order to reduce their dimension. More precisely, we use Johnson\hyp{}Lindenstrauss transforms to produce a smaller SDP whose solution preserves feasibility or…

Optimization and Control · Mathematics 2019-02-12 Andreas Bluhm , Daniel Stilck Franca

Consider a real diagonal deterministic matrix $X_n$ of size $n$ with spectral measure converging to a compactly supported probability measure. We perturb this matrix by adding a random finite rank matrix, with delocalized eigenvectors. We…

Probability · Mathematics 2011-06-21 Florent Benaych-Georges , Alice Guionnet , Mylène Maïda

Data consisting of a graph with a function mapping into $\mathbb{R}^d$ arise in many data applications, encompassing structures such as Reeb graphs, geometric graphs, and knot embeddings. As such, the ability to compare and cluster such…

Computational Geometry · Computer Science 2025-07-17 Erin W. Chambers , Elizabeth Munch , Sarah Percival , Bei Wang

In this paper new general modewise Johnson-Lindenstrauss (JL) subspace embeddings are proposed that are both considerably faster to generate and easier to store than traditional JL embeddings when working with extremely large vectors and/or…

Numerical Analysis · Mathematics 2020-12-18 M. A. Iwen , D. Needell , E. Rebrova , A. Zare

We give a dimensionality reduction procedure to approximate the sum of distances of a given set of $n$ points in $R^d$ to any "shape" that lies in a $k$-dimensional subspace. Here, by "shape" we mean any set of points in $R^d$. Our…

Data Structures and Algorithms · Computer Science 2021-06-25 Zhili Feng , Praneeth Kacham , David P. Woodruff

For any metric space $X$, finite subset spaces of $X$ provide a sequence of isometric embeddings $X=X(1)\subset X(2)\subset\cdots$. The existence of Lipschitz retractions $r_n\colon X(n)\to X(n-1)$ depends on the geometry of $X$ in a subtle…

Metric Geometry · Mathematics 2021-08-10 Earnest Akofor , Leonid V. Kovalev

Langevin dynamics are widely used in sampling high-dimensional, non-Gaussian distributions whose densities are known up to a normalizing constant. In particular, there is strong interest in unadjusted Langevin algorithms (ULA), which…

Methodology · Statistics 2024-10-24 Benjamin J. Zhang , Youssef M. Marzouk , Konstantinos Spiliopoulos

Persistent homology is a popular and useful tool for analysing finite metric spaces, revealing features that can be used to distinguish sets of unlabeled points and as input into machine learning pipelines. The famous stability theorem of…

Computational Geometry · Computer Science 2024-05-10 Philip Smith , Vitaliy Kurlin

Let $R$ and $B$ be two point sets in $\mathbb{R}^d$, with $|R|+ |B| = n$ and where $d$ is a constant. Next, let $\lambda : R \cup B \to \mathbb{N}$ such that $\sum_{r \in R } \lambda(r) = \sum_{b \in B} \lambda(b)$ be demand functions over…

Data Structures and Algorithms · Computer Science 2019-03-21 Pankaj K. Agarwal , Kyle Fox , Debmalya Panigrahi , Kasturi R. Varadarajan , Allen Xiao