English
Related papers

Related papers: On the Largest and the Smallest Singular Value of …

200 papers

The properties of the first (largest) eigenvalue and its eigenvector (first eigenvector) are investigated for large sparse random symmetric matrices that are characterized by bimodal degree distributions. In principle, one should be able to…

Disordered Systems and Neural Networks · Physics 2012-08-03 Yoshiyuki Kabashima , Hisanao Takahashi

The spectra of random feature matrices provide essential information on the conditioning of the linear system used in random feature regression problems and are thus connected to the consistency and generalization of random feature models.…

Machine Learning · Statistics 2022-12-13 Zhijun Chen , Hayden Schaeffer , Rachel Ward

The covariance matrix of a $p$-dimensional random variable is a fundamental quantity in data analysis. Given $n$ i.i.d. observations, it is typically estimated by the sample covariance matrix, at a computational cost of $O(np^{2})$…

Computation · Statistics 2018-11-13 Ofer Shwartz , Boaz Nadler

Given a redundant dictionary $\Phi$, represented by an $M \times N$ matrix ($\Phi \in \mathbb{R}^{M \times N}$) and a target signal $y \in \mathbb{R}^M$, the \emph{sparse approximation problem} asks to find an approximate representation of…

Computational Complexity · Computer Science 2011-11-29 Ali Civril

Let $G=G(n,p_n)$ be a homogeneous Erd\"os-R\'enyi graph, and $A$ its adjacency matrix with eigenvalues $\lambda_1(A) \geq \lambda_2(A) \geq ... \geq \lambda_n(A).$ Local laws have been used to show that $lambda_2(A)$ can exhibit…

Probability · Mathematics 2024-12-24 Simona Diaconu

We investigate the large $N$ behavior of the smallest eigenvalue, $\lambda_{N}$, of an $\left(N+1\right)\times \left(N+1\right)$ Hankel (or moments) matrix $\mathcal{H}_{N}$, generated by the weight…

Mathematical Physics · Physics 2018-04-02 Mengkun Zhu , Yang Chen , Niall Emmart , Charles Weems

We consider m independent random rectangular matrices whose entries are independent and identically distributed standard complex Gaussian random variables. Assume the product of the m rectangular matrices is an n by n square matrix. The…

Probability · Mathematics 2022-07-18 Yongcheng Qi , Mengzi Xie

In this paper, we consider a well-known sparse optimization problem that aims to find a sparse solution of a possibly noisy underdetermined system of linear equations. Mathematically, it can be modeled in a unified manner by minimizing…

Optimization and Control · Mathematics 2021-10-01 Lei Yang , Xiaojun Chen , Shuhuang Xiang

Consider the normalized adjacency matrices of random $d$-regular graphs on $N$ vertices with fixed degree $d\geq 3$, and denote the eigenvalues as $\lambda_1=d/\sqrt{d-1}\geq \lambda_2\geq\lambda_3\cdots\geq \lambda_N$. We prove that the…

Probability · Mathematics 2024-05-21 Jiaoyang Huang , Theo McKenzie , Horng-Tzer Yau

We study the problem of sparse tensor principal component analysis: given a tensor $\pmb Y = \pmb W + \lambda x^{\otimes p}$ with $\pmb W \in \otimes^p\mathbb{R}^n$ having i.i.d. Gaussian entries, the goal is to recover the $k$-sparse unit…

Machine Learning · Computer Science 2021-11-03 Davin Choo , Tommaso d'Orsi

We consider a problem in random matrix theory that is inspired by quantum information theory: determining the largest eigenvalue of a sum of p random product states in (C^d)^{otimes k}, where k and p/d^k are fixed while d grows. When k=1,…

Quantum Physics · Physics 2012-02-09 Andris Ambainis , Aram W. Harrow , Matthew B. Hastings

Sparse binary matrices are of great interest in the field of sparse recovery, nonnegative compressed sensing, statistics in networks, and theoretical computer science. This class of matrices makes it possible to perform signal recovery with…

Information Theory · Computer Science 2024-12-09 Pedro Abdalla

We prove an algorithmic regularity lemma for $L_p$ regular matrices $(1 < p \leq \infty),$ a class of sparse $\{0,1\}$ matrices which obey a natural pseudorandomness condition. This extends a result of Coja-Oghlan, Cooper and Frieze who…

Combinatorics · Mathematics 2017-05-19 Thodoris Karageorgos , Silouanos Brazitikos

In the context of the compressed sensing problem, we propose a new ensemble of sparse random matrices which allow one (i) to acquire and compress a {\rho}0-sparse signal of length N in a time linear in N and (ii) to perfectly recover the…

Information Theory · Computer Science 2013-04-15 Maria Chiara Angelini , Federico Ricci-Tersenghi , Yoshiyuki Kabashima

The behavior of the leading singular values and vectors of noisy low-rank matrices is fundamental to many statistical and scientific problems. Theoretical understanding currently derives from asymptotic analysis under one of two regimes:…

Statistics Theory · Mathematics 2023-08-03 Michael J. Feldman

In this paper, we analyze the large n-limit for random matrix with external source with three distinct eigenvalues. And we confine ourselves in the Hermite case and the three distinct eigenvalues are $-a,0,a$. For the case $a^2>3$, we…

Mathematical Physics · Physics 2015-10-02 Jian Xu , Engui Fan , Yang Chen

We show that the spectral radius of an $N\times N$ random symmetric matrix with i.i.d. bounded centered but non-symmetrically distributed entries is bounded from below by $ 2 \*\sigma - o(N^{-6/11+\epsilon}), $ where $\sigma^2 $ is the…

Probability · Mathematics 2008-05-14 Sandrine Peche , Alexander Soshnikov

Let $M_n$ denote a random symmetric $n \times n$ matrix whose upper diagonal entries are independent and identically distributed Bernoulli random variables (which take values $1$ and $-1$ with probability $1/2$ each). It is widely…

Probability · Mathematics 2019-09-10 Asaf Ferber , Vishesh Jain

In this paper, we consider $m$ independent random rectangular matrices whose entries are independent and identically distributed standard complex Gaussian random variables and assume the product of the $m$ rectangular matrices is an $n$ by…

Probability · Mathematics 2021-04-08 Yongcheng Qi , Hongru Zhao

Let A be an M by N matrix (M < N) which is an instance of a real random Gaussian ensemble. In compressed sensing we are interested in finding the sparsest solution to the system of equations A x = y for a given y. In general, whenever the…

Information Theory · Computer Science 2011-03-09 Mihailo Stojnic , Farzad Parvaresh , Babak Hassibi