English
Related papers

Related papers: Sparse Hanson-Wright Inequalities with Application…

200 papers

We derive explicit Bernstein-type and Bennett-type concentration inequalities for matrix-valued martingale processes with unbounded observations from the Hermitian space $\mathbb{H}(d)$. Specifically, we assume that the…

Probability · Mathematics 2025-02-21 Alexey Kroshnin , Alexandra Suvorikova

Random feature methods have been successful in various machine learning tasks, are easy to compute, and come with theoretical accuracy bounds. They serve as an alternative approach to standard neural networks since they can represent…

Machine Learning · Statistics 2026-01-21 Abolfazl Hashemi , Hayden Schaeffer , Robert Shi , Ufuk Topcu , Giang Tran , Rachel Ward

The unadjusted Langevin algorithm is widely used for sampling from complex high-dimensional distributions. It is well known to be biased, with the bias typically scaling linearly with the dimension when measured in squared Wasserstein…

Machine Learning · Statistics 2025-09-11 Daniel Lacker , Fuzhong Zhou

We consider $N\times N$ self-adjoint Gaussian random matrices defined by an arbitrary deterministic sparsity pattern with $d$ nonzero entries per row. We show that such random matrices exhibit a canonical localization-delocalization…

Probability · Mathematics 2024-01-03 Laura Shou , Ramon van Handel

We present two sharp, closed-form empirical Bernstein inequalities for symmetric random matrices with bounded eigenvalues. By sharp, we mean that both inequalities adapt to the unknown variance in a tight manner: the deviation captured by…

Probability · Mathematics 2025-09-19 Hongjian Wang , Aaditya Ramdas

In this paper, we prove the restricted isometry property of block diagonal random matrices with elements from $\varphi$-sub-Gaussian variables, which extends the previously known results for the sub-Gaussian case. A crucial ingredient of…

Probability · Mathematics 2024-11-14 Yiming Chen , Guozheng Dai , Kaiti Ding

We introduce a randomly extrapolated primal-dual coordinate descent method that adapts to sparsity of the data matrix and the favorable structures of the objective function. Our method updates only a subset of primal and dual variables with…

Optimization and Control · Mathematics 2020-07-14 Ahmet Alacaoglu , Olivier Fercoq , Volkan Cevher

We consider a sparse linear regression model with unknown symmetric error under the high-dimensional setting. The true error distribution is assumed to belong to the locally $\beta$-H\"{o}lder class with an exponentially decreasing tail,…

Statistics Theory · Mathematics 2020-09-01 Kyoungjae Lee , Minwoo Chae , Lizhen Lin

Consider a $n\times n$ sparse non-Hermitian random matrix $X_n$ defined as the Hadamard product between a random matrix with centered independent and identically distributed entries and a sparse Bernoulli matrix with success probability…

Probability · Mathematics 2026-02-25 Walid Hachem , Michail Louvaris , Jamal Najim

Sparse graphs with bounded average degree form a rich class of discrete structures where local geometry strongly influences global behavior. The Benjamini-Schramm (BS) convergence offers a natural framework to describe their asymptotic…

Probability · Mathematics 2025-10-14 Charles Bordenave

In this paper, we propose a novel nonconvex approach to robust principal component analysis for HSI denoising, which focuses on simultaneously developing more accurate approximations to both rank and column-wise sparsity for the low-rank…

Image and Video Processing · Electrical Eng. & Systems 2022-12-07 Chong Peng , Yang Liu , Yongyong Chen , Xinxin Wu , Andrew Cheng , Zhao Kang , Chenglizhao Chen , Qiang Cheng

Sparse non-Hermitian random matrices arise in the study of disordered physical systems with asymmetric local interactions, and have applications ranging from neural networks to ecosystem dynamics. The spectral characteristics of these…

Statistical Mechanics · Physics 2024-02-21 Fernando Lucas Metz , Izaak Neri , Tim Rogers

Complex networks with directed, local interactions are ubiquitous in nature, and often occur with probabilistic connections due to both intrinsic stochasticity and disordered environments. Sparse non-Hermitian random matrices arise…

Disordered Systems and Neural Networks · Physics 2019-12-04 Grace H. Zhang , David R. Nelson

We prove that the reverse characteristic polynomial $\det(I_n - zA_n)$ of a random $n \times n$ matrix $A_n$ with iid $\mathrm{Bernoulli}(d/n)$ entries converges in distribution towards the random infinite product $\prod_{\ell =…

Probability · Mathematics 2021-06-23 Simon Coste

In this paper, we describe a new algorithm that approximates the extreme eigenvalue/eigenvector pairs of a symmetric matrix. The proposed algorithm can be viewed as an extension of the Jacobi eigenvalue method for symmetric matrices…

Numerical Analysis · Mathematics 2025-09-16 Cristian Rusu

We review the application of the notion of local convergence on locally finite randomly rooted graphs, known as Benjamini-Schramm convergence, to the calculation of the global eigenvalue density of random matrices from the beta-Gaussian and…

Probability · Mathematics 2018-05-29 Sergio Andraus

We develop novel empirical Bernstein inequalities for the variance of bounded random variables. Our inequalities hold under constant conditional variance and mean, without further assumptions like independence or identical distribution of…

Statistics Theory · Mathematics 2026-05-28 Diego Martinez-Taboada , Aaditya Ramdas

Consider an $ N \times N$ Hermitian one-dimensional random band matrix with band width $W > N^{1 / 2 + \frak c} $ for any $ {\frak c} > 0$. In the bulk of the spectrum and in the large $ N $ limit, we obtain the following results: (i) The…

Probability · Mathematics 2025-05-22 Horng-Tzer Yau , Jun Yin

We present a concentration result concerning random weighted projections in high dimensional spaces. As applications, we prove (1) New concentration inequalities for random quadratic forms; (2) The infinity norm of most unit eigenvectors of…

Probability · Mathematics 2014-08-19 Van Vu , Ke Wang

We propose a novel parallel numerical algorithm for calculating the smallest eigenvalues of highly ill-conditioned matrices. It is based on the {\it LDLT} decomposition and involves finding a $k \times k$ sub-matrix of the inverse of the…

Numerical Analysis · Mathematics 2018-10-04 Yang Chen , Jakub Sikorowski , Mengkun Zhu