English
Related papers

Related papers: Estimating Rank-One Spikes from Heavy-Tailed Noise…

200 papers

A number of random matrix ensembles permitting exact determination of their eigenvalue and eigenvector statistics maintain this property under a rank $1$ perturbation. Considered in this review are the additive rank $1$ perturbation of the…

Mathematical Physics · Physics 2022-01-24 Peter J. Forrester

We consider the high-dimensional linear regression model and assume that a fraction of the measurements are altered by an adversary with complete knowledge of the data and the underlying distribution. We are interested in a scenario where…

Statistics Theory · Mathematics 2023-12-11 Stanislav Minsker , Mohamed Ndaoud , Lang Wang

A new approach to solving eigenvalue optimization problems for large structured matrices is proposed and studied. The class of optimization problems considered is related to computing structured pseudospectra and their extremal points, and…

Numerical Analysis · Mathematics 2022-06-22 Nicola Guglielmi , Christian Lubich , Stefano Sicilia

We examine the behaviour of the pseudo-marginal random walk Metropolis algorithm, where evaluations of the target density for the accept/reject probability are estimated rather than computed precisely. Under relatively general conditions on…

Computation · Statistics 2014-12-31 Chris Sherlock , Alexandre H. Thiery , Gareth O. Roberts , Jeffrey S. Rosenthal

We consider the matrix completion problem under a form of row/column weighted entrywise sampling, including the case of uniform entrywise sampling as a special case. We analyze the associated random observation operator, and prove that with…

Information Theory · Computer Science 2011-05-17 Sahand Negahban , Martin J. Wainwright

A central problem of random matrix theory is to understand the eigenvalues of spiked random matrix models, in which a prominent eigenvector is planted into a random matrix. These distributions form natural statistical models for principal…

Statistics Theory · Mathematics 2016-12-26 Amelia Perry , Alexander S. Wein , Afonso S. Bandeira , Ankur Moitra

We study matrix and tensor denoising when the underlying signal is \textbf{not} necessarily low-rank. In the tensor setting, we observe \[ Y = X^\ast + Z \in \mathbb{R}^{p_1 \times p_2 \times p_3}, \] where $X^\ast$ is an unknown signal…

Phase retrieval has been mainly considered in the presence of Gaussian noise. However, the performance of the algorithms proposed under the Gaussian noise model severely degrades when grossly corrupted data, i.e., outliers, exist. This…

Information Theory · Computer Science 2017-11-22 Cheng Qian , Xiao Fu , Nicholas D. Sidiropoulos , Lei Huang , Junhao Xie

The problem of infering the top component of a noisy sample covariance matrix with prior information about the distribution of its entries is considered, in the framework of the spiked covariance model. Using the replica method of…

Statistical Mechanics · Physics 2016-12-20 Rémi Monasson

In existing distributed stochastic optimization studies, it is usually assumed that the gradient noise has a bounded variance. However, recent research shows that the heavy-tailed noise, which allows an unbounded variance, is closer to…

Optimization and Control · Mathematics 2025-05-15 Jun Hu , Chao Sun , Bo Chen , Jianzheng Wang , Zheming Wang

We consider the weak detection problem in a rank-one spiked Wigner data matrix where the signal-to-noise ratio is small so that reliable detection is impossible. We propose a hypothesis test on the presence of the signal by utilizing the…

Statistics Theory · Mathematics 2022-06-28 Hye Won Chung , Ji Oon Lee

Estimating eigenvectors and low-dimensional subspaces is of central importance for numerous problems in statistics, computer science, and applied mathematics. This paper characterizes the behavior of perturbed eigenvectors for a range of…

Statistics Theory · Mathematics 2018-09-14 Joshua Cape , Minh Tang , Carey E. Priebe

In this letter, we address the problem of estimating Gaussian noise level from the trained dictionaries in update stage. We first provide rigorous statistical analysis on the eigenvalue distributions of a sample covariance matrix. Then we…

Signal Processing · Electrical Eng. & Systems 2017-12-12 Rui Chen , Changshui Yang , Huizhu Jia , Xiaodong Xie

We study the fundamental task of outlier-robust mean estimation for heavy-tailed distributions in the presence of sparsity. Specifically, given a small number of corrupted samples from a high-dimensional heavy-tailed distribution whose mean…

Data Structures and Algorithms · Computer Science 2022-11-30 Ilias Diakonikolas , Daniel M. Kane , Jasper C. H. Lee , Ankit Pensia

In this paper, we study the problem of sparse mean estimation under adversarial corruptions, where the goal is to estimate the $k$-sparse mean of a heavy-tailed distribution from samples contaminated by adversarial noise. Existing methods…

Machine Learning · Computer Science 2025-08-26 Jianhao Ma , Rui Ray Chen , Yinghui He , Salar Fattahi , Wei Hu

In this paper, a novel method based on the entropy estimation of the observation space eigenvalues is proposed to estimate the number of the sources in Gaussian and Non-Gaussian noise. In this method, the eigenvalues of correlation matrix…

Applications · Statistics 2024-09-02 Hamid Asadi , Babak Seyfe

The problem of symmetric rank-one approximation of symmetric tensors is important in Independent Components Analysis, also known as Blind Source Separation, as well as polynomial optimization. We analyze the symmetric rank-one approximation…

Computation · Statistics 2011-12-14 Michael James O'Hara

This paper considers sparse spiked covariance matrix models in the high-dimensional setting and studies the minimax estimation of the covariance matrix and the principal subspace as well as the minimax rank detection. The optimal rate of…

Statistics Theory · Mathematics 2016-03-29 Tony Cai , Zongming Ma , Yihong Wu

Low-rank tensor models are widely used in statistics. However, most existing methods rely heavily on the assumption that data follows a sub-Gaussian distribution. To address the challenges associated with heavy-tailed distributions…

Methodology · Statistics 2025-09-16 Xiaoyu Zhang , Di Wang , Guodong Li , Defeng Sun

Spectral methods have myriad applications in high-dimensional statistics and data science, and while previous works have primarily focused on $\ell_2$ or $\ell_{2,\infty}$ eigenvector and singular vector perturbation theory, in many…

Statistics Theory · Mathematics 2026-05-11 Joshua Agterberg
‹ Prev 1 4 5 6 7 8 10 Next ›