English
Related papers

Related papers: Estimating Rank-One Spikes from Heavy-Tailed Noise…

200 papers

Consider a Hermitian matrix model under an external potential with spiked external source. When the external source is of rank one, we compute the limiting distribution of the largest eigenvalue for general, regular, analytic potential for…

Mathematical Physics · Physics 2010-12-21 Jinho Baik , Dong Wang

Stochastic first-order methods are standard for training large-scale machine learning models. Random behavior may cause a particular run of an algorithm to result in a highly suboptimal objective value, whereas theoretical guarantees are…

Optimization and Control · Mathematics 2024-09-02 Eduard Gorbunov , Marina Danilova , Innokentiy Shibaev , Pavel Dvurechensky , Alexander Gasnikov

In many real-world optimization problems, the objective function evaluation is subject to noise, and we cannot obtain the exact objective value. Evolutionary algorithms (EAs), a type of general-purpose randomized optimization algorithm,…

Neural and Evolutionary Computing · Computer Science 2022-11-29 Chao Qian , Chao Bian , Wu Jiang , Ke Tang

We present a path integral calculation of the probability distribution associated with the time-integrated moments of the Ornstein-Uhlenbeck process that includes the Gaussian prefactor in addition to the dominant path or instanton term…

Statistical Mechanics · Physics 2022-06-07 Daniel Nickelsen , Hugo Touchette

We study convergence in high-probability of SGD-type methods in non-convex optimization and the presence of heavy-tailed noise. To combat the heavy-tailed noise, a general black-box nonlinear framework is considered, subsuming…

Machine Learning · Statistics 2026-02-11 Aleksandar Armacki , Dragana Bajovic , Dusan Jakovetic , Soummya Kar

Rank estimation is a classical model order selection problem that arises in a variety of important statistical signal and array processing systems, yet is addressed relatively infrequently in the extant literature. Here we present sample…

Methodology · Statistics 2011-08-25 Patrick O. Perry , Patrick J. Wolfe

We consider the estimation of an n-dimensional vector s from the noisy element-wise measurements of $\mathbf{s}\mathbf{s}^T$, a generic problem that arises in statistics and machine learning. We study a mismatched Bayesian inference…

Information Theory · Computer Science 2021-09-14 Farzad Pourkamali , Nicolas Macris

We investigate the noise sensitivity of the top eigenvector of a Wigner matrix in the following sense. Let $v$ be the top eigenvector of an $N\times N$ Wigner matrix. Suppose that $k$ randomly chosen entries of the matrix are resampled,…

Probability · Mathematics 2020-03-03 Charles Bordenave , Gábor Lugosi , Nikita Zhivotovskiy

In array processing, a common problem is to estimate the angles of arrival of $K$ deterministic sources impinging on an array of $M$ antennas, from $N$ observations of the source signal, corrupted by gaussian noise. The problem reduces to…

Probability · Mathematics 2011-06-28 Walid Hachem , Philippe Loubaton , Xavier Mestre , Jamal Najim , Pascal Vallet

We address the problem of estimating a high-dimensional matrix from linear measurements, with a focus on designing optimal rank-adaptive algorithms. These algorithms infer the matrix by estimating its singular values and the corresponding…

Information Theory · Computer Science 2026-05-12 Frédéric Zheng , Yassir Jedra , Alexandre Proutiere

We study the algorithmic thresholds for principal component analysis of Gaussian $k$-tensors with a planted rank-one spike, via Langevin dynamics and gradient descent. In order to efficiently recover the spike from natural initializations,…

Probability · Mathematics 2023-06-23 Gerard Ben Arous , Reza Gheissari , Aukosh Jagannath

We investigate the role of noise in optimization algorithms for learning over-parameterized models. Specifically, we consider the recovery of a rank one matrix $Y^*\in R^{d\times d}$ from a noisy observation $Y$ using an…

Machine Learning · Computer Science 2022-02-09 Tianyi Liu , Yan Li , Enlu Zhou , Tuo Zhao

We study the robustness of accelerated first-order algorithms to stochastic uncertainties in gradient evaluation. Specifically, for unconstrained, smooth, strongly convex optimization problems, we examine the mean-squared error in the…

Optimization and Control · Mathematics 2020-02-21 Hesameddin Mohammadi , Meisam Razaviyayn , Mihailo R. Jovanović

We prove new results about the robustness of well-known convex noise-blind optimization formulations for the reconstruction of low-rank matrices from underdetermined linear measurements. Our results are applicable for symmetric rank-one…

Information Theory · Computer Science 2020-10-26 Felix Krahmer , Christian Kümmerle , Oleh Melnyk

Source enumeration, the task of estimating the number of sources from the signal received by the array of antennas, is a critical problem in array signal processing. Numerous methods have been proposed to estimate the number of sources…

Signal Processing · Electrical Eng. & Systems 2025-07-03 Gokularam Muthukrishnan , Siva Shanmugam , Sheetal Kalyani

We consider the problem of learning the level set for which a noisy black-box function exceeds a given threshold. To efficiently reconstruct the level set, we investigate Gaussian process (GP) metamodels. Our focus is on strongly stochastic…

Machine Learning · Statistics 2020-03-03 Xiong Lyu , Mickael Binois , Michael Ludkovski

Recently, inference about high-dimensional integrated covariance matrices (ICVs) based on noisy high-frequency data has emerged as a challenging problem. In the literature, a pre-averaging estimator (PA-RCov) is proposed to deal with the…

Methodology · Statistics 2017-02-14 Keren Shen , Jianfeng Yao , Wai Keung Li

In this work we consider deterministic, symmetric matrices with heavy-tailed noise imposed on entries within a fixed distance $K$ to the diagonal. The most important example is discrete 1d random Schr\"odinger operator defined on…

Probability · Mathematics 2025-07-01 Yi Han

In this paper, we consider inference and uncertainty quantification for low Tucker rank tensors with additive noise in the high-dimensional regime. Focusing on the output of the higher-order orthogonal iteration (HOOI) algorithm, a commonly…

Statistics Theory · Mathematics 2024-10-10 Joshua Agterberg , Anru Zhang

This paper proposes a novel type of random forests called a denoising random forests that are robust against noises contained in test samples. Such noise-corrupted samples cause serious damage to the estimation performances of random…

Computer Vision and Pattern Recognition · Computer Science 2017-10-31 Masaya Hibino , Akisato Kimura , Takayoshi Yamashita , Yuji Yamauchi , Hironobu Fujiyoshi