English
Related papers

Related papers: Rotational invariant estimator for general noisy m…

200 papers

Precision matrix estimation is a fundamental topic in multivariate statistics and modern machine learning. This paper proposes an adversarially perturbed precision matrix estimation framework, motivated by recent developments in adversarial…

Methodology · Statistics 2026-03-25 Yiling Xie

We consider a prototypical problem of Bayesian inference for a structured spiked model: a low-rank signal is corrupted by additive noise. While both information-theoretic and algorithmic limits are well understood when the noise is a…

Information Theory · Computer Science 2024-07-09 Jean Barbier , Francesco Camilli , Marco Mondelli , Yizhou Xu

We consider the problem of learning a coefficient vector $x_{0}$ in $R^{N}$ from noisy linear observations $y=Fx_{0}+w$ in $R^{M}$ in the high dimensional limit $M,N$ to infinity with $\alpha=M/N$ fixed. We provide a rigorous derivation of…

Machine Learning · Statistics 2020-02-12 Cédric Gerbelot , Alia Abbara , Florent Krzakala

Synchronization of rotations is the problem of estimating a set of rotations R_i in SO(n), i = 1, ..., N, based on noisy measurements of relative rotations R_i R_j^T. This fundamental problem has found many recent applications, most…

Information Theory · Computer Science 2016-01-07 Nicolas Boumal , Amit Singer , P. -A. Absil , Vincent D. Blondel

We consider the problem of estimating an unknown coordinate-wise monotone function given noisy measurements, known as the isotonic regression problem. Often, only a small subset of the features affects the output. This motivates the sparse…

Statistics Theory · Mathematics 2019-07-04 David Gamarnik , Julia Gaudio

In this paper, we first describe a matricial Newton-type algorithm designed to solve the multivariable spectrum approximation problem. We then prove its global convergence. Finally, we apply this approximation procedure to multivariate…

Optimization and Control · Mathematics 2008-09-30 Federico Ramponi , Augusto Ferrante , Michele Pavon

In this paper, the consensus problems of the continuous-time integrator systems under noisy measurements are considered. The measurement noises, which appear when agents measure their neighbors' states, are modeled to be multiplicative. By…

Optimization and Control · Mathematics 2013-04-22 Yuan-Hua Ni , Xun Li

We study the estimation of the covariance matrix $\Sigma$ of a $p$-dimensional normal random vector based on $n$ independent observations corrupted by additive noise. Only a general nonparametric assumption is imposed on the distribution of…

Statistics Theory · Mathematics 2018-03-28 Denis Belomestny , Mathias Trabs , Alexandre B. Tsybakov

We revisit the relative perturbation theory for invariant subspaces of positive definite matrix pairs. As a prototype model problem for our results we consider parameter dependent families of eigenvalue problems. We show that new estimates…

Numerical Analysis · Mathematics 2010-11-22 Luka Grubišić , Ninoslav Truhar , Krešimir Veselić

Consider the design based situation where an $r$-regular set is sampled on a random lattice. A fast algorithm for estimating the integrated mean curvature based on this observation is to use a weighted sum of $2\times \dotsm \times 2$…

Statistics Theory · Mathematics 2016-02-24 Anne Marie Svane

We study the problem of estimating functions of a large symmetric matrix $A_n$ when we only have access to a noisy estimate $\hat{A}_n=A_n+\sigma Z_n/\sqrt{n}.$ We are interested in the case that $Z_n$ is a Wigner ensemble and suggest an…

Probability · Mathematics 2021-06-10 Panagiotis Lolas , Lexing Ying

We introduce a $Z_2$ noise for the stochastic estimation of matrix inversion and discuss its superiority over other noises including the Gaussian noise. This algorithm is applied to the calculation of quark loops in lattice quantum…

High Energy Physics - Lattice · Physics 2009-10-22 S. J. Dong , K. F. Liu

Motivated by value function estimation in reinforcement learning, we study statistical linear inverse problems, i.e., problems where the coefficients of a linear system to be solved are observed in noise. We consider penalized estimators,…

Machine Learning · Computer Science 2012-07-03 Bernardo Avila Pires , Csaba Szepesvari

We study the problem of signal estimation from non-linear observations when the signal belongs to a low-dimensional set buried in a high-dimensional space. A rough heuristic often used in practice postulates that non-linear observations may…

Information Theory · Computer Science 2015-11-17 Yaniv Plan , Roman Vershynin

Low-rank matrix completion has been studied extensively under various type of categories. The problem could be categorized as noisy completion or exact completion, also active or passive completion algorithms. In this paper we focus on…

Machine Learning · Computer Science 2022-03-17 Ilqar Ramazanli

The problem of estimating a complex measure made up by a linear combination of Dirac distributions centered on points of the complex plane from a finite number of its complex moments affected by additive i.i.d. Gaussian noise is considered.…

Statistics Theory · Mathematics 2012-05-03 Piero Barone

This paper investigates statistical inference for noisy matrix completion in a semi-supervised model when auxiliary covariates are available. The model consists of two parts. One part is a low-rank matrix induced by unobserved latent…

Methodology · Statistics 2024-03-27 Shujie Ma , Po-Yao Niu , Yichong Zhang , Yinchu Zhu

In model-free deep reinforcement learning (RL) algorithms, using noisy value estimates to supervise policy evaluation and optimization is detrimental to the sample efficiency. As this noise is heteroscedastic, its effects can be mitigated…

Machine Learning · Computer Science 2022-05-04 Vincent Mai , Kaustubh Mani , Liam Paull

We tackle the problem of learning linear classifiers from noisy datasets in a multiclass setting. The two-class version of this problem was studied a few years ago by, e.g. Bylander (1994) and Blum et al. (1996): in these contributions, the…

Machine Learning · Computer Science 2014-03-21 Ugo Louche , Liva Ralaivola

Simulating sample correlation matrices is important in many areas of statistics. Approaches such as generating Gaussian data and finding their sample correlation matrix or generating random uniform $[-1,1]$ deviates as pairwise correlations…

Statistics Theory · Mathematics 2013-12-09 Johanna Hardin , Stephan Ramon Garcia , David Golan