English
Related papers

Related papers: Unbiased Risk Estimates for Singular Value Thresho…

200 papers

Consider the problem of estimating the entries of a large matrix, when the observed entries are noisy versions of a small random fraction of the original entries. This problem has received widespread attention in recent times, especially…

Statistics Theory · Mathematics 2014-12-31 Sourav Chatterjee

We propose a method for estimating the entries of a large noisy matrix when the variance of the noise, $\sigma^2$, is unknown without putting any assumption on the rank of the matrix. We consider the estimator for $\sigma$ introduced by…

Statistics Theory · Mathematics 2019-10-30 Mona Azadkia

We consider the problem of estimating a low-rank signal matrix from noisy measurements under the assumption that the distribution of the data matrix belongs to an exponential family. In this setting, we derive generalized Stein's unbiased…

Statistics Theory · Mathematics 2017-10-03 Jérémie Bigot , Charles Deledalle , Delphine Féral

To recover a low rank structure from a noisy matrix, truncated singular value decomposition has been extensively used and studied. Recent studies suggested that the signal can be better estimated by shrinking the singular values. We pursue…

Methodology · Statistics 2014-11-25 Julie Josse , Sylvain Sardy

Stein's unbiased risk estimate (SURE) gives an unbiased estimate of the $\ell_2$ risk of any estimator of the mean of a Gaussian random vector. We focus here on the case when the estimator minimizes a quadratic loss term plus a convex…

Statistics Theory · Mathematics 2023-10-09 Parth Nobel , Emmanuel Candès , Stephen Boyd

We consider unbiased estimation of a sparse nonrandom vector corrupted by additive white Gaussian noise. We show that while there are infinitely many unbiased estimators for this problem, none of them has uniformly minimum variance.…

Statistics Theory · Mathematics 2010-06-02 Alexander Jung , Zvika Ben-Haim , Franz Hlawatsch , Yonina C. Eldar

Extreme Value Theory (EVT) is one of the most commonly used approaches in finance for measuring the downside risk of investment portfolios, especially during financial crises. In this paper, we propose a novel approach based on EVT called…

General Economics · Economics 2020-11-16 Hamidreza Arian , Hossein Poorvasei , Azin Sharifi , Shiva Zamani

Many important problems are characterized by the eigenvalues of a large matrix. For example, the difficulty of many optimization problems, such as those arising from the fitting of large models in statistics and machine learning, can be…

In the framework of matrix valued observables with low rank means, Stein's unbiased risk estimate (SURE) can be useful for risk estimation and for tuning the amount of shrinkage towards low rank matrices. This was demonstrated by Cand\`es…

Statistics Theory · Mathematics 2017-09-01 Niels Richard Hansen

Rank minimization can be converted into tractable surrogate problems, such as Nuclear Norm Minimization (NNM) and Weighted NNM (WNNM). The problems related to NNM, or WNNM, can be solved iteratively by applying a closed-form proximal…

Computer Vision and Pattern Recognition · Computer Science 2019-02-18 Tae-Hyun Oh , Yasuyuki Matsushita , Yu-Wing Tai , In So Kweon

The truncated singular value decomposition may be used to find the solution of linear discrete ill-posed problems in conjunction with Tikhonov regularization and requires the estimation of a regularization parameter that balances between…

Numerical Analysis · Mathematics 2022-08-16 Rosemary A. Renaut , Anthony W. Helmstetter , Saeed Vatankhah

Algorithms to solve variational regularization of ill-posed inverse problems usually involve operators that depend on a collection of continuous parameters. When these operators enjoy some (local) regularity, these parameters can be…

Statistics Theory · Mathematics 2014-08-12 Charles-Alban Deledalle , Samuel Vaiter , Jalal M. Fadili , Gabriel Peyré

In this paper we consider estimating the system parameters and designing stable observer for unknown noisy linear time-invariant (LTI) systems. We propose a Support Vector Regression (SVR) based estimator to provide adjustable asymmetric…

Systems and Control · Electrical Eng. & Systems 2022-05-17 Xuda Ding , Han Wang , Jianping He , Cailian Chen , Xinping Guan

Affine rank minimization problem is the generalized version of low rank matrix completion problem where linear combinations of the entries of a low rank matrix are observed and the matrix is estimated from these measurements. We propose a…

Machine Learning · Computer Science 2021-05-17 Siva Shanmugam , Sheetal Kalyani

We develop a new approach for estimating the risk of an arbitrary estimator of the mean vector in the classical normal means problem. The key idea is to generate two auxiliary data vectors, by adding carefully constructed normal noise…

Statistics Theory · Mathematics 2024-04-25 Natalia L. Oliveira , Jing Lei , Ryan J. Tibshirani

We consider the estimation of a sparse parameter vector from measurements corrupted by white Gaussian noise. Our focus is on unbiased estimation as a setting under which the difficulty of the problem can be quantified analytically. We show…

Information Theory · Computer Science 2010-02-02 Alexander Jung , Zvika Ben-Haim , Franz Hlawatsch , Yonina C. Eldar

Penalized Least Squares are widely used in signal and image processing. Yet, it suffers from a major limitation since it requires fine-tuning of the regularization parameters. Under assumptions on the noise probability distribution,…

Machine Learning · Statistics 2020-05-13 Barbara Pascal , Samuel Vaiter , Nelly Pustelnik , Patrice Abry

Unbiased estimators are introduced for averaged Bregman divergences which generalize Stein's Unbiased (Predictive) Risk Estimator, and the minimization of these estimators is proposed as a regularization parameter selection method for…

Numerical Analysis · Mathematics 2021-11-22 Elias S. Helou , Sandra A. Santos , Lucas E. A. Simões

Modelling noisy data in a network context remains an unavoidable obstacle; fortunately, random matrix theory may comprehensively describe network environments effectively. Thus it necessitates the probabilistic characterisation of these…

Methodology · Statistics 2023-12-04 J. Pillay , A. Bekker , J. T. Ferreira , M. Arashi

Gaussian process regression is used throughout statistics and machine learning for prediction and uncertainty quantification. A Gaussian process is specified by its mean and covariance functions. Many covariance functions, including…

Statistics Theory · Mathematics 2025-10-28 Toni Karvonen , François Bachoc
‹ Prev 1 2 3 10 Next ›