English
Related papers

Related papers: Risk Estimators for Choosing Regularization Parame…

200 papers

Algorithms to solve variational regularization of ill-posed inverse problems usually involve operators that depend on a collection of continuous parameters. When these operators enjoy some (local) regularity, these parameters can be…

Statistics Theory · Mathematics 2014-08-12 Charles-Alban Deledalle , Samuel Vaiter , Jalal M. Fadili , Gabriel Peyré

Tikhonov regularization for projected solutions of large-scale ill-posed problems is considered. The Golub-Kahan iterative bidiagonalization is used to project the problem onto a subspace and regularization then applied to find a subspace…

Numerical Analysis · Mathematics 2022-08-16 Rosemary A. Renaut , Saeed Vatankhah , Vahid E. Ardestani

Stein's unbiased risk estimate (SURE) gives an unbiased estimate of the $\ell_2$ risk of any estimator of the mean of a Gaussian random vector. We focus here on the case when the estimator minimizes a quadratic loss term plus a convex…

Statistics Theory · Mathematics 2023-10-09 Parth Nobel , Emmanuel Candès , Stephen Boyd

Estimating the values of unknown parameters from corrupted measured data faces a lot of challenges in ill-posed problems. In such problems, many fundamental estimation methods fail to provide a meaningful stabilized solution. In this work,…

Information Theory · Computer Science 2017-01-11 Mohamed Suliman , Tarig Ballal , Tareq Y. Al-Naffouri

Stein's unbiased risk estimate (SURE) was proposed by Stein for the independent, identically distributed (iid) Gaussian model in order to derive estimates that dominate least-squares (LS). In recent years, the SURE criterion has been…

Methodology · Statistics 2009-11-13 Yonina C. Eldar

Unbiased estimators are introduced for averaged Bregman divergences which generalize Stein's Unbiased (Predictive) Risk Estimator, and the minimization of these estimators is proposed as a regularization parameter selection method for…

Numerical Analysis · Mathematics 2021-11-22 Elias S. Helou , Sandra A. Santos , Lucas E. A. Simões

In the framework of matrix valued observables with low rank means, Stein's unbiased risk estimate (SURE) can be useful for risk estimation and for tuning the amount of shrinkage towards low rank matrices. This was demonstrated by Cand\`es…

Statistics Theory · Mathematics 2017-09-01 Niels Richard Hansen

Deep learning image reconstruction algorithms often suffer from model mismatches when the acquisition scheme differs significantly from the forward model used during training. We introduce a Generalized Stein's Unbiased Risk Estimate…

Machine Learning · Computer Science 2022-01-02 Hemant Kumar Aggarwal , Mathews Jacob

Nearly all estimators in statistical prediction come with an associated tuning parameter, in one way or another. Common practice, given data, is to choose the tuning parameter value that minimizes a constructed estimate of the prediction…

Statistics Theory · Mathematics 2017-01-17 Ryan J. Tibshirani , Saharon Rosset

The truncated singular value decomposition may be used to find the solution of linear discrete ill-posed problems in conjunction with Tikhonov regularization and requires the estimation of a regularization parameter that balances between…

Numerical Analysis · Mathematics 2022-08-16 Rosemary A. Renaut , Anthony W. Helmstetter , Saeed Vatankhah

The kernel-based regularization method has two core issues: kernel design and hyperparameter estimation. In this paper, we focus on the second issue and study the properties of several hyperparameter estimators including the empirical Bayes…

Systems and Control · Computer Science 2017-07-04 Biqiang Mu , Tianshi Chen , Lennart Ljung

In this paper, we aim at recovering an unknown signal x0 from noisy L1measurements y=Phi*x0+w, where Phi is an ill-conditioned or singular linear operator and w accounts for some noise. To regularize such an ill-posed inverse problem, we…

Statistics Theory · Mathematics 2013-11-05 Samuel Vaiter , Charles Deledalle , Gabriel Peyré , Charles Dossal , Jalal Fadili

Estimators based on non-convex sparsity-promoting penalties were shown to yield state-of-the-art solutions to the magneto-/electroencephalography (M/EEG) brain source localization problem. In this paper we tackle the model selection problem…

Image and Video Processing · Electrical Eng. & Systems 2021-12-24 Pierre-Antoine Bannier , Quentin Bertrand , Joseph Salmon , Alexandre Gramfort

Conditional stability estimates are a popular tool for the regularization of ill-posed problems. A drawback in particular under nonlinear operators is that additional regularization is needed for obtaining stable approximate solutions if…

Numerical Analysis · Mathematics 2019-05-29 Daniel Gerth , Bernd Hofmann , Christopher Hofmann

Stein's unbiased risk estimator (SURE) has been shown to be an effective metric for determining optimal parameters for many applications. The topic of this article is focused on the use of SURE for determining parameters for blind…

Numerical Analysis · Mathematics 2022-03-01 Toby Sanders

Linear inverse problems are very common in signal and image processing. Many algorithms that aim at solving such problems include unknown parameters that need tuning. In this work we focus on optimally selecting such parameters in iterative…

Computer Vision and Pattern Recognition · Computer Science 2010-03-23 Raja Giryes , Michael Elad , Yonina C Eldar

Many applied settings in empirical economics involve simultaneous estimation of a large number of parameters. In particular, applied economists are often interested in estimating the effects of many-valued treatments (like teacher effects…

Machine Learning · Statistics 2017-04-03 Alberto Abadie , Maximilian Kasy

In this work, we propose a new criterion for choosing the regularization parameter in Tikhonov regularization when the noise is white Gaussian. The criterion minimizes a lower bound of the predictive risk, when both data norm and noise…

Numerical Analysis · Mathematics 2020-06-24 Federico Benvenuto , Bangti Jin

We study weighted Tikhonov regularization for large-scale linear discrete ill-posed problems with random noise. Under a polynomial upper-bound assumption on the generalized eigenvalues of the discrete forward operator, we derive stochastic…

Numerical Analysis · Mathematics 2026-05-19 Duan-Peng Ling , Wenlong Zhang

We study the choice of the regularisation parameter for linear ill-posed problems in the presence of data noise and operator perturbations, for which a bound on the operator error is known but the data noise-level is unknown. We introduce a…

Numerical Analysis · Mathematics 2018-07-16 Uno Hämarik , Urve Kangro , Stefan Kindermann , Kemal Raik
‹ Prev 1 2 3 10 Next ›