English
Related papers

Related papers: Generalized SURE for Exponential Families: Applica…

200 papers

Linear inverse problems are very common in signal and image processing. Many algorithms that aim at solving such problems include unknown parameters that need tuning. In this work we focus on optimally selecting such parameters in iterative…

Computer Vision and Pattern Recognition · Computer Science 2010-03-23 Raja Giryes , Michael Elad , Yonina C Eldar

The application of Deep Neural Networks (DNNs) to image denoising has notably challenged traditional denoising methods, particularly within complex noise scenarios prevalent in medical imaging. Despite the effectiveness of traditional and…

Image and Video Processing · Electrical Eng. & Systems 2024-08-31 Reeshad Khan , John Gauch , Ukash Nakarmi

This paper is devoted to adaptive signal denoising in the context of Graph Signal Processing (GSP) using Spectral Graph Wavelet Transform (SGWT). This issue is addressed \emph{via} a data-driven thresholding process in the transformed…

Signal Processing · Electrical Eng. & Systems 2021-02-03 Basile de Loynes , Fabien Navarro , Baptiste Olivier

Graphical models are a framework for representing and exploiting prior conditional independence structures within distributions using graphs. In the Gaussian case, these models are directly related to the sparsity of the inverse covariance…

Statistics Theory · Mathematics 2015-10-28 Ami Wiesel , Yonina C. Eldar , Alfred O. Hero

Recently, many self-supervised learning methods for image reconstruction have been proposed that can learn from noisy data alone, bypassing the need for ground-truth references. Most existing methods cluster around two classes: i) Stein's…

Machine Learning · Statistics 2025-02-12 Julián Tachella , Mike Davies , Laurent Jacques

To address the challenges of reliable statistical inference in high-dimensional models, we introduce the Synthetic-data Regularized Estimator (SRE). Unlike traditional regularization methods, the SRE regularizes the complex target model via…

Statistics Theory · Mathematics 2025-03-18 Weihao Li , Dongming Huang

In this paper, we aim at recovering an unknown signal x0 from noisy L1measurements y=Phi*x0+w, where Phi is an ill-conditioned or singular linear operator and w accounts for some noise. To regularize such an ill-posed inverse problem, we…

Statistics Theory · Mathematics 2013-11-05 Samuel Vaiter , Charles Deledalle , Gabriel Peyré , Charles Dossal , Jalal Fadili

Using integration by parts on Gaussian space we construct a Stein Unbiased Risk Estimator (SURE) for the drift of Gaussian processes using their local and occupation times. By almost-sure minimization of the SURE risk of shrinkage…

Statistics Theory · Mathematics 2009-02-23 Nicolas Privault , Anthony Réveillac

A method of determining the optimum number of levels of decomposition in soft-thresholding wavelet denoising using Stationary Wavelet Transform is presented here. The method calculates the risk at each level of decomposition using Steins…

Computational Physics · Physics 2017-01-25 Mohd Rozni Md Yusof , Ahmad Kamal bin Ariffin

Shrinkage estimation is a fundamental tool of modern statistics, pioneered by Charles Stein upon his discovery of the famous paradox involving the multivariate Gaussian. A large portion of the subsequent literature only considers the…

Statistics Theory · Mathematics 2022-03-30 Max Fathi , Larry Goldstein , Gesine Reinert , Adrien Saumard

Many applications involve estimating the mean of multiple binomial outcomes as a common problem -- assessing intergenerational mobility of census tracts, estimating prevalence of infectious diseases across countries, and measuring…

Econometrics · Economics 2026-01-01 Yan Chen , Lihua Lei

Stein unbiased risk estimation is generalized twice, from the Gaussian shift model to nonparametric families of smooth densities, and from the quadratic risk to more general divergence type distances. The development relies on a connection…

Statistics Theory · Mathematics 2011-05-12 Werner Ehm

We derive the asymptotic risk function of regularized empirical risk minimization (ERM) estimators tuned by $n$-fold cross-validation (CV). The out-of-sample prediction loss of such estimators converges in distribution to the squared-error…

Statistics Theory · Mathematics 2026-03-24 Karun Adusumilli , Maximilian Kasy , Ashia Wilson

Deep learning algorithms that rely on extensive training data are revolutionizing image recovery from ill-posed measurements. Training data is scarce in many imaging applications, including ultra-high-resolution imaging. The deep image…

Image and Video Processing · Electrical Eng. & Systems 2021-11-23 Maneesh John , Hemant Kumar Aggarwal , Qing Zou , Mathews Jacob

In this paper, we are interested in the classical problem of restoring data degraded by a convolution and the addition of a white Gaussian noise. The originality of the proposed approach is two-fold. Firstly, we formulate the restoration…

Methodology · Statistics 2015-05-13 Jean-Christophe Pesquet , Amel Benazza-Benyahia , Caroline Chaux

We introduce a smooth variant of the SCAD thresholding rule for wavelet denoising by replacing its piecewise linear transition with a raised cosine. The resulting shrinkage function is odd, continuous on R, and continuously differentiable…

Computation · Statistics 2026-01-19 Radhika Kulkarni , Aluisio Pinheiro , Brani Vidakovic , Abdourrahmane M. Atto

Selecting regularization parameters in penalized high-dimensional graphical models in a principled, data-driven, and computationally efficient manner continues to be one of the key challenges in high-dimensional statistics. We present…

Methodology · Statistics 2016-10-19 Christian L. Müller , Richard Bonneau , Zachary Kurtz

This work presents a novel general regularized distributed solution for the state estimation problem in networked systems. Resting on the graph-based representation of sensor networks and adopting a multivariate least-squares approach, the…

Systems and Control · Electrical Eng. & Systems 2021-11-17 Marco Fabris , Giulia Michieletto , Angelo Cenedese

In this paper we study the effective degrees of freedom of a general class of reduced rank estimators for multivariate regression in the framework of Stein's unbiased risk estimation (SURE). We derive a finite-sample exact unbiased…

Methodology · Statistics 2013-04-23 Ashin Mukherjee , Kun Chen , Naisyin Wang , Ji Zhu

This note examines the behavior of generalization capabilities - as defined by out-of-sample mean squared error (MSE) - of Linear Gaussian (with a fixed design matrix) and Linear Least Squares regression. Particularly, we consider a…

Statistics Theory · Mathematics 2021-09-21 Karthik Duraisamy