English
Related papers

Related papers: C-SURE: Shrinkage Estimator and Prototype Classifi…

200 papers

In this study, we consider preliminary test and shrinkage estimation strategies for quantile regression models. In classical Least Squares Estimation (LSE) method, the relationship between the explanatory and explained variables in the…

Statistics Theory · Mathematics 2017-09-07 Bahadır Yüzbaşı , Yasin Asar , M. Şamil Şık , Ahmet Demiralp

The estimation of the mean matrix of the multivariate normal distribution is addressed in the high dimensional setting. Efron-Morris-type linear shrinkage estimators based on ridge estimators for the precision matrix instead of the…

Statistics Theory · Mathematics 2020-07-07 Ryota Yuasa , Tatsuya Kubokawa

In this letter, we investigate the shrinkage problem for the non-local means (NLM) image denoising. In particular, we derive the closed-form of the optimal blockwise shrinkage for NLM that minimizes the Stein's unbiased risk estimator…

Computer Vision and Pattern Recognition · Computer Science 2015-05-05 Yue Wu , Brian Tracey , Premkumar Natarajan , Joseph P. Noonan

Estimators based on non-convex sparsity-promoting penalties were shown to yield state-of-the-art solutions to the magneto-/electroencephalography (M/EEG) brain source localization problem. In this paper we tackle the model selection problem…

Image and Video Processing · Electrical Eng. & Systems 2021-12-24 Pierre-Antoine Bannier , Quentin Bertrand , Joseph Salmon , Alexandre Gramfort

The Stein paradox has played an influential role in the field of high dimensional statistics. This result warns that the sample mean, classically regarded as the "usual estimator", may be suboptimal in high dimensions. The development of…

Statistics Theory · Mathematics 2021-09-07 Alex Shkolnik

For the univariate current status and, more generally, the interval censoring model, distribution theory has been developed for the maximum likelihood estimator (MLE) and smoothed maximum likelihood estimator (SMLE) of the unknown…

Statistics Theory · Mathematics 2013-06-18 Piet Groeneboom

This paper discusses the properties of certain risk estimators recently proposed to choose regularization parameters in ill-posed problems. A simple approach is Stein's unbiased risk estimator (SURE), which estimates the risk in the data…

Popular debiased estimation methods for causal inference -- such as augmented inverse propensity weighting and targeted maximum likelihood estimation -- enjoy desirable asymptotic properties like statistical efficiency and double robustness…

Machine Learning · Statistics 2025-09-16 Tiffany Tianhui Cai , Yuri Fonseca , Kaiwen Hou , Hongseok Namkoong

Binarization of neural networks is a dominant paradigm in neural networks compression. The pioneering work BinaryConnect uses Straight Through Estimator (STE) to mimic the gradients of the sign function, but it also causes the crucial…

Computer Vision and Pattern Recognition · Computer Science 2023-08-28 Xiao-Ming Wu , Dian Zheng , Zuhao Liu , Wei-Shi Zheng

A popular regularized (shrinkage) covariance estimator is the shrinkage sample covariance matrix (SCM) which shares the same set of eigenvectors as the SCM but shrinks its eigenvalues toward its grand mean. In this paper, a more general…

Methodology · Statistics 2020-02-13 Esa Ollila , Daniel P. Palomar , Frederic Pascal

Maximum likelihood estimation in nonlinear models can exhibit substantial instability in finite samples when the data provide limited information about certain parameters. Such instability is driven by rare but extreme realizations of the…

Methodology · Statistics 2026-04-15 Masamune Iwasawa

The Gauss Markov theorem states that the weighted least squares estimator is a linear minimum variance unbiased estimation (MVUE) in linear models. In this paper, we take a first step towards extending this result to non linear settings via…

Machine Learning · Computer Science 2023-11-30 Tzvi Diskin , Yonina C. Eldar , Ami Wiesel

Linear inverse problems are very common in signal and image processing. Many algorithms that aim at solving such problems include unknown parameters that need tuning. In this work we focus on optimally selecting such parameters in iterative…

Computer Vision and Pattern Recognition · Computer Science 2010-03-23 Raja Giryes , Michael Elad , Yonina C Eldar

Consider estimating the n by p matrix of means of an n by p matrix of independent normally distributed observations with constant variance, where the performance of an estimator is judged using a p by p matrix quadratic error loss function.…

Statistics Theory · Mathematics 2011-01-19 Reman Abu-Shanab , John T. Kent , William E. Strawderman

We address the problem of signal denoising via transform-domain shrinkage based on a novel $\textit{risk}$ criterion called the minimum probability of error (MPE), which measures the probability that the estimated parameter lies outside an…

Applications · Statistics 2020-02-19 Jishnu Sadasivan , Subhadip Mukherjee , Chandra Sekhar Seelamantula

This paper is speculated to propose a class of shrinkage estimators for shape parameter beta in failure censored samples from two-parameter Weibull distribution when some 'apriori' or guessed interval containing the parameter beta is…

Statistics Theory · Mathematics 2007-06-13 Housila P. Singh , Sharad Saxena , Jack Allen , Sarjinder Singh , Florentin Smarandache

In this paper, we revisit techniques for uncertainty estimation within deep neural networks and consolidate a suite of techniques to enhance their reliability. Our investigation reveals that an integrated application of diverse…

Computer Vision and Pattern Recognition · Computer Science 2024-03-04 Yuting Li , Yingyi Chen , Xuanlong Yu , Dexiong Chen , Xi Shen

Modern statistics provides an ever-expanding toolkit for estimating unknown parameters. Consequently, applied statisticians frequently face a difficult decision: retain a parameter estimate from a familiar method or replace it with an…

Methodology · Statistics 2022-12-20 Brian L. Trippe , Sameer K. Deshpande , Tamara Broderick

We compare an autoencoder convolutional neural network (AE-CNN) with a conventional maximum-likelihood estimator (MLE) for inferring cluster virial masses, $M_v$, directly from the galaxy distribution around clusters, without identifying…

Cosmology and Nongalactic Astrophysics · Physics 2025-11-18 Raeed Mundow , Adi Nusser

Shrinkage estimators have profound impacts in statistics and in scientific and engineering applications. In this article, we consider shrinkage estimation in the presence of linear predictors. We formulate two heteroscedastic hierarchical…

Methodology · Statistics 2024-06-21 Samuel Kou , Justin J. Yang