English
Related papers

Related papers: On Improved Loss Estimation for Shrinkage Estimato…

200 papers

We propose Stein-type estimators for zero-inflated Bell regression models by incorporating information on model parameters. These estimators combine the advantages of unrestricted and restricted estimators. We derive the asymptotic…

Computation · Statistics 2024-03-04 Solmaz Seifollahi , Hossein Bevrani , Zakariya Yahya Algamal

Consider nonparametric function estimation under $L^p$-loss. The minimax rate for estimation of the regression function over a H\"older ball with smoothness index $\beta$ is $n^{-\beta/(2\beta+1)}$ if $1\leq p<\infty$ and $(n/\log…

Statistics Theory · Mathematics 2015-02-10 Johannes Schmidt-Hieber

A large empirical literature regresses outcomes on empirical Bayes shrinkage estimates of value-added, yet little is known about whether this approach leads to unbiased estimates and valid inference for the downstream regression…

Econometrics · Economics 2025-12-11 Tian Xie

In this paper, we consider the problem of estimating the $p\times p$ scale matrix $\Sigma$ of a multivariate linear regression model $Y=X\,\beta + \mathcal{E}\,$ when the distribution of the observed matrix $Y$ belongs to a large class of…

Statistics Theory · Mathematics 2020-12-23 Anis M. Haddouche , Dominique Fourdrinier , Fatiha Mezoued

This work proposes a wavelet shrinkage rule under asymmetric LINEX loss function and a mixture of a point mass function at zero and the logistic distribution as prior distribution to the wavelet coefficients in a nonparametric regression…

Methodology · Statistics 2023-07-27 Alex Rodrigo dos Santos Sousa

There is growing evidence that converting targets to soft targets in supervised learning can provide considerable gains in performance. Much of this work has considered classification, converting hard zero-one values to soft labels---such…

Machine Learning · Statistics 2018-06-13 Ehsan Imani , Martha White

We describe a hierarchical Bayesian approach for inference about a parameter $\theta$ lower-bounded by $\alpha$ with uncertain $\alpha$, derive some basic identities for posterior analysis about $(\theta,\alpha)$, and provide illustrations…

Statistics Theory · Mathematics 2018-06-08 Éric Marchand , Theodoros Nicoleris

We derive minimax generalized Bayes estimators of regression coefficients in the general linear model with spherically symmetric errors under invariant quadratic loss for the case of unknown scale. The class of estimators generalizes the…

Statistics Theory · Mathematics 2010-09-14 Yuzo Maruyama , William E. Strawderman

We construct a surrogate loss to directly optimise the significance metric used in particle physics. We evaluate our loss function for a simple event classification task using a linear model and show that it produces decision boundaries…

High Energy Physics - Phenomenology · Physics 2024-12-13 Jai Bardhan , Cyrin Neeraj , Subhadip Mitra , Tanumoy Mandal

Feature selection problems have been extensively studied for linear estimation, for instance, Lasso, but less emphasis has been placed on feature selection for non-linear functions. In this study, we propose a method for feature selection…

Machine Learning · Computer Science 2020-07-28 Yutaro Yamada , Ofir Lindenbaum , Sahand Negahban , Yuval Kluger

We consider the problem of combining data from observational and experimental sources to make causal conclusions. This problem is increasingly relevant, as the modern era has yielded passive collection of massive observational datasets in…

Methodology · Statistics 2020-05-19 Evan Rosenman , Guillaume Basse , Art Owen , Michael Baiocchi

We consider the problem of estimating the joint distribution of $n$ independent random variables. Our approach is based on a family of candidate probabilities that we shall call a model and which is chosen to either contain the true…

Statistics Theory · Mathematics 2021-06-01 Yannick Baraud

Consider two populations characterized by independent random variables $X_1$ and $X_2$ such that $X_i, i=1,2,$ follows a gamma distribution with an unknown scale parameter $\theta_i>0$, and known shape parameter $\alpha >0$ (the same shape…

Statistics Theory · Mathematics 2022-09-22 Masihuddin , Neeraj Misra

Let y=A\beta+\epsilon, where y is an N\times1 vector of observations, \beta is a p\times1 vector of unknown regression coefficients, A is an N\times p design matrix and \epsilon is a spherically symmetric error term with unknown scale…

Statistics Theory · Mathematics 2010-09-14 Yuzo Maruyama , William E. Strawderman

Variance estimation in the linear model when $p > n$ is a difficult problem. Standard least squares estimation techniques do not apply. Several variance estimators have been proposed in the literature, all with accompanying asymptotic…

Methodology · Statistics 2014-01-30 Stephen Reid , Robert Tibshirani , Jerome Friedman

This paper focuses on investigating Stein's invariant shrinkage estimators for large sample covariance matrices and precision matrices in high-dimensional settings. We consider models that have nearly arbitrary population covariance…

Statistics Theory · Mathematics 2024-04-24 Xiucai Ding , Yun Li , Fan Yang

Consider an autoregressive model with measurement error: we observe $Z_i=X_i+\epsilon_i$, where $X_i$ is a stationary solution of the equation $X_i=f_{\theta^0}(X_{i-1})+\xi_i$. The regression function $f_{\theta^0}$ is known up to a finite…

Statistics Theory · Mathematics 2011-10-27 Jérôme Dedecker , Adeline Samson , Marie-Luce Taupin

Accurately forecasting the probability distribution of phenomena of interest is a classic and ever more widespread goal in statistics and decision theory. In comparison to point forecasts, probabilistic forecasts aim to provide a more…

Statistics Theory · Mathematics 2025-05-05 Erez Buchweitz , João Vitor Romano , Ryan J. Tibshirani

Hierarchical statistical models are widely employed in information science and data engineering. The models consist of two types of variables: observable variables that represent the given data and latent variables for the unobservable…

Machine Learning · Statistics 2014-02-21 Keisuke Yamazaki

Point estimators may not exist, need not be unique, and their distributions are not parameter invariant. Generalized estimators provide distributions that are parameter invariant, unique, and exist when point estimates do not. Comparing…

Statistics Theory · Mathematics 2022-11-04 Paul W. Vos