English
Related papers

Related papers: Reversing the Stein Effect

200 papers

In this work, the estimation of the multivariate normal mean by different classes of shrinkage estimators is investigated. The risk associated with the balanced loss function is used to compare two estimators. We start by considering…

Statistics Theory · Mathematics 2021-07-30 Abdelkader Benkhaled , Mekki Terbeche , Abdenour Hamdaoui

Optimizing recommender systems based on user interaction data is mainly seen as a problem of dealing with selection bias, where most existing work assumes that interactions from different users are independent. However, it has been shown…

Information Retrieval · Computer Science 2022-07-04 Norman Knyazev , Harrie Oosterhuis

A new class of minimax Stein-type shrinkage estimators of a multivariate normal mean is studied where the shrinkage factor is based on an l_p norm. The proposed estimators allow some but not all coordinates to be estimated by 0 thereby…

Statistics Theory · Mathematics 2015-05-29 Yuzo Maruyama

We want to reconstruct a signal based on inhomogeneous data (the amount of data can vary strongly), using the model of regression with a random design. Our aim is to understand the consequences of inhomogeneity on the accuracy of estimation…

Statistics Theory · Mathematics 2016-08-16 Stéphane Gaiffas

We introduce a distributionally robust maximum likelihood estimation model with a Wasserstein ambiguity set to infer the inverse covariance matrix of a $p$-dimensional Gaussian random vector from $n$ independent samples. The proposed model…

Optimization and Control · Mathematics 2018-05-21 Viet Anh Nguyen , Daniel Kuhn , Peyman Mohajerin Esfahani

We derive a tight bound between the quality of estimating a quantum state by measurement and the success probability of undoing the measurement in arbitrary dimensional systems, which completely describes the tradeoff relation between the…

Quantum Physics · Physics 2012-10-12 Yong Wook Cheong , Seung-Woo Lee

This study proposes a combination of a statistical identification approach with potentially invalid short-run zero restrictions. The estimator shrinks towards imposed restrictions and stops shrinkage when the data provide evidence against a…

Econometrics · Economics 2024-04-04 Sascha A. Keweloh

This note shows how to apply the James-Stein estimator to the case of entropic uncertainty relations of more than two observables. A better result is found compared to applying the ordinary estimator and we find a more optimal model…

Quantum Physics · Physics 2017-02-09 Mark Stander

Many statistical practices involve choosing between a full model and reduced models where some coefficients are reduced to zero. Data were used to select a model with estimated coefficients. Is it possible to do so and still come up with an…

Statistics Theory · Mathematics 2007-06-13 Harrison H. Zhou , J. T. Gene Hwang

We develop an adaptive monotone shrinkage estimator for regression models with the following characteristics: i) dense coefficients with small but important effects; ii) a priori ordering that indicates the probable predictive importance of…

Methodology · Statistics 2015-05-08 Zhuang Ma , Dean Foster , Robert Stine

In statistical inference, retrodiction is the act of inferring potential causes in the past based on knowledge of the effects in the present and the dynamics leading to the present. Retrodiction is applicable even when the dynamics is not…

Category Theory · Mathematics 2024-02-01 Arthur J. Parzygnat

Given two sets of data which lead to a similar statistical conclusion, the Simpson Paradox describes the tactic of combining these two sets and achieving the opposite conclusion. Depending upon the given data, this may or may not succeed.…

Applications · Statistics 2008-01-30 Ora E. Percus , Jerome K. Percus

When a linear model is adjusted to control for additional explanatory variables the sign of a fitted coefficient may reverse. Here these reversals are studied using coefficients of determination. The resulting theory can be used to…

Methodology · Statistics 2015-03-11 Brian Knaeble , Seth Dutter

Inverse problems in statistical physics are motivated by the challenges of `big data' in different fields, in particular high-throughput experiments in biology. In inverse problems, the usual procedure of statistical physics needs to be…

Disordered Systems and Neural Networks · Physics 2017-11-07 H. Chau Nguyen , Riccardo Zecchina , Johannes Berg

Shrinkage estimators of covariance are an important tool in modern applied and theoretical statistics. They play a key role in regularized estimation problems, such as ridge regression (aka Tykhonov regularization), regularized discriminant…

Statistics Theory · Mathematics 2011-05-10 Noureddine El Karoui , Holger Koesters

When grains are added to a cylinder, the weight at the bottom is smaller than the total weight of the column, which is partially supported by the lateral walls through wall/grain frictional forces. This is known as the Janssen effect. Via a…

We propose an improved LASSO estimation technique based on Stein-rule. We shrink classical LASSO estimator using preliminary test, shrinkage, and positive-rule shrinkage principle. Simulation results have been carried out for various…

Statistics Theory · Mathematics 2015-03-18 A. K. Md. Ehsanes Saleh , Enayetur Raheem

The concept of biased data is well known and its practical applications range from social sciences and biology to economics and quality control. These observations arise when a sampling procedure chooses an observation with probability that…

Statistics Theory · Mathematics 2007-06-13 Sam Efromovich

The performance of decision policies and prediction models often deteriorates when applied to environments different from the ones seen during training. To ensure reliable operation, we analyze the stability of a system under distribution…

Machine Learning · Statistics 2026-02-13 Hongseok Namkoong , Yuanzhe Ma , Peter W. Glynn

In a remarkable series of papers beginning in 1956, Charles Stein set the stage for the future development of minimax shrinkage estimators of a multivariate normal mean under quadratic loss. More recently, parallel developments have seen…

Methodology · Statistics 2012-03-27 Edward I. George , Feng Liang , Xinyi Xu