English
Related papers

Related papers: Lower bounds for the trade-off between bias and me…

200 papers

Empirical research typically involves a robustness-efficiency tradeoff. A researcher seeking to estimate a scalar parameter can invoke strong assumptions to motivate a restricted estimator that is precise but may be heavily biased, or they…

Econometrics · Economics 2025-09-17 Timothy B. Armstrong , Patrick Kline , Liyang Sun

We consider the model of nonregular nonparametric regression where smoothness constraints are imposed on the regression function $f$ and the regression errors are assumed to decay with some sharpness level at their endpoints. The aim of…

Statistics Theory · Mathematics 2014-10-02 Moritz Jirak , Alexander Meister , Markus Reiß

A trade-off between accuracy and fairness is almost taken as a given in the existing literature on fairness in machine learning. Yet, it is not preordained that accuracy should decrease with increased fairness. Novel to this work, we…

Machine Learning · Statistics 2020-12-14 Sanghamitra Dutta , Dennis Wei , Hazar Yueksel , Pin-Yu Chen , Sijia Liu , Kush R. Varshney

We establish a general statistical optimality theory for estimation problems where the target parameter is a linear functional of an unknown nuisance component that must be estimated from data. This formulation covers many causal and…

Machine Learning · Statistics 2026-01-06 Jikai Jin , Vasilis Syrgkanis

Unbiased estimation for parameters of maximal distribution is a very fundamental problem in the statistical theory of sublinear expectation. In this paper, we proved that the maximum estimator is the largest unbiased estimator for the upper…

Probability · Mathematics 2016-11-28 Hanqing Jin , Shige Peng

We consider the estimation of a regression function with random design and heteroscedastic noise in a nonparametric setting. More precisely, we address the problem of characterizing the optimal penalty when the regression function is…

Statistics Theory · Mathematics 2015-06-29 Adrien Saumard

We find that, in a linear model, the James-Stein estimator, which dominates the maximum-likelihood estimator in terms of its in-sample prediction error, can perform poorly compared to the maximum-likelihood estimator in out-of-sample…

Statistics Theory · Mathematics 2013-12-02 Nina Huber , Hannes Leeb

We consider the problem of estimating the mean and covariance of a distribution from iid samples in $\mathbb{R}^n$, in the presence of an $\eta$ fraction of malicious noise; this is in contrast to much recent work where the noise itself is…

Data Structures and Algorithms · Computer Science 2016-08-16 Kevin A. Lai , Anup B. Rao , Santosh Vempala

Most modern learning problems are over-parameterized, where the number of learnable parameters is much greater than the number of training data points. In this over-parameterized regime, the training loss typically has infinitely many…

Machine Learning · Computer Science 2025-06-23 Kanumuri Nithin Varma , Babak Hassibi

This paper proposes an estimation framework to assess the performance of sorting over perturbed/noisy data. In particular, the recovering accuracy is measured in terms of Minimum Mean Square Error (MMSE) between the values of the sorting…

Information Theory · Computer Science 2019-09-04 Alex Dytso , Martina Cardone , H. Vincent Poor

The vast majority of statistical theory on binary classification characterizes performance in terms of accuracy. However, accuracy is known in many cases to poorly reflect the practical consequences of classification error, most famously in…

Statistics Theory · Mathematics 2022-09-27 Shashank Singh , Justin Khim

Assume that one is interested in estimating an average treatment effect (ATE), equal to a weighted average of $S$ conditional average treatment effects (CATEs). One has unbiased estimators of the CATEs. One could just average the CATE…

Econometrics · Economics 2025-11-11 Clément de Chaisemartin

In this paper several related estimation problems are addressed from a Bayesian point of view and optimal estimators are obtained for each of them when some natural loss functions are considered. Namely, we are interested in estimating a…

Statistics Theory · Mathematics 2021-10-27 A. G. Nogales

An important challenge in statistical analysis concerns the control of the finite sample bias of estimators. For example, the maximum likelihood estimator has a bias that can result in a significant inferential loss. This problem is…

Statistics Theory · Mathematics 2019-11-04 Stéphane Guerrier , Mucyo Karemera , Samuel Orso , Maria-Pia Victoria-Feser

This paper characterizes the minimax linear estimator of the value of an unknown function at a boundary point of its domain in a Gaussian white noise model under the restriction that the first-order derivative of the unknown function is…

Econometrics · Economics 2017-10-19 Wayne Yuan Gao

We consider the problem of parameter estimation by the observations of deterministic signal in white gaussian noise. It is supposed that the signal has a singularity of cusp-type. The properties of the maximum likelihood and bayesian…

Statistics Theory · Mathematics 2015-09-10 Oleg Chernoyarov , Serguei Dachian , Yury Kutoyants

Binary classifiers trained on a certain proportion of positive items introduce a bias when applied to data sets with different proportions of positive items. Most solutions for dealing with this issue assume that some information on the…

Machine Learning · Statistics 2021-02-18 Marco J. H. Puts , Piet J. H. Daas

We study fairness-accuracy tradeoffs when a single predictive model must serve multiple demographic groups. A useful tool for understanding this tradeoff is the fairness-accuracy (FA) Pareto frontier, which characterizes the set of models…

Machine Learning · Statistics 2026-02-17 Alireza Fallah , Michael I. Jordan , Annie Ulichney

We study worst-case guarantees on the expected return of fixed-dataset policy optimization algorithms. Our core contribution is a unified conceptual and mathematical framework for the study of algorithms in this regime. This analysis…

Artificial Intelligence · Computer Science 2020-12-01 Jacob Buckman , Carles Gelada , Marc G. Bellemare

We consider the problem of linear estimation, and establish an extension of the Gauss-Markov theorem, in which the bias operator is allowed to be non-zero but bounded with respect to a matrix norm of Schatten type. We derive simple and…

Machine Learning · Computer Science 2023-11-21 Simon Segert