English
Related papers

Related papers: On the construction of unbiased estimators for the…

200 papers

We study a simple model of unsupervised learning where the single symmetry breaking vector has binary components $\pm 1$. We calculate exactly the Bayes-optimal performance of an estimator which is required to lie in the same discrete…

Disordered Systems and Neural Networks · Physics 2009-10-31 M. Copelli , C. Van den Broeck , M. Opper

Neural networks are prone to be biased towards spurious correlations between classes and latent attributes exhibited in a major portion of training data, which ruins their generalization capability. We propose a new method for training…

Machine Learning · Computer Science 2023-05-02 Nayeong Kim , Sehyun Hwang , Sungsoo Ahn , Jaesik Park , Suha Kwak

Statistical inference, a central tool of science, revolves around the study and the usage of statistical estimators: functions that map finite samples to predictions about unknown distribution parameters. In the frequentist framework,…

Machine Learning · Computer Science 2025-12-15 Maxime Peyrard , Kyunghyun Cho

Estimating the prevalence of a category in a population using imperfect measurement devices (diagnostic tests, classifiers, or large language models) is fundamental to science, public health, and online trust and safety. Standard approaches…

Artificial Intelligence · Computer Science 2026-04-24 Fridolin Linder , Thomas Leeper , Daniel Haimovich , Niek Tax , Lorenzo Perini , Milan Vojnovic

In this paper, we expand the theory of depth-unbiased source localization to unbiased parameter estimation and signal reconstruction of an arbitrary number of non-zero parameters to be recovered. The topic touches on the concept of exact…

Information Theory · Computer Science 2026-05-08 Joonas Lahtinen

Group testing concerns itself with the accurate recovery of a set of "defective" items from a larger population via a series of tests. While most works in this area have considered the classical group testing model, where tests are binary…

Information Theory · Computer Science 2026-05-13 Daniel McMorrow , Nikhil Karamchandani , Sidharth Jaggi

It is a common contention that it is an ``impossible mission'' to exactly determine the minimum sample size for the estimation of a binomial parameter with prescribed margin of error and confidence level. In this paper, we investigate such…

Statistics Theory · Mathematics 2007-08-02 Xinjia Chen

We revisit resampling procedures for error estimation in binary classification in terms of U-statistics. In particular, we exploit the fact that the error rate estimator involving all learning-testing splits is a U-statistic. Thus, it has…

Statistics Theory · Mathematics 2013-12-19 Mathias Fuchs , Roman Hornung , Riccardo De Bin , Anne-Laure Boulesteix

The empirical Bayes estimators in mixed models are useful for small area estimation in the sense of increasing precision of prediction for small area means, and one wants to know the prediction errors of the empirical Bayes estimators based…

Methodology · Statistics 2016-04-07 Shonosuke Sugasawa , Tatsuya Kubokawa

For large classes of group testing problems, we derive lower bounds for the probability that all significant items are uniquely identified using specially constructed random designs. These bounds allow us to optimize parameters of the…

Statistics Theory · Mathematics 2022-02-17 Jack Noonan , Anatoly Zhigljavsky

Training and evaluation of fair classifiers is a challenging problem. This is partly due to the fact that most fairness metrics of interest depend on both the sensitive attribute information and label information of the data points. In many…

Machine Learning · Computer Science 2021-02-18 Pranjal Awasthi , Alex Beutel , Matthaeus Kleindessner , Jamie Morgenstern , Xuezhi Wang

Estimating the causal effect of a treatment or health policy with observational data can be challenging due to an imbalance of and a lack of overlap between treated and control covariate distributions. In the presence of limited overlap,…

Methodology · Statistics 2025-03-24 Martha Barnard , Jared D. Huling , Julian Wolfson

It is argued that systematically unbiassing estimators is not always justified and can be counter-productive. On the contrary, a general rule is given to build a (slightly) biased but consistent estimator which is always closer to the value…

High Energy Physics - Phenomenology · Physics 2007-05-23 Jean-Michel Levy

In this paper, we study the low-rank matrix completion problem, a class of machine learning problems, that aims at the prediction of missing entries in a partially observed matrix. Such problems appear in several challenging applications…

Machine Learning · Statistics 2023-09-04 The Tien Mai

The linear regression models are widely used statistical techniques in numerous practical applications. The standard regression model requires several assumptions about the regres- sors and the error term. The regression parameters are…

Methodology · Statistics 2016-10-23 P. Vellaisamy

The group testing problem consists of determining a sparse subset of defective items from within a larger set of items via a series of tests, where each test outcome indicates whether at least one defective item is included in the test. We…

Information Theory · Computer Science 2026-04-24 Daniel McMorrow , Jonathan Scarlett

Machine learning algorithms are increasingly used to inform critical decisions. There is a growing concern about bias, that algorithms may produce uneven outcomes for individuals in different demographic groups. In this work, we measure…

Machine Learning · Computer Science 2021-06-01 Runshan Fu , Yangfan Liang , Peter Zhang

In empirical research, when we have multiple estimators for the same parameter of interest, a central question arises: how do we combine unbiased but less precise estimators with biased but more precise ones to improve the inference? Under…

Methodology · Statistics 2026-02-19 Zhexiao Lin , Peter J. Bickel , Peng Ding

Debiasing group graphical lasso estimates enables statistical inference when multiple Gaussian graphical models share a common sparsity pattern. We analyze the estimation properties of group graphical lasso, establishing convergence rates…

Statistics Theory · Mathematics 2025-10-07 Sayan Ranjan Bhowal , Debashis Paul , Gopal K Basak , Samarjit Das

We consider high-dimensional estimation problems where the number of parameters diverges with the sample size. General conditions are established for consistency, uniqueness, and asymptotic normality in both unpenalized and penalized…

Statistics Theory · Mathematics 2025-04-08 Jana Gauss , Thomas Nagler