English
Related papers

Related papers: Fisher consistency for prior probability shift

200 papers

Dempster-Shafer theory of imprecise probabilities has proved useful to incorporate both nonspecificity and conflict uncertainties in an inference mechanism. The traditional Bayesian approach cannot differentiate between the two, and is…

Cryptography and Security · Computer Science 2015-03-20 Sari Haj Hussein

Posterior probabilistic statistical inference without priors is an important but so far elusive goal. Fisher's fiducial inference, Dempster-Shafer theory of belief functions, and Bayesian inference with default priors are attempts to…

Statistics Theory · Mathematics 2013-03-26 Ryan Martin , Chuanhai Liu

A central focus of data science is the transformation of empirical evidence into knowledge. As such, the key insights and scientific attitudes of deep thinkers like Fisher, Popper, and Tukey are expected to inspire exciting new advances in…

Statistics Theory · Mathematics 2025-01-28 Yiran Jiang , Zeyu Zhang , Ryan Martin , Chuanhai Liu

When do nonparametric Bayesian procedures ``overfit''? To shed light on this question, we consider a binary regression problem in detail and establish frequentist consistency for a certain class of Bayes procedures based on hierarchical…

Statistics Theory · Mathematics 2007-06-13 Marc Coram , Steven P. Lalley

By representing the range of fair betting odds according to a pair of confidence set estimators, dual probability measures on parameter space called frequentist posteriors secure the coherence of subjective inference without any prior…

Statistics Theory · Mathematics 2012-05-02 David R. Bickel

Uncertainty quantification is a central challenge in reliable and trustworthy machine learning. Naive measures such as last-layer scores are well-known to yield overconfident estimates in the context of overparametrized neural networks.…

Machine Learning · Computer Science 2023-05-24 Lucas Clarté , Bruno Loureiro , Florent Krzakala , Lenka Zdeborová

Fisher matrices play an important role in experimental design and in data analysis. Their primary role is to make predictions for the inference of model parameters - both their errors and covariances. In this short review, I outline a…

Cosmology and Nongalactic Astrophysics · Physics 2016-08-24 Alan Heavens

An Edgeworth-type expansion is established for the relative Fisher information distance to the class of normal distributions of sums of i.i.d. random variables, satisfying moment conditions. The validity of the central limit theorem is…

Probability · Mathematics 2012-05-01 S. G. Bobkov , G. P. Chistyakov , F. Götze

Bayesian inference can often be sensitive to the choice of hyperparameters of the prior or likelihood, yet defining and quantifying this sensitivity in a principled and computationally feasible way remains challenging in practice.…

Methodology · Statistics 2026-05-28 Arina Odnoblyudova , Charita Dellaporta , François-Xavier Briol

Point estimation of class prevalences in the presence of data set shift has been a popular research topic for more than two decades. Less attention has been paid to the construction of confidence and prediction intervals for estimates of…

Machine Learning · Statistics 2019-07-23 Dirk Tasche

An important challenge in statistical analysis concerns the control of the finite sample bias of estimators. For example, the maximum likelihood estimator has a bias that can result in a significant inferential loss. This problem is…

Statistics Theory · Mathematics 2019-11-04 Stéphane Guerrier , Mucyo Karemera , Samuel Orso , Maria-Pia Victoria-Feser

The Fisher information of a quantum observable is shown to be proportional to both (i) the difference of a quantum and a classical variance, thus providing a measure of nonclassicality; and (ii) the rate of entropy increase under Gaussian…

Quantum Physics · Physics 2009-10-31 Michael J. W. Hall

The presence of interference renders classic Fisher randomization tests infeasible due to nuisance unknowns. To address this issue, we propose imputing the nuisance unknowns and computing Fisher randomization p-values multiple times, then…

Methodology · Statistics 2024-11-14 Tingxuan Han , Ke Zhu , Hanzhong Liu , Ke Deng

Motivated by the need for rigorous and scalable evaluation of large language models, we study contextual preference inference for pairwise comparison functionals of context-dependent preference score functions across domains. Focusing on…

Machine Learning · Statistics 2025-09-09 Yichi Zhang , Alexander Belloni , Ethan X. Fang , Junwei Lu , Xiaoan Xu

Several problems in statistics involve the combination of high-variance unbiased estimators with low-variance estimators that are only unbiased under strong assumptions. A notable example is the estimation of causal effects while combining…

Methodology · Statistics 2023-05-25 Michael Oberst , Alexander D'Amour , Minmin Chen , Yuyan Wang , David Sontag , Steve Yadlowsky

A trade-off between accuracy and fairness is almost taken as a given in the existing literature on fairness in machine learning. Yet, it is not preordained that accuracy should decrease with increased fairness. Novel to this work, we…

Machine Learning · Statistics 2020-12-14 Sanghamitra Dutta , Dennis Wei , Hazar Yueksel , Pin-Yu Chen , Sijia Liu , Kush R. Varshney

Proper quantification of predictive uncertainty is essential for the use of machine learning in safety-critical applications. Various uncertainty measures have been proposed for this purpose, typically claiming superiority over other…

Machine Learning · Computer Science 2025-12-16 Paul Hofman , Yusuf Sale , Eyke Hüllermeier

Uncertainty quantification has received increasing attention in machine learning in the recent past. In particular, a distinction between aleatoric and epistemic uncertainty has been found useful in this regard. The latter refers to the…

Machine Learning · Computer Science 2022-10-14 Viktor Bengs , Eyke Hüllermeier , Willem Waegeman

Fisher forecasts are a common tool in cosmology with applications ranging from survey planning to the development of new cosmological probes. While frequently adopted, they are subject to numerical instabilities that need to be carefully…

Cosmology and Nongalactic Astrophysics · Physics 2021-03-15 Naren Bhandari , C. Danielle Leonard , Markus Michael Rau , Rachel Mandelbaum

Motivated by the information bound for the asymptotic variance of M-estimates for scale, we define Fisher information of scale of any distribution function F on the real line as a suitable supremum. In addition, we enforce equivariance by a…

Statistics Theory · Mathematics 2015-03-17 Peter Ruckdeschel , Helmut Rieder