English
Related papers

Related papers: Wrong Priors

200 papers

The problem of the priors is well known: it concerns the challenge of identifying norms that govern one's prior credences. I argue that a key to addressing this problem lies in considering what I call the problem of the posteriors -- the…

Other Statistics · Statistics 2025-07-01 Hanti Lin

The likelihood principle makes strong claims about the nature of statistical evidence but is controversial. Its claims are undermined by the existence of several examples that are assumed to show that it allows, with unity probability,…

Statistics Theory · Mathematics 2015-08-25 Michael J. Lew

Specifying a Bayesian prior is notoriously difficult for complex models such as neural networks. Reasoning about parameters is made challenging by the high-dimensionality and over-parameterization of the space. Priors that seem benign and…

Machine Learning · Statistics 2020-10-22 Eric Nalisnick , Jonathan Gordon , José Miguel Hernández-Lobato

The problem of prediction consists in forecasting the conditional distribution of the next outcome given the past. Assume that the source generating the data is such that there is a stationary ergodic predictor whose error converges to zero…

Information Theory · Computer Science 2015-09-28 Daniil Ryabko , Boris Ryabko

This contribution to the debate on confidence limits focuses mostly on the case of measurements with `open likelihood', in the sense that it is defined in the text. I will show that, though a prior-free assessment of {\it confidence} is, in…

High Energy Physics - Experiment · Physics 2007-05-23 G. D'Agostini

One of the greatest difficulties encountered by all in their first proof intensive class is subtly assuming an unproven fact in a proof. The purpose of this note is to describe a specific instance where this can occur, namely in results…

History and Overview · Mathematics 2010-12-30 Steven J. Miller , Cesar E. Silva

We propose a two-component mixture of a noninformative (diffuse) and an informative prior distribution, weighted through the data in such a way to prefer the first component if a prior-data conflict arises. The data-driven approach for…

Methodology · Statistics 2017-08-02 Leonardo Egidi , Francesco Pauli , Nicola Torelli

The derivation of the quantum retrodictive probability formula involves an error, an ambiguity. The end result is correct because this error appears twice, in such a way as to cancel itself. In addition, however, the usual expression for…

Quantum Physics · Physics 2007-05-23 K. A. Kirkpatrick

Point estimation of class prevalences in the presence of data set shift has been a popular research topic for more than two decades. Less attention has been paid to the construction of confidence and prediction intervals for estimates of…

Machine Learning · Statistics 2019-07-23 Dirk Tasche

In this work we generalize standard Decision Theory by assuming that two outcomes can also be incomparable. Two motivating scenarios show how incomparability may be helpful to represent those situations where, due to lack of information,…

Computer Science and Game Theory · Computer Science 2014-04-04 Piero A. Bonatti , Marco Faella , Luigi Sauro

The choice of sentence encoder architecture reflects assumptions about how a sentence's meaning is composed from its constituent words. We examine the contribution of these architectures by holding them randomly initialised and fixed,…

Computation and Language · Computer Science 2019-10-09 Joseph Enguehard , Dan Busbridge , Vitalii Zhelezniak , Nils Hammerla

Binary classifiers trained on a certain proportion of positive items introduce a bias when applied to data sets with different proportions of positive items. Most solutions for dealing with this issue assume that some information on the…

Machine Learning · Statistics 2021-02-18 Marco J. H. Puts , Piet J. H. Daas

The ``impossibility theorem'' -- which is considered foundational in algorithmic fairness literature -- asserts that there must be trade-offs between common notions of fairness and performance when fitting statistical models, except in two…

Machine Learning · Computer Science 2023-02-14 Andrew Bell , Lucius Bynum , Nazarii Drushchak , Tetiana Herasymova , Lucas Rosenblatt , Julia Stoyanovich

As artificial intelligence and machine learning tools become more accessible, and scientists face new obstacles to data collection (e.g. rising costs, declining survey response rates), researchers increasingly use predictions from…

Methodology · Statistics 2024-02-06 Kentaro Hoffman , Stephen Salerno , Awan Afiaz , Jeffrey T. Leek , Tyler H. McCormick

Confusion over the predicativist conception of well-ordering pervades the literature and is responsible for widespread fundamental misconceptions about the nature of predicative reasoning. This short note aims to explain the principal…

Logic · Mathematics 2018-11-09 Nik Weaver

Using instruments comprising ordered responses to items are ubiquitous for studying many constructs of interest. However, using such an item response format may lead to items with response categories infrequently endorsed or unendorsed…

Methodology · Statistics 2024-05-02 R. Noah Padgett , Grant B. Morgan , Tim Lomas

We learn mathematics subjectively and must apply it objectively. But sometimes, we apply it subjectively by using wrong intuitions which may be elusive to our eyes. The aim of this note is to disclose the secretes of two kinds of these…

Functional Analysis · Mathematics 2017-01-23 Fouad Naderi

This article discusses a number of incorrect statements appearing in textbooks on data analysis, machine learning, or computational methods; the common theme in all these cases is the relevance and application of statistics to the study of…

Data Analysis, Statistics and Probability · Physics 2023-01-13 Alexandros Gezerlis , Martin Williams

When a series of measurements is performed with increasingly coarse (or increasingly fine) precision, consecutive observations seem to be erratically distributed at first, and then organize themselves into cycles and patterns. The patterns,…

chao-dyn · Physics 2009-10-22 George G. Szpiro

Inverse problems, where in broad sense the task is to learn from the noisy response about some unknown function, usually represented as the argument of some known functional form, has received wide attention in the general scientific…

Methodology · Statistics 2017-07-24 Debashis Chatterjee , Sourabh Bhattacharya