English
Related papers

Related papers: Improper posteriors are not improper

200 papers

Jakob Bernoulli, working in the late 17th century, identified a gap in contemporary probability theory. He cautioned that it was inadequate to specify force of proof (probability of provability) for some kinds of uncertain arguments. After…

Artificial Intelligence · Computer Science 2018-09-10 Brian Shay , Patrick Brazil

Algorithmic theories of randomness can be related to theories of probabilistic sequence prediction through the notion of a predictor, defined as a function which supplies lower bounds on initial-segment probabilities of infinite sequences.…

Information Theory · Computer Science 2024-01-25 Lenhart K. Schubert

Causality is a central concept in a wide range of research areas, yet there is still no universally agreed axiomatisation of causality. We view causality both as an extension of probability theory and as a study of \textit{what happens when…

Artificial Intelligence · Computer Science 2024-06-07 Junhyung Park , Simon Buchholz , Bernhard Schölkopf , Krikamol Muandet

Given two measurable spaces $H$ and $D$ with countably generated $\sigma$-algebras, a perfect prior probability measure $P_H$ on $H$ and a sampling distribution $S: H \rightarrow D$, there is a corresponding inference map $I: D \rightarrow…

Category Theory · Mathematics 2018-08-16 Jared Culbertson , Kirk Sturtz

In this paper, the Neyman-Pearson lemma for general sublinear expectations is studied. We weaken the assumptions for sublinear expectations in [1] and give a completely new method to study this problem. Applying Mazur-Orlicz Theorem and the…

Probability · Mathematics 2021-08-31 Chuanfeng Sun , Shaolin Ji

Bayes [Philos. Trans. R. Soc. Lond. 53 (1763) 370--418; 54 296--325] introduced the observed likelihood function to statistical inference and provided a weight function to calibrate the parameter; he also introduced a confidence…

Methodology · Statistics 2011-12-26 D. A. S. Fraser

We revisit the flatland paradox proposed by \cite{ston1976} which is an example of non-conglomerability. The aim of the paper is to show that the improperness of the prior is not directly involved in the inconsistency. First, we show that…

Methodology · Statistics 2017-04-10 Pierre Druilhet

The Posterior distribution of the Likelihood Ratio (PLR) is proposed by Dempster in 1974 for significance testing in the simple vs composite hypotheses case. In this hypotheses test case, classical frequentist and Bayesian hypotheses tests…

Data Analysis, Statistics and Probability · Physics 2014-06-05 I. Smith , A. Ferrari

In a recent preprint (Mosegaard and Curtis, 2024, arXiv:2411.13570v2) we analyzed the consequences of ignoring the well-known inconsistency of classical conditional probability densities. We explained how this inconsistency, together with…

Methodology · Statistics 2026-05-01 Klaus Mosegaard , Andrew Curtis

Possibility theory offers a framework where both Lehmann's "preferential inference" and the more productive (but less cautious) "rational closure inference" can be represented. However, there are situations where the second inference does…

Artificial Intelligence · Computer Science 2013-02-18 Salem Benferhat , Didier Dubois , Henri Prade

The Bayesian perspective on inverse problems has attracted much mathematical attention in recent years. Particular attention has been paid to Bayesian inverse problems (BIPs) in which the parameter to be inferred lies in an…

Probability · Mathematics 2017-10-17 T. J. Sullivan

In statistical inference, uncertainty is unknown and all models are wrong. That is to say, a person who makes a statistical model and a prior distribution is simultaneously aware that both are fictional candidates. To study such cases,…

Machine Learning · Computer Science 2023-02-13 Sumio Watanabe

For ill-posed inverse problems, a regularised solution can be interpreted as a mode of the posterior distribution in a Bayesian framework. This framework enriches the set the solutions, as other posterior estimates can be used as a solution…

Statistics Theory · Mathematics 2013-04-22 Natalia Bochkina

Kolmogorov's first axiom of probability is probability takes values between 0 and 1; however, in Cox's derivation of probability having a maximum value of unity is arbitrary since he derives probability as a tool to rank degrees of…

Quantum Physics · Physics 2016-12-05 Kevin Vanslette

The classical condition on the existence of uniformly exponentially consistent tests for testing the true density against the complement of its arbitrary neighborhood has been widely adopted in study of asymptotics of Bayesian nonparametric…

Statistics Theory · Mathematics 2008-12-01 Yang Xing

One can often encounter claims that classical (Kolmogorovian) probability theory cannot handle, or even is contradicted by, certain empirical findings or substantive theories. This note joins several previous attempts to explain that these…

Probability · Mathematics 2019-01-24 Ehtibar N. Dzhafarov , Maria Kon

The role of probability appears unchallenged as the key measure of uncertainty, used among other things for practical induction in the empirical sciences. Yet, Popper was emphatic in his rejection of inductive probability and of the logical…

Other Statistics · Statistics 2021-08-04 Youngjo Lee , Yudi Pawitan

Kolmogorov's setting for probability theory is given an original generalization to account for probabilities arising from Quantum Mechanics. The sample space has a central role in this presentation and random variables, i.e., observables,…

Quantum Physics · Physics 2023-06-05 Daniel Lehmann

The Bayesian framework is a well-studied and successful framework for inductive reasoning, which includes hypothesis testing and confirmation, parameter estimation, sequence prediction, classification, and regression. But standard…

Statistics Theory · Mathematics 2008-06-26 Marcus Hutter

This monograph is an account of the theory of fallible probability and of the dynamics of degrees of belief. It discusses the first order subjective theory in which first order degrees of belief are expressed by subjective probabilities and…

Probability · Mathematics 2008-03-06 Amos Nathan