English
Related papers

Related papers: The marginalization paradox and the formal Bayes' …

200 papers

Testing hypotheses is an issue of primary importance in the scientific research, as well as in many other human activities. Much clarification about it can be achieved if the process of learning from data is framed in a stochastic model of…

Data Analysis, Statistics and Probability · Physics 2007-05-23 G. D'Agostini

Hierarchical models in Bayesian inverse problems are characterized by an assumed prior probability distribution for the unknown state and measurement error precision, and hyper-priors for the prior parameters. Combining these probability…

Computation · Statistics 2019-06-10 Arvind K. Saibaba , Johnathan Bardsley , D. Andrew Brown , Alen Alexanderian

Bayesian model comparison (BMC) offers a principled probabilistic approach to study and rank competing models. In standard BMC, we construct a discrete probability distribution over the set of possible models, conditional on the observed…

Machine Learning · Statistics 2023-02-22 Marvin Schmitt , Stefan T. Radev , Paul-Christian Bürkner

We study Martin-L\"{o}f random (ML-random) points on computable probability measures on sample and parameter spaces (Bayes models). We consider variants of conditional randomness defined by ML-randomness on Bayes models and those of…

Information Theory · Computer Science 2023-04-24 Hayato Takahashi

Unmeasured confounding is a threat to causal inference and gives rise to biased estimates. In this article, we consider the problem of individualized decision-making under partial identification. Firstly, we argue that when faced with…

Methodology · Statistics 2021-10-22 Yifan Cui

We address the fundamental problem of selection under uncertainty by modeling it from the perspective of Bayesian persuasion. In our model, a decision maker with imperfect information always selects the option with the highest expected…

Computer Science and Game Theory · Computer Science 2024-10-16 Siddhartha Banerjee , Kamesh Munagala , Yiheng Shen , Kangning Wang

This paper develops meshless methods for probabilistically describing discretisation error in the numerical solution of partial differential equations. This construction enables the solution of Bayesian inverse problems while accounting for…

Methodology · Statistics 2017-12-20 Jon Cockayne , Chris Oates , Tim Sullivan , Mark Girolami

Bayes factor, defined as the ratio of the marginal likelihood functions of two competing models, is the natural Bayesian procedure for model selection. Marginal likelihoods are usually computationally demanding and complex. This scenario is…

Methodology · Statistics 2022-09-09 Gabriel Calvo , Carmen Armero , Luigi Spezia , Maria Grazia Pennino

The inverse relation between mutual information (MI) and Bayesian error is sharpened by deriving finite sequences of upper and lower bounds on MI in terms of the minimum probability of error (MPE) and related Bayesian quantities. The well…

Information Theory · Computer Science 2014-09-24 Sudhakar Prasad

Marginalization techniques are presented for the Bayesian filtering problem under the assumption of Gaussian priors and posteriors and a set of sequentially more constraining state space model assumptions. The techniques provide the…

Statistics Theory · Mathematics 2016-07-12 John-Olof Nilsson

Autoregressive language models (LMs) map token sequences to probabilities. The usual practice for computing the probability of any character string (e.g. English sentences) is to first transform it into a sequence of tokens that is scored…

Computation and Language · Computer Science 2023-07-03 Nadezhda Chirkova , Germán Kruszewski , Jos Rozen , Marc Dymetman

In the propositional setting, the marginal problem is to find a (maximum-entropy) distribution that has some given marginals. We study this problem in a relational setting and make the following contributions. First, we compare two…

Artificial Intelligence · Computer Science 2018-04-26 Ondrej Kuzelka , Yuyi Wang , Jesse Davis , Steven Schockaert

In the hypothesis testing framework, p-value is often computed to determine rejection of the null hypothesis or not. On the other hand, Bayesian approaches typically compute the posterior probability of the null hypothesis to evaluate its…

Methodology · Statistics 2020-02-26 Guosheng Yin , Haolun Shi

Probabilities of Causation play a fundamental role in decision making in law, health care and public policy. Nevertheless, their point identification is challenging, requiring strong assumptions such as monotonicity. In the absence of such…

Machine Learning · Statistics 2023-04-06 Numair Sani , Atalanti A. Mastakouri , Dominik Janzing

We consider the Bayesian analysis of models in which the unknown distribution of the outcomes is specified up to a set of conditional moment restrictions. The nonparametric exponentially tilted empirical likelihood function is constructed…

Statistics Theory · Mathematics 2021-10-27 Siddhartha Chib , Minchul Shin , Anna Simoni

We revisit empirical Bayes discrimination detection, focusing on uncertainty arising from both partial identification and sampling variability. While prior work has mostly focused on partial identification, we find that some empirical…

Econometrics · Economics 2025-08-19 Jiaying Gu , Nikolaos Ignatiadis , Azeem M. Shaikh

This paper is concerned with the well known Jeffreys-Lindley paradox. In a Bayesian set up, the so-called paradox arises when a point null hypothesis is tested and an objective prior is sought for the alternative hypothesis. In particular,…

Statistics Theory · Mathematics 2015-03-16 Cristiano Villa , Stephen Walker

This paper describes a method for estimating the marginal likelihood or Bayes factors of Bayesian models using non-parametric importance sampling ("arrogance sampling"). This method can also be used to compute the normalizing constant of…

Computation · Statistics 2015-03-17 Benedict Escoto

A central challenge in statistical inference is the presence of confounding variables that may distort observed associations between treatment and outcome. Conventional "causal" methods, grounded in assumptions such as ignorability, exclude…

Methodology · Statistics 2025-09-09 Ellis Scharfenaker , Duncan K. Foley

A new approach to complex systems aimed to resolve their paradoxes is proposed. Yet, the major inference is the prohibition of informational perpetuum mobile

General Physics · Physics 2008-02-27 Maria K. Koleva