English
Related papers

Related papers: The prior can generally only be understood in the …

200 papers

The behavior of many Bayesian models used in machine learning critically depends on the choice of prior distributions, controlled by some hyperparameters that are typically selected by Bayesian optimization or cross-validation. This…

Machine Learning · Statistics 2023-10-09 Eliezer de Souza da Silva , Tomasz Kuśmierczyk , Marcelo Hartmann , Arto Klami

Following the critical review of Seaman et al. (2012), we reflect on what is presumably the most essential aspect of Bayesian statistics, namely the selection of a prior density. In some cases, Bayesian inference remains fairly stable under…

Methodology · Statistics 2014-07-23 Kaniav Kamary , Christian P. Robert

It is a relatively well-known fact that in problems of Bayesian model selection improper priors should, in general, be avoided. In this paper we derive a proper and parsimonious uniform prior for regression coefficients. We then use this…

Methodology · Statistics 2013-08-07 H. R. N. van Erp , R. O. Linger , P. H. A. J. M. van Gelder

Study of the bivariate normal distribution raises the full range of issues involving objective Bayesian inference, including the different types of objective priors (e.g., Jeffreys, invariant, reference, matching), the different modes of…

Statistics Theory · Mathematics 2008-12-18 James O. Berger , Dongchu Sun

In quantum Bayesian inference problems, any conclusions drawn from a finite number of measurements depend not only on the outcomes of the measurements but also on a prior. Here we show that, in general, the prior remains important even in…

Quantum Physics · Physics 2015-05-13 Christopher A. Fuchs , Ruediger Schack

The ongoing unprecedented exponential explosion of available computing power, has radically transformed the methods of statistical inference. What used to be a small minority of statisticians advocating for the use of priors and a strict…

Data Analysis, Statistics and Probability · Physics 2009-11-07 Carlos C. Rodriguez

Bayesian inference gets its name from *Bayes's theorem*, expressing posterior probabilities for hypotheses about a data generating process as the (normalized) product of prior probabilities and a likelihood function. But Bayesian inference…

Methodology · Statistics 2024-07-02 Thomas J. Loredo , Robert L. Wolpert

The ranking problem is to order a collection of units by some unobserved parameter, based on observations from the associated distribution. This problem arises naturally in a number of contexts, such as business, where we may want to rank…

Methodology · Statistics 2016-10-28 Toby Kenney , Hao He , Hong Gu

In problems with large amounts of missing data one must model two distinct data generating processes: the outcome process which generates the response and the missing data mechanism which determines the data we observe. Under the…

Methodology · Statistics 2021-11-10 Antonio R. Linero

Improper priors are not allowed for the computation of the Bayesian evidence $Z=p({\bf y})$ (a.k.a., marginal likelihood), since in this case $Z$ is not completely specified due to an arbitrary constant involved in the computation. However,…

Methodology · Statistics 2026-02-27 L. Martino , F. Llorente

I review the problem of the choice of the priors from the point of view of a physicist interested in measuring a physical quantity, and I try to show that the reference priors often recommended for the purpose (Jeffreys priors) do not fit…

Data Analysis, Statistics and Probability · Physics 2007-05-23 G. D'Agostini

This paper provides a critical review of the Bayesian perspective of causal inference based on the potential outcomes framework. We review the causal estimands, identification assumptions, the general structure of Bayesian inference of…

Methodology · Statistics 2022-10-25 Fan Li , Peng Ding , Fabrizia Mealli

This chapter provides a overview of Bayesian inference, mostly emphasising that it is a universal method for summarising uncertainty and making estimates and predictions using probability statements conditional on observed data and an…

Methodology · Statistics 2010-02-11 Christian P. Robert , Jean-Michel Marin , Judith Rousseau

Bayesian modeling provides a principled approach to quantifying uncertainty in model parameters and model structure and has seen a surge of applications in recent years. Within the context of a Bayesian workflow, we are concerned with model…

Methodology · Statistics 2025-01-24 Maximilian Scholz , Paul-Christian Bürkner

This introduction to Bayesian statistics presents the main concepts as well as the principal reasons advocated in favour of a Bayesian modelling. We cover the various approaches to prior determination as well as the basis asymptotic…

Methodology · Statistics 2010-02-09 Christian P. Robert , Judith Rousseau

Bayesian models based on the Dirichlet process and other stick-breaking priors have been proposed as core ingredients for clustering, topic modeling, and other unsupervised learning tasks. However, due to the flexibility of these models,…

Methodology · Statistics 2022-01-27 Ryan Giordano , Runjing Liu , Michael I. Jordan , Tamara Broderick

Objective priors for sequential experiments are considered. Common priors, such as the Jeffreys prior and the reference prior, will typically depend on the stopping rule used for the sequential experiment. New expressions for reference…

Statistics Theory · Mathematics 2008-12-18 Dongchu Sun , James O. Berger

The Bayesian approach to data analysis provides a powerful way to handle uncertainty in all observations, model parameters, and model structure using probability theory. Probabilistic programming languages make it easier to specify and fit…

The method of Maximum (relative) Entropy (ME) is used to translate the information contained in the known form of the likelihood into a prior distribution for Bayesian inference. The argument is guided by intuition gained from the…

Data Analysis, Statistics and Probability · Physics 2009-11-10 Ariel Caticha , Roland Preuss

When using complex Bayesian models to combine information, the checking for consistency of the information being combined is good statistical practice. Here a new method is developed for detecting prior-data conflicts in Bayesian models…

Methodology · Statistics 2016-11-29 David J. Nott , Xueou Wang , Michael Evans , Berthold-Georg Englert