English
Related papers

Related papers: Bayes factors with (overly) informative priors

200 papers

Objective prior distributions represent an important tool that allows one to have the advantages of using the Bayesian framework even when information about the parameters of a model is not available. The usual objective approaches work off…

Methodology · Statistics 2018-09-25 Fabrizio Leisen , Cristiano Villa , Stephen G. Walker

Stochastic independence has a complex status in probability theory. It is not part of the definition of a probability measure, but it is nonetheless an essential property for the mathematical development of this theory. Bayesian decision…

Computer Science and Game Theory · Computer Science 2023-06-22 Philippe Mongin

We review common situations in Bayesian latent variable models where the prior distribution that a researcher specifies differs from the prior distribution used during estimation. These situations can arise from the positive definite…

Methodology · Statistics 2024-11-19 Edgar C. Merkle , Oludare Ariyo , Sonja D. Winter , Mauricio Garnier-Villarreal

Informally, "Information Inconsistency" is the property that has been observed in many Bayesian hypothesis testing and model selection procedures whereby the Bayesian conclusion does not become definitive when the data seems to become…

Statistics Theory · Mathematics 2017-10-27 Joris Mulder , James O. Berger , Víctor Peña , M. J. Bayarri

A staple of Bayesian model comparison and hypothesis testing, Bayes factors are often used to quantify the relative predictive performance of two rival hypotheses. The computation of Bayes factors can be challenging, however, and this has…

Methodology · Statistics 2023-09-19 František Bartoš , Eric-Jan Wagenmakers

Inference from limited data requires a notion of measure on parameter space, most explicit in the Bayesian framework as a prior. Here we demonstrate that Jeffreys prior, the best-known uninformative choice, introduces enormous bias when…

Other Statistics · Statistics 2023-04-03 Michael C. Abbott , Benjamin B. Machta

We develop simple methods for constructing likelihoods and parameter priors for learning about the parameters and structure of a Bayesian network. In particular, we introduce several assumptions that permit the construction of likelihoods…

Machine Learning · Computer Science 2021-07-01 David Heckerman , Dan Geiger

In Bayesian hypothesis testing and model selection, prior distributions must be chosen carefully. For example, setting arbitrarily large prior scales for location parameters, which is common practice in estimation problems, can lead to…

Statistics Theory · Mathematics 2019-11-25 Víctor Peña , James O. Berger

The Bayes factor, the data-based updating factor from prior to posterior odds, is a principled measure of relative evidence for two competing hypotheses. It is naturally suited to sequential data analysis in settings such as clinical trials…

Methodology · Statistics 2026-01-07 Samuel Pawel , Leonhard Held

Forecasting techniques for assessing the power of future experiments to discriminate between theories or discover new laws of nature are of great interest in many areas of science. In this paper, we introduce a Bayesian forecasting method…

Data Analysis, Statistics and Probability · Physics 2024-09-24 Mohammad Hossein Namjoo

We consider the problem of assessing whether, in an individual case, there is a causal relationship between an observed exposure and a response variable. When data are available on similar individuals we may be able to estimate prospective…

Statistics Theory · Mathematics 2023-11-15 Monica Musio , Philip Dawid

We propose a new method for conducting Bayesian prediction that delivers accurate predictions without correctly specifying the unknown true data generating process. A prior is defined over a class of plausible predictive models. After…

Methodology · Statistics 2020-08-24 Ruben Loaiza-Maya , Gael M. Martin , David T. Frazier

We propose a two-component mixture of a noninformative (diffuse) and an informative prior distribution, weighted through the data in such a way to prefer the first component if a prior-data conflict arises. The data-driven approach for…

Methodology · Statistics 2017-08-02 Leonardo Egidi , Francesco Pauli , Nicola Torelli

Deep learning is increasingly moving towards a transfer learning paradigm whereby large foundation models are fine-tuned on downstream tasks, starting from an initialization learned on the source task. But an initialization contains…

Machine Learning · Computer Science 2022-05-23 Ravid Shwartz-Ziv , Micah Goldblum , Hossein Souri , Sanyam Kapoor , Chen Zhu , Yann LeCun , Andrew Gordon Wilson

Analysis of competing risks data plays an important role in the lifetime data analysis. Recently Feizjavadian and Hashemi (Computational Statistics and Data Analysis, vol. 82, 19-34, 2015) provided a classical inference of a competing risks…

Methodology · Statistics 2021-05-04 Debashis Samanta , Debasis Kundu

Bayes' theorem incorporates distinct types of information through the likelihood and prior. Direct observations of state variables enter the likelihood and modify posterior probabilities through consistent updating. Information in terms of…

Methodology · Statistics 2024-07-19 Duncan K. Foley , Ellis Scharfenaker

This paper provides a critical review of the Bayesian perspective of causal inference based on the potential outcomes framework. We review the causal estimands, identification assumptions, the general structure of Bayesian inference of…

Methodology · Statistics 2022-10-25 Fan Li , Peng Ding , Fabrizia Mealli

We study the identifiability of parameters and falsifiability of predictions under the process of model expansion in a Bayesian setting. Identifiability is represented by the closeness of the posterior to the prior distribution and…

Statistics Theory · Mathematics 2025-10-15 Collin Cademartori

In the application of Bayesian methods to metrology, pre-data probabilities play a critical role in the estimation of the model uncertainty. Following the observation that distributions form Riemann's manifolds, methods of differential…

Methodology · Statistics 2015-12-17 Giovanni Mana , Carlo Palmisano

The recent literature on deep learning offers new tools to learn a rich probability distribution over high dimensional data such as images or sounds. In this work we investigate the possibility of learning the prior distribution over neural…

Machine Learning · Statistics 2017-12-19 Alexandre Lacoste , Thomas Boquet , Negar Rostamzadeh , Boris Oreshkin , Wonchang Chung , David Krueger