English
Related papers

Related papers: Flexible Prior Elicitation via the Prior Predictiv…

200 papers

Empirical likelihood is a popular nonparametric statistical tool that does not require any distributional assumptions. In this paper, we explore the possibility of conducting variable selection via Bayesian empirical likelihood. We show…

Methodology · Statistics 2022-06-13 Yichen Cheng , Yichuan Zhao

We use the language of uninformative Bayesian prior choice to study the selection of appropriately simple effective models. We advocate for the prior which maximizes the mutual information between parameters and predictions, learning as…

Data Analysis, Statistics and Probability · Physics 2018-02-16 Henry H. Mattingly , Mark K. Transtrum , Michael C. Abbott , Benjamin B. Machta

The behavior of many Bayesian models used in machine learning critically depends on the choice of prior distributions, controlled by some hyperparameters that are typically selected by Bayesian optimization or cross-validation. This…

Machine Learning · Statistics 2023-10-09 Eliezer de Souza da Silva , Tomasz Kuśmierczyk , Marcelo Hartmann , Arto Klami

Using instruments comprising ordered responses to items are ubiquitous for studying many constructs of interest. However, using such an item response format may lead to items with response categories infrequently endorsed or unendorsed…

Methodology · Statistics 2024-05-02 R. Noah Padgett , Grant B. Morgan , Tim Lomas

We propose a novel approach to perform approximate Bayesian inference in complex models such as Bayesian neural networks. The approach is more scalable to large data than Markov Chain Monte Carlo, it embraces more expressive models than…

Machine Learning · Statistics 2022-09-07 Joel Janek Dabrowski , Daniel Edward Pagendam

In this work we study the problem of inferring a discrete probability distribution using both expert knowledge and empirical data. This is an important issue for many applications where the scarcity of data prevents a purely empirical…

Machine Learning · Computer Science 2020-01-08 Rémi Besson , Erwan Le Pennec , Stéphanie Allassonnière

With the continued increase in the use of Bayesian methods in drug development, there is a need for statisticians to have tools to develop robust and defensible informative prior distributions. Whilst relevant empirical data should, where…

Applications · Statistics 2017-09-01 Nigel Dallow , Nicky Best , Timothy Montague

This article describes an approach to incorporate expert opinion on observable quantities through the use of a loss function which updates a prior belief as opposed to specifying parameters on the priors. Eliciting information on observable…

Machine Learning · Statistics 2023-02-14 Philip Cooney , Arthur White

Inferring the value of a property of a large stochastic system is a difficult task when the number of samples is insufficient to reliably estimate the probability distribution. The Bayesian estimator of the property of interest requires the…

Data Analysis, Statistics and Probability · Physics 2022-01-26 Damián G. Hernández , Inés Samengo

Bayesian predictive inference propagates parameter uncertainty to quantities of interest through the posterior-predictive distribution. In practice, this is typically performed using a two-stage procedure: first approximating the posterior…

Machine Learning · Statistics 2026-05-06 Nan Feng , Xun Huan

Providing accurate predictions is challenging for machine learning algorithms when the number of features is larger than the number of samples in the data. Prior knowledge can improve machine learning models by indicating relevant variables…

Artificial Intelligence · Computer Science 2017-01-17 Luana Micallef , Iiris Sundin , Pekka Marttinen , Muhammad Ammad-ud-din , Tomi Peltola , Marta Soare , Giulio Jacucci , Samuel Kaski

We develop a Bayesian approach for selecting the model which is the most supported by the data within a class of marginal models for categorical variables formulated through equality and/or inequality constraints on generalised logits…

Statistics Theory · Mathematics 2012-02-21 Francesco Bartolucci , Luisa Scaccia , Alessio Farcomeni

Motivated by parametric models for which the likelihood is analytically unavailable, numerically unstable, or prohibitively expensive to compute or optimize, we develop a prior- and likelihood-free framework for fully probabilistic…

Methodology · Statistics 2026-03-17 Leonardo Cella , Emily C. Hector

We propose a methodology for modeling and comparing probability distributions within a Bayesian nonparametric framework. Building on dependent normalized random measures, we consider a prior distribution for a collection of discrete random…

Methodology · Statistics 2022-06-01 Mario Beraha , Jim E. Griffin

In real-world Bayesian inference applications, prior assumptions regarding the parameters of interest may be unrepresentative of their actual values for a given dataset. In particular, if the likelihood is concentrated far out in the wings…

Computation · Statistics 2018-11-01 Xi Chen , Mike Hobson , Saptarshi Das , Paul Gelderblom

Sensitivity forecasts inform the design of experiments and the direction of theoretical efforts. To arrive at representative results, Bayesian forecasts should marginalize their conclusions over uncertain parameters and noise realizations…

Instrumentation and Methods for Astrophysics · Physics 2024-05-24 T. Gessey-Jones , W. J. Handley

Given i.i.d. data from an unknown distribution, we consider the problem of predicting future items. An adaptive way to estimate the probability density is to recursively subdivide the domain to an appropriate data-dependent granularity. A…

Statistics Theory · Mathematics 2007-06-13 Marcus Hutter

Objective probabilistic forecasts of future climate that include parameter uncertainty can be made by using the Bayesian prediction integral with the prior set to Jeffreys' Prior. The calculations involved in determining the prior can then…

Atmospheric and Oceanic Physics · Physics 2010-05-24 Stephen Jewson , Dan Rowlands , Myles Allen

To include parameter uncertainty into probabilistic climate forecasts one must first specify a prior. We advocate the use of objective priors, and, in particular, the Jeffreys' Prior. In previous work we have derived expressions for the…

Atmospheric and Oceanic Physics · Physics 2010-05-14 Stephen Jewson , Dan Rowlands , Myles Allen

In this work, we propose a novel prior learning method for advancing generalization and uncertainty estimation in deep neural networks. The key idea is to exploit scalable and structured posteriors of neural networks as informative priors…

Machine Learning · Computer Science 2026-03-31 Dominik Schnaus , Jongseok Lee , Daniel Cremers , Rudolph Triebel