English
Related papers

Related papers: Objective Bayesian inference with proper scoring r…

200 papers

The use of objective prior in Bayesian applications has become a common practice to analyze data without subjective information. Formal rules usually obtain these priors distributions, and the data provide the dominant information in the…

Statistics Theory · Mathematics 2020-05-18 Pedro L. Ramos , Francisco A. Rodrigues , Eduardo Ramos , Dipak K. Dey , Francisco Louzada

Especially when facing reliability data with limited information (e.g., a small number of failures), there are strong motivations for using Bayesian inference methods. These include the option to use information from physics-of-failure or…

Methodology · Statistics 2022-10-27 Qinglong Tian , Colin Lewis-Beck , Jarad Niemi , William Meeker

We propose a framework for general Bayesian inference. We argue that a valid update of a prior belief distribution to a posterior can be made for parameters which are connected to observations through a loss function rather than the…

Statistics Theory · Mathematics 2016-02-29 Pier Giovanni Bissiri , Chris Holmes , Stephen Walker

The ranking problem is to order a collection of units by some unobserved parameter, based on observations from the associated distribution. This problem arises naturally in a number of contexts, such as business, where we may want to rank…

Methodology · Statistics 2016-10-28 Toby Kenney , Hao He , Hong Gu

Bayes' rule has enabled innumerable powerful algorithms of statistical signal processing and statistical machine learning. However, when model misspecifications exist in prior and/or data distributions, the direct application of Bayes' rule…

Signal Processing · Electrical Eng. & Systems 2026-02-13 Shixiong Wang

In this paper we introduce objective proper prior distributions for hypothesis testing and model selection based on measures of divergence between the competing models; we call them divergence based (DB) priors. DB priors have simple forms…

Methodology · Statistics 2009-02-27 M. J. Bayarri , G. García-Donato

We describe algorithms for learning Bayesian networks from a combination of user knowledge and statistical data. The algorithms have two components: a scoring metric and a search procedure. The scoring metric takes a network structure,…

Artificial Intelligence · Computer Science 2021-06-29 Dan Geiger , David Heckerman

In Generalised Bayesian Inference (GBI), the learning rate and hyperparameters of the loss must be estimated. These inference-hyperparameters can't be estimated jointly with the other parameters, from the data, by giving them a prior.…

Methodology · Statistics 2026-05-18 Jeong Eun Lee , Sitong Liu , Geoff K. Nicholls

Study of the bivariate normal distribution raises the full range of issues involving objective Bayesian inference, including the different types of objective priors (e.g., Jeffreys, invariant, reference, matching), the different modes of…

Statistics Theory · Mathematics 2008-12-18 James O. Berger , Dongchu Sun

The classical paradigm of scoring rules is to discriminate between two different forecasts by comparing them with observations. The probability distribution of the observed record is assumed to be perfect as a verification benchmark. In…

Methodology · Statistics 2021-08-06 Julie Bessac , Philippe Naveau

When performing Bayesian inference, we frequently need to work with conditional probability densities. For example, the posterior function is the conditional density of the parameters given the data. Some might worry that conditional…

Methodology · Statistics 2026-03-31 Alex Yan , Cathal Mills , Augustin Marignier , Younjung Kim , Ben Lambert

Statistical system models provide the basis for the examination of various sorts of distributions. Classification distributions are a very common and versatile form of statistics in e.g. real economic, social, and IT systems. The…

Computation · Statistics 2019-12-20 Uwe Petersohn , Thomas Dedek , Sandra Zimmer , Hans Biskupski

We propose a posterior for Bayesian Likelihood-Free Inference (LFI) based on generalized Bayesian inference. To define the posterior, we use Scoring Rules (SRs), which evaluate probabilistic models given an observation. In LFI, we can…

Methodology · Statistics 2024-09-24 Lorenzo Pacchiardi , Sherman Khoo , Ritabrata Dutta

The main object of Bayesian statistical inference is the determination of posterior distributions. Sometimes these laws are given for quantities devoid of empirical value. This serious drawback vanishes when one confines oneself to…

Statistical Finance · Quantitative Finance 2008-12-02 Federico Bassetti

Posterior predictive p-values are a common approach to Bayesian model-checking. This article analyses their frequency behaviour, that is, their distribution when the parameters and the data are drawn from the prior and the model…

Statistics Theory · Mathematics 2015-03-31 Patrick Rubin-Delanchy , Daniel John Lawson

Estimation of parameters that obey specific constraints is crucial in statistics and machine learning; for example, when parameters are required to satisfy boundedness, monotonicity, or linear inequalities. Traditional approaches impose…

Methodology · Statistics 2026-04-03 Lachlan Astfalck , Deborshee Sen , Sayan Patra , Edward Cripps , David Dunson

Loss-based updating, including generalized Bayes, Gibbs, and quasi-posteriors, replaces likelihoods by a user-chosen loss and produces a posterior-like distribution via exponential tilt. We give a decision-theoretic characterization that…

Methodology · Statistics 2026-02-03 Kenichiro McAlinn , Kōsaku Takanashi

We study full Bayesian procedures for high-dimensional linear regression under sparsity constraints. The prior is a mixture of point masses at zero and continuous distributions. Under compatibility conditions on the design matrix, the…

Statistics Theory · Mathematics 2015-10-15 Ismaël Castillo , Johannes Schmidt-Hieber , Aad van der Vaart

Objective Bayesian inference procedures are derived for the parameters of the multivariate random effects model generalized to elliptically contoured distributions. The posterior for the overall mean vector and the between-study covariance…

Methodology · Statistics 2021-04-07 Olha Bodnar , Taras Bodnar

Scoring rules serve to quantify predictive performance. A scoring rule is proper if truth telling is an optimal strategy in expectation. Subject to customary regularity conditions, every scoring rule can be made proper, by applying a…

Statistics Theory · Mathematics 2020-04-30 Jonas Brehmer , Tilmann Gneiting