English
Related papers

Related papers: Covering Unknown Correlations in Bayesian Priors b…

200 papers

The behavior of many Bayesian models used in machine learning critically depends on the choice of prior distributions, controlled by some hyperparameters that are typically selected by Bayesian optimization or cross-validation. This…

Machine Learning · Statistics 2023-10-09 Eliezer de Souza da Silva , Tomasz Kuśmierczyk , Marcelo Hartmann , Arto Klami

We consider the Bayesian approach to linear inverse problems when the underlying operator depends on an unknown parameter. Allowing for finite dimensional as well as infinite dimensional parameters, the theory covers several models with…

Statistics Theory · Mathematics 2018-09-05 Mathias Trabs

Nowadays model uncertainty has become one of the most important problems in both academia and industry. In this paper, we mainly consider the scenario in which we have a common model set used for model averaging instead of selecting a…

Machine Learning · Computer Science 2023-01-26 Yimin Huang , Weiran Huang , Liang Li , Zhenguo Li

This paper studies the role played by identification in the Bayesian analysis of statistical and econometric models. First, for unidentified models we demonstrate that there are situations where the introduction of a non-degenerate prior…

Econometrics · Economics 2021-10-20 Jean-Pierre Florens , Anna Simoni

We consider the specification of prior distributions for Bayesian model comparison, focusing on regression-type models. We propose a particular joint specification of the prior distribution across models so that sensitivity of posterior…

Methodology · Statistics 2012-07-25 Petros Dellaportas , Jonathan J. Forster , Ioannis Ntzoufras

Quantifying and reducing uncertainty in Earth system model parameterizations is essential to improving their reliability in decision-making. Forward uncertainty propagation is used to derive parameter sensitivity but requires physically…

Atmospheric and Oceanic Physics · Physics 2026-04-22 Ethan YoungIn Shin , Baris Kale , Michael F. Howland

In this paper, distributed Bayesian detection problems with unknown prior probabilities of hypotheses are considered. The sensors obtain observations which are conditionally dependent across sensors and their probability density functions…

Information Theory · Computer Science 2012-09-20 Xiaojing Shen , Pramod K. Varshney , Yunmin Zhu

We address the problem of providing inference from a Bayesian perspective for parameters selected after viewing the data. We present a Bayesian framework for providing inference for selected parameters, based on the observation that…

Computation · Statistics 2015-03-13 Daniel Yekutieli

In Bayesian inference, an unknown measurement uncertainty is often quantified in terms of a Gamma distributed precision parameter, which is impractical when prior information on the standard deviation of the measurement uncertainty shall be…

Methodology · Statistics 2021-01-19 Manuel M. Eichenlaub

When the historical data are limited, the conditional probabilities associated with the nodes of Bayesian networks are uncertain and can be empirically estimated. Second order estimation methods provide a framework for both estimating the…

Machine Learning · Statistics 2022-08-09 Conrad D. Hougen , Lance M. Kaplan , Federico Cerutti , Alfred O. Hero

Uncertainty quantification in reinforcement learning can greatly improve exploration and robustness. Approximate Bayesian approaches have recently been popularized to quantify uncertainty in model-free algorithms. However, so far the focus…

Machine Learning · Computer Science 2025-09-01 Pascal R. van der Vaart , Neil Yorke-Smith , Matthijs T. J. Spaan

We explore probability modelling of discretization uncertainty for system states defined implicitly by ordinary or partial differential equations. Accounting for this uncertainty can avoid posterior under-coverage when likelihoods are…

Methodology · Statistics 2016-10-25 Oksana A. Chkrebtii , David A. Campbell , Ben Calderhead , Mark A. Girolami

When dealing with Bayesian inference the choice of the prior often remains a debatable question. Empirical Bayes methods offer a data-driven solution to this problem by estimating the prior itself from an ensemble of data. In the…

Methodology · Statistics 2020-05-13 Ilja Klebanov , Alexander Sikorski , Christof Schütte , Susanna Röblitz

We propose a new method for conducting Bayesian prediction that delivers accurate predictions without correctly specifying the unknown true data generating process. A prior is defined over a class of plausible predictive models. After…

Methodology · Statistics 2020-08-24 Ruben Loaiza-Maya , Gael M. Martin , David T. Frazier

Calibration or parameter identification is used with computational mechanics models related to observed data of the modeled process to find model parameters such that good similarity between model prediction and observation is achieved. We…

Computational Engineering, Finance, and Science · Computer Science 2022-12-26 Harald Willmann , Jonas Nitzler , Sebastian Brandstaeter , Wolfgang A. Wall

Geoscientists often solve inverse problems to estimate values of parameters of interest given relevant data sets. Bayesian inference solves these problems by combining probability distributions that describe uncertainties in both…

Geophysics · Physics 2026-04-30 Xuebin Zhao , Andrew Curtis , Klaus Mosegaard

Possible parameter values in a random sampling model are shown by definition to have uniform base-rate prior probabilities. This allows a frequentist posterior probability distribution to be calculated for such possible parameter values…

Other Statistics · Statistics 2020-02-14 Huw Llewelyn

The posterior probability distribution for a set of model parameters encodes all that the data have to tell us in the context of a given model; it is the fundamental quantity for Bayesian parameter estimation. In order to infer the…

Instrumentation and Methods for Astrophysics · Physics 2015-06-16 Rupert Allison , Joanna Dunkley

Using instruments comprising ordered responses to items are ubiquitous for studying many constructs of interest. However, using such an item response format may lead to items with response categories infrequently endorsed or unendorsed…

Methodology · Statistics 2024-05-02 R. Noah Padgett , Grant B. Morgan , Tim Lomas

Priors in which a large number of parameters are specified to be independent are dangerous; they make it hard to learn from data. I present a couple of examples from the literature and work through a bit of large sample theory to show what…

Statistics Theory · Mathematics 2019-07-09 Richard A Lockhart