English
Related papers

Related papers: Posterior Adaptation With New Priors

200 papers

We introduce a general IFS Bayesian method for getting posterior probabilities from prior probabilities, and also a generalized Bayes' rule, which will contemplate a dynamical, as well as a non-dynamical setting. Given a loss function…

Dynamical Systems · Mathematics 2023-09-08 Artur O. Lopes , Jairo. K. Mengue

We propose a framework for general Bayesian inference. We argue that a valid update of a prior belief distribution to a posterior can be made for parameters which are connected to observations through a loss function rather than the…

Statistics Theory · Mathematics 2016-02-29 Pier Giovanni Bissiri , Chris Holmes , Stephen Walker

Recent work has observed that one can outperform exact inference in Bayesian neural networks by tuning the "temperature" of the posterior on a validation set (the "cold posterior" effect). To help interpret this phenomenon, we argue that…

Machine Learning · Statistics 2020-08-04 Ben Adlam , Jasper Snoek , Samuel L. Smith

A stream of algorithmic advances has steadily increased the popularity of the Bayesian approach as an inference paradigm, both from the theoretical and applied perspective. Even with apparent successes in numerous application fields, a…

Methodology · Statistics 2020-07-10 Owen Thomas , Henri Pesonen , Jukka Corander

We consider situations in Bayesian analysis where we have a family of priors $\nu_h$ on the parameter $\theta$, where $h$ varies continuously over a space $\mathcal{H}$, and we deal with two related problems. The first involves sensitivity…

Statistics Theory · Mathematics 2012-02-24 Eugenia Buta , Hani Doss

I propose a normative updating rule, extended Bayesianism, for the incorporation of probabilistic information arising from the process of becoming more aware. Extended Bayesianism generalizes standard Bayesian updating to allow the…

Theoretical Economics · Economics 2021-10-06 Evan Piermont

While Bayesian methods are praised for their ability to incorporate useful prior knowledge, in practice, convenient priors that allow for computationally cheap or tractable inference are commonly used. In this paper, we investigate the…

Machine Learning · Statistics 2017-07-14 Willie Neiswanger , Eric Xing

In solving Bayesian inverse problems, it is often desirable to use a common density parameterization to denote the prior and posterior. Typically we seek a density from the same family as the prior which closely approximates the true…

Numerical Analysis · Mathematics 2022-03-29 Xiao-Mei Yang , Zhi-Liang Deng

Posterior sampling allows exploitation of prior knowledge on the environment's transition dynamics to improve the sample efficiency of reinforcement learning. The prior is typically specified as a class of parametric distributions, the…

Machine Learning · Computer Science 2024-04-09 Mirco Mutti , Riccardo De Santi , Marcello Restelli , Alexander Marx , Giorgia Ramponi

We propose a general framework for obtaining probabilistic solutions to PDE-based inverse problems. Bayesian methods are attractive for uncertainty quantification but assume knowledge of the likelihood model or data generation process. This…

Methodology · Statistics 2023-09-28 Youngsoo Baek , Wilkins Aquino , Sayan Mukherjee

We present a novel approach for reconciling hierarchical forecasts, based on Bayes rule. We define a prior distribution for the bottom time series of the hierarchy, based on the bottom base forecasts. Then we update their distribution via…

Applications · Statistics 2021-06-07 Giorgio Corani , Dario Azzimonti , João P. S. C. Augusto , Marco Zaffalon

Inverse classification, the process of making meaningful perturbations to a test point such that it is more likely to have a desired classification, has previously been addressed using data from a single static point in time. Such an…

Machine Learning · Computer Science 2016-11-15 Michael T. Lash , W. Nick Street

A novel block prior is proposed for adaptive Bayesian estimation. The prior does not depend on the smoothness of the function or the sample size. It puts sufficient prior mass near the true signal and automatically concentrates on its…

Statistics Theory · Mathematics 2016-01-22 Chao Gao , Harrison H. Zhou

In order to study updating rules, we consider the problem of a malevolent principal screening an imperfectly Bayesian agent. We uncover a fundamental dichotomy between underreaction and overreaction to information. If an agent's posterior…

Theoretical Economics · Economics 2024-05-15 Konstantin von Beringe , Mark Whitmeyer

Bayesian posterior distributions arising in modern applications, including inverse problems in partial differential equation models in tomography and subsurface flow, are often computationally intractable due to the large computational cost…

Machine Learning · Statistics 2023-02-10 Tapio Helin , Andrew Stuart , Aretha Teckentrup , Konstantinos Zygalakis

Humans and animals have a natural ability to quickly adapt to their surroundings, but machine-learning models, when subjected to changes, often require a complete retraining from scratch. We present Knowledge-adaptation priors (K-priors) to…

Machine Learning · Computer Science 2021-10-28 Mohammad Emtiyaz Khan , Siddharth Swaroop

Laplace's "add-one" rule of succession modifies the observed frequencies in a sequence of heads and tails by adding one to the observed counts. This improves prediction by avoiding zero probabilities and corresponds to a uniform Bayesian…

Information Theory · Computer Science 2015-03-17 Yann Ollivier

Exponential random graph models are an important tool in the statistical analysis of data. However, Bayesian parameter estimation for these models is extremely challenging, since evaluation of the posterior distribution typically involves…

Computation · Statistics 2017-05-05 Lampros Bouranis , Nial Friel , Florian Maire

When prior information is lacking, the go-to strategy for probabilistic inference is to combine a "default prior" and the likelihood via Bayes's theorem. Objective Bayes, (generalized) fiducial inference, etc. fall under this umbrella. This…

Methodology · Statistics 2026-01-05 Ryan Martin

Using instruments comprising ordered responses to items are ubiquitous for studying many constructs of interest. However, using such an item response format may lead to items with response categories infrequently endorsed or unendorsed…

Methodology · Statistics 2024-05-02 R. Noah Padgett , Grant B. Morgan , Tim Lomas