English
Related papers

Related papers: Variational Bayes and non-Bayesian Updating

200 papers

Parameter estimation for model-based clustering using a finite mixture of normal inverse Gaussian (NIG) distributions is achieved through variational Bayes approximations. Univariate NIG mixtures and multivariate NIG mixtures are…

Methodology · Statistics 2017-10-09 Sanjeena Subedi , Paul D. McNicholas

Bayesian approach, as a useful tool for quantifying uncertainties, has been widely used for solving inverse problems of partial differential equations (PDEs). One of the key difficulties for employing Bayesian approach for the issue is how…

Numerical Analysis · Mathematics 2026-02-09 Junxiong Jia , Qian Zhao , Zongben Xu , Deyu Meng , Yee Leung

This paper is a note on the use of Bayesian nonparametric mixture models for continuous time series. We identify a key requirement for such models, and then establish that there is a single type of model which meets this requirement. As it…

Methodology · Statistics 2013-03-05 George Karabatsos , Stephen G. Walker

Variable selection and classification are common objectives in the analysis of high-dimensional data. Most such methods make distributional assumptions that may not be compatible with the diverse families of distributions data can take. A…

Methodology · Statistics 2019-08-28 Weichang Yu , Lamiae Azizi , John T. Ormerod

Weighted Updating generalizes Bayesian updating, allowing for biased beliefs by weighting the likelihood function and prior distribution with positive real exponents. I provide a rigorous foundation for the model by showing that…

Probability · Mathematics 2016-02-09 Jesse Aaron Zinn

Bayesian Non-negative Matrix Factorization (NMF) is a promising approach for understanding uncertainty and structure in matrix data. However, a large volume of applied work optimizes traditional non-Bayesian NMF objectives that fail to…

Machine Learning · Statistics 2018-03-19 M. Arjumand Masood , Finale Doshi-Velez

In this paper, we explore adaptive inference based on variational Bayes. Although several studies have been conducted to analyze the contraction properties of variational posteriors, there is still a lack of a general and computationally…

Statistics Theory · Mathematics 2024-03-12 Ilsang Ohn , Lizhen Lin

We construct examples of variational bivectors that are not Poissonian.

Differential Geometry · Mathematics 2025-05-08 I. S. Krasil'shchik

We study the convergence rates of empirical Bayes posterior distributions for nonparametric and high-dimensional inference. We show that as long as the hyperparameter set is discrete, the empirical Bayes posterior distribution induced by…

Statistics Theory · Mathematics 2020-09-10 Fengshuo Zhang , Chao Gao

We propose a model for functional data registration that compares favorably to the best methods of functional data registration currently available. It also extends current inferential capabilities for unregistered data by providing a…

Methodology · Statistics 2016-06-06 Cecilia Earls , Giles Hooker

Machine learning methods for computational imaging require uncertainty estimation to be reliable in real settings. While Bayesian models offer a computationally tractable way of recovering uncertainty, they need large data volumes to be…

Machine Learning · Computer Science 2020-08-24 Francesco Tonolini , Jack Radford , Alex Turpin , Daniele Faccio , Roderick Murray-Smith

The main challenge in Bayesian models is to determine the posterior for the model parameters. Already, in models with only one or few parameters, the analytical posterior can only be determined in special settings. In Bayesian neural…

Machine Learning · Statistics 2021-06-02 Sefan Hörtling , Daniel Dold , Oliver Dürr , Beate Sick

We propose VarFA, a variational inference factor analysis framework that extends existing factor analysis models for educational data mining to efficiently output uncertainty estimation in the model's estimated factors. Such uncertainty…

Machine Learning · Statistics 2020-08-18 Zichao Wang , Yi Gu , Andrew Lan , Richard Baraniuk

Bayesian learning is built on an assumption that the model space contains a true reflection of the data generating mechanism. This assumption is problematic, particularly in complex data environments. Here we present a Bayesian…

Machine Learning · Statistics 2018-11-05 S. P. Lyddon , S. G. Walker , C. C. Holmes

Nonlinear Bayesian update for a prior ensemble is proposed to extend traditional ensemble Kalman filtering to settings characterized by non-Gaussian priors and nonlinear measurement operators. In this framework, the observed component is…

Machine Learning · Statistics 2025-03-20 Yoonsang Lee

Given overlapping subsets of a set of taxa (e.g. species), and posterior distributions on phylogenetic tree topologies for each of these taxon sets, how can we infer a posterior distribution on phylogenetic tree topologies for the entire…

Populations and Evolution · Quantitative Biology 2021-04-23 Michael Karcher , Cheng Zhang , Frederick A Matsen

Variational methods are widely used for approximate posterior inference. However, their use is typically limited to families of distributions that enjoy particular conjugacy properties. To circumvent this limitation, we propose a family of…

Machine Learning · Computer Science 2012-06-22 Samuel Gershman , Matt Hoffman , David Blei

Variational Bayes methods approximate the posterior density by a family of tractable distributions whose parameters are estimated by optimisation. Variational approximation is useful when exact inference is intractable or very costly. Our…

Computation · Statistics 2023-08-15 David Gunawan , Robert Kohn , David Nott

I propose a normative updating rule, extended Bayesianism, for the incorporation of probabilistic information arising from the process of becoming more aware. Extended Bayesianism generalizes standard Bayesian updating to allow the…

Theoretical Economics · Economics 2021-10-06 Evan Piermont

A software library for constructing and learning probabilistic models is presented. The library offers a set of building blocks from which a large variety of static and dynamic models can be built. These include hierarchical models for…

Mathematical Software · Computer Science 2012-07-09 Markus Harva , Tapani Raiko , Antti Honkela , Harri Valpola , Juha Karhunen