English
Related papers

Related papers: Transformation Models for Flexible Posteriors in V…

200 papers

The steady-state Bayesian vector autoregression (BVAR) makes it possible to incorporate prior information about the long-run mean of the process. This has been shown in many studies to substantially improve forecasting performance, and the…

Computation · Statistics 2025-06-12 Oskar Gustafsson , Mattias Villani

Variational autoencoder (VAE) is a very successful generative model whose key element is the so called amortized inference network, which can perform test time inference using a single feed forward pass. Unfortunately, this comes at the…

Machine Learning · Computer Science 2021-02-08 Minyoung Kim , Vladimir Pavlovic

Bayesian clustering accounts for uncertainty but is computationally demanding at scale. Furthermore, real-world datasets often contain missing values, and simple imputation ignores the associated uncertainty, resulting in suboptimal…

Machine Learning · Computer Science 2026-03-18 Prajit Bhaskaran , Tom Viering

Variational Inference is a powerful tool in the Bayesian modeling toolkit, however, its effectiveness is determined by the expressivity of the utilized variational distributions in terms of their ability to match the true posterior…

Machine Learning · Statistics 2019-05-10 Artem Sobolev , Dmitry Vetrov

Variational inference techniques based on inducing variables provide an elegant framework for scalable posterior estimation in Gaussian process (GP) models. Besides enabling scalability, one of their main advantages over sparse…

Machine Learning · Statistics 2021-02-24 Simone Rossi , Markus Heinonen , Edwin V. Bonilla , Zheyang Shen , Maurizio Filippone

Solving Bayesian inference problems approximately with variational approaches can provide fast and accurate results. Capturing correlation within the approximation requires an explicit parametrization. This intrinsically limits this…

Machine Learning · Statistics 2020-01-31 Jakob Knollmüller , Torsten A. Enßlin

Bayesian Last Layer (BLL) models focus solely on uncertainty in the output layer of neural networks, demonstrating comparable performance to more complex Bayesian models. However, the use of Gaussian priors for last layer weights in…

Machine Learning · Computer Science 2024-08-08 Jian Xu , Zhiqi Lin , Shigui Li , Min Chen , Junmei Yang , Delu Zeng , John Paisley

Transformation-based methods have been an attractive approach in non-parametric inference for problems such as unconditional and conditional density estimation due to their unique hierarchical structure that models the data as flexible…

Statistics Theory · Mathematics 2020-11-06 Sean Plummer , Shuang Zhou , Anirban Bhattacharya , David Dunson , Debdeep Pati

Bayesian parameter inference depends on a choice of prior probability distribution for the parameters in question. The prior which makes the posterior distribution maximally sensitive to data is called the Jeffreys prior, and it is…

Cosmology and Nongalactic Astrophysics · Physics 2019-02-25 Steen Hannestad , Thomas Tram

This paper is concerned with the approximation of probability distributions known up to normalization constants, with a focus on Bayesian inference for large-scale inverse problems in scientific computing. In this context, key challenges…

Machine Learning · Computer Science 2025-06-10 Baojun Che , Yifan Chen , Zhenghao Huan , Daniel Zhengyu Huang , Weijie Wang

We present a generative modeling approach based on the variational inference framework for likelihood-free simulation-based inference. The method leverages latent variables within variational autoencoders to efficiently estimate complex…

Machine Learning · Computer Science 2025-10-20 Mayank Nautiyal , Andrey Shternshis , Andreas Hellander , Prashant Singh

Variational inference offers scalable and flexible tools to tackle intractable Bayesian inference of modern statistical models like Bayesian neural networks and Gaussian processes. For largely over-parameterized models, however, the…

Machine Learning · Statistics 2019-12-03 Simone Rossi , Sebastien Marmin , Maurizio Filippone

Most applications of Bayesian Inference for parameter estimation and model selection in astrophysics involve the use of Monte Carlo techniques such as Markov Chain Monte Carlo (MCMC) and nested sampling. However, these techniques are time…

Instrumentation and Methods for Astrophysics · Physics 2022-01-26 Geetakrishnasai Gunapati , Anirudh Jain , P. K. Srijith , Shantanu Desai

This article tackles the old problem of prediction via a nonparametric transformation model (NTM) in a new Bayesian way. Estimation of NTMs is known challenging due to model unidentifiability though appealing because of its robust…

Methodology · Statistics 2023-02-08 Chong Zhong , Jin Yang , Junshan Shen , Catherine Liu , Zhaohai Li

State-space models have been successfully used for more than fifty years in different areas of science and engineering. We present a procedure for efficient variational Bayesian learning of nonlinear state-space models based on sparse…

Machine Learning · Computer Science 2014-11-04 Roger Frigola , Yutian Chen , Carl E. Rasmussen

Deriving Bayesian inference for exponential random graph models (ERGMs) is a challenging "doubly intractable" problem as the normalizing constants of the likelihood and posterior density are both intractable. Markov chain Monte Carlo (MCMC)…

Computation · Statistics 2019-11-26 Linda S. L. Tan , Nial Friel

Generalized linear models (GLMs) are routinely used for modeling relationships between a response variable and a set of covariates. The simple form of a GLM comes with easy interpretability, but also leads to concerns about model…

Methodology · Statistics 2023-11-10 Davide Agnoletto , Tommaso Rigon , David B. Dunson

Variational inference (VI) is a popular approach in Bayesian inference, that looks for the best approximation of the posterior distribution within a parametric family, minimizing a loss that is typically the (reverse) Kullback-Leibler (KL)…

Machine Learning · Statistics 2024-06-11 Tom Huix , Anna Korba , Alain Durmus , Eric Moulines

Invariant prediction [Peters et al., 2016] analyzes feature/outcome data from multiple environments to identify invariant features - those with a stable predictive relationship to the outcome. Such features support generalization to new…

Machine Learning · Statistics 2025-07-10 Luhuan Wu , Mingzhang Yin , Yixin Wang , John P. Cunningham , David M. Blei

Bayesian methods have shown success in deep learning applications. For example, in predictive tasks, Bayesian neural networks leverage Bayesian reasoning of model uncertainty to improve the reliability and uncertainty awareness of deep…

Machine Learning · Computer Science 2025-10-21 Wenlong Chen , Bolian Li , Ruqi Zhang , Yingzhen Li