English
Related papers

Related papers: Variational Inference for Bayesian Bridge Regressi…

200 papers

It is well known that Bridge regression enjoys superior theoretical properties when compared to traditional LASSO. However, the current latent variable representation of its Bayesian counterpart, based on the exponential power prior, is…

Methodology · Statistics 2024-06-27 Xiongwen Ke , Yanan Fan

In this article we consider parametric Bayesian inference for stochastic differential equations (SDE) driven by a pure-jump stable Levy process, which is observed at high frequency. In most cases of practical interest, the likelihood…

Statistics Theory · Mathematics 2017-07-28 Ajay Jasra , Kengo Kamatani , Hiroki Masuda

A framework is presented for fitting inverse problem models via variational Bayes approximations. This methodology guarantees flexibility to statistical model specification for a broad range of applications, good accuracy and reduced model…

Methodology · Statistics 2024-09-05 Luca Maestrini , Robert G. Aykroyd , Matt P. Wand

Variational inference is a powerful approach for approximate posterior inference. However, it is sensitive to initialization and can be subject to poor local optima. In this paper, we develop proximity variational inference (PVI). PVI is a…

Machine Learning · Statistics 2017-05-26 Jaan Altosaar , Rajesh Ranganath , David M. Blei

In this work we explore a new framework for approximate Bayesian inference in large datasets based on stochastic control (i.e. Schr\"odinger bridges). We advocate stochastic control as a finite time and low variance alternative to popular…

We derive and present explicit algorithms to facilitate streamlined computing for variational inference for models containing higher level random effects. Existing literature, such as Lee and Wand (2016), is such that streamlined…

Computation · Statistics 2020-07-07 Tui H. Nolan , Marianne Menictas , Matt P. Wand

Geoscientists use observed data to estimate properties of the Earth's interior. This often requires non-linear inverse problems to be solved and uncertainties to be estimated. Bayesian inference solves inverse problems under a probabilistic…

Geophysics · Physics 2024-01-01 Xuebin Zhao , Andrew Curtis

Modeling nonstationary processes is of paramount importance to many scientific disciplines including environmental science, ecology, and finance, among others. Consequently, flexible methodology that provides accurate estimation across a…

Methodology · Statistics 2014-08-13 Wen-Hsi Yang , Scott H. Holan , Christopher K. Wikle

We consider the joint estimation of change point locations and the sparsity pattern of the variance covariance matrix, which is assumed to evolve in a piecewise constant manner. By applying Group Fused LASSO and LASSO penalties to the…

Methodology · Statistics 2026-05-14 Ying Lin , Benjamin Poignard

How can we perform efficient inference and learning in directed probabilistic models, in the presence of continuous latent variables with intractable posterior distributions, and large datasets? We introduce a stochastic variational…

Machine Learning · Statistics 2022-12-13 Diederik P Kingma , Max Welling

We present a Bayesian procedure for estimation of pairwise intervention effects in a high-dimensional system of categorical variables. We assume that we have observational data generated from an unknown causal Bayesian network for which…

Methodology · Statistics 2025-07-02 Vera Kvisgaard , Johan Pensar

Modern statistical learning algorithms are capable of amazing flexibility, but struggle with interpretability. One possible solution is sparsity: making inference such that many of the parameters are estimated as being identically 0, which…

Methodology · Statistics 2023-05-15 Nathan Wycoff , Ali Arab , Katharine M. Donato , Lisa O. Singh

Computer models play a crucial role in numerous scientific and engineering domains. To ensure the accuracy of simulations, it is essential to properly calibrate the input parameters of these models through statistical inference. While…

Applications · Statistics 2024-03-07 Dongkyu Derek Cho , Won Chang , Jaewoo Park

We propose denoising diffusion variational inference (DDVI), a black-box variational inference algorithm for latent variable models which relies on diffusion models as flexible approximate posteriors. Specifically, our method introduces an…

Machine Learning · Computer Science 2026-03-16 Wasu Top Piriyakulkij , Yingheng Wang , Volodymyr Kuleshov

We consider the problem of static Bayesian inference for partially observed Levy-process models. We develop a methodology which allows one to infer static parameters and some states of the process, without a bias from the…

Computation · Statistics 2022-04-01 Hamza Ruzayqat , Ajay Jasra

Latent Gaussian models (LGMs) are widely used in statistics and machine learning. Bayesian inference in non-conjugate LGMs is difficult due to intractable integrals involving the Gaussian prior and non-conjugate likelihoods. Algorithms…

Machine Learning · Statistics 2013-06-06 Mohammad Emtiyaz Khan , Aleksandr Y. Aravkin , Michael P. Friedlander , Matthias Seeger

Variational Bayes (VB) has become a widely-used tool for Bayesian inference in statistics and machine learning. Nonetheless, the development of the existing VB algorithms is so far generally restricted to the case where the variational…

Machine Learning · Computer Science 2021-08-04 Minh-Ngoc Tran , Dang H. Nguyen , Duy Nguyen

Bayesian predictive inference propagates parameter uncertainty to quantities of interest through the posterior-predictive distribution. In practice, this is typically performed using a two-stage procedure: first approximating the posterior…

Machine Learning · Statistics 2026-05-06 Nan Feng , Xun Huan

Model-based reinforcement learning is attractive for sequential decision-making because it explicitly estimates reward and transition models and then supports planning through simulated rollouts. In offline settings with hidden confounding,…

Machine Learning · Computer Science 2026-04-08 Nishanth Venkatesh , Andreas A. Malikopoulos

Bayesian methods are particularly effective for addressing inverse problems due to their ability to manage uncertainties inherent in the inference process. However, employing these methods with costly forward models poses significant…

Computational Engineering, Finance, and Science · Computer Science 2025-10-30 G. Robalo Rei , C. P. Schmidt , J. Nitzler , M. Dinkel , W. A. Wall