English
Related papers

Related papers: Accelerating Stochastic Probabilistic Inference

200 papers

Stochastic variational inference (SVI) lets us scale up Bayesian computation to massive data. It uses stochastic optimization to fit a variational distribution, following easy-to-compute noisy natural gradients. As with most traditional…

Machine Learning · Statistics 2014-11-19 Stephan Mandt , David Blei

Variational inference algorithms have proven successful for Bayesian analysis in large data settings, with recent advances using stochastic variational inference (SVI). However, such methods have largely been studied in independent or…

Machine Learning · Statistics 2014-11-07 Nicholas J. Foti , Jason Xu , Dillon Laird , Emily B. Fox

We propose a second-order (Hessian or Hessian-free) based optimization method for variational inference inspired by Gaussian backpropagation, and argue that quasi-Newton optimization can be developed as well. This is accomplished by…

Machine Learning · Statistics 2017-03-30 Kai Fan , Ziteng Wang , Jeff Beck , James Kwok , Katherine Heller

We exploit the observation that stochastic variational inference (SVI) is a form of annealing and present a modified SVI approach -- applicable to both large and small datasets -- that allows the amount of annealing done by SVI to be tuned.…

Machine Learning · Computer Science 2025-11-17 John Paisley , Ghazal Fazelnia , Brian Barr

We consider the problem of fitting variational posterior approximations using stochastic optimization methods. The performance of these approximations depends on (1) how well the variational family matches the true posterior…

Stochastic variational inference (SVI) employs stochastic optimization to scale up Bayesian computation to massive data. Since SVI is at its core a stochastic gradient-based algorithm, horizontal parallelism can be harnessed to allow larger…

Machine Learning · Statistics 2018-01-16 Saad Mohamad , Abdelhamid Bouchachia , Moamar Sayed-Mouchaweh

Stein variational inference (SVI) is a sample-based approximate Bayesian inference technique that generates a sample set by jointly optimizing the samples' locations to minimize an information-theoretic measure of discrepancy with the…

Machine Learning · Computer Science 2024-10-22 Liam Pavlovic , David M. Rosen

Stochastic planning can be reduced to probabilistic inference in large discrete graphical models, but hardness of inference requires approximation schemes to be used. In this paper we argue that such applications can be disentangled along…

Artificial Intelligence · Computer Science 2022-09-05 Zhennan Wu , Roni Khardon

In this paper, we study stochastic non-convex optimization with non-convex random functions. Recent studies on non-convex optimization revolve around establishing second-order convergence, i.e., converging to a nearly second-order optimal…

Optimization and Control · Mathematics 2017-11-02 Mingrui Liu , Tianbao Yang

Variational inference is a powerful approach for approximate posterior inference. However, it is sensitive to initialization and can be subject to poor local optima. In this paper, we develop proximity variational inference (PVI). PVI is a…

Machine Learning · Statistics 2017-05-26 Jaan Altosaar , Rajesh Ranganath , David M. Blei

We introduce deterministic perturbation schemes for the recently proposed random directions stochastic approximation (RDSA) [17], and propose new first-order and second-order algorithms. In the latter case, these are the first second-order…

Optimization and Control · Mathematics 2019-03-29 Prashanth L A , Shalabh Bhatnagar , Nirav Bhavsar , Michael Fu , Steven I. Marcus

Owing to the recent advances in "Big Data" modeling and prediction tasks, variational Bayesian estimation has gained popularity due to their ability to provide exact solutions to approximate posteriors. One key technique for approximate…

Machine Learning · Computer Science 2018-03-01 Hamza Anwar , Quanyan Zhu

We introduce Support Decomposition Variational Inference (SDVI), a new variational inference (VI) approach for probabilistic programs with stochastic support. Existing approaches to this problem rely on designing a single global variational…

Machine Learning · Computer Science 2023-11-02 Tim Reichelt , Luke Ong , Tom Rainforth

We show that, for finite-sum minimization problems, incorporating partial second-order information of the objective function can dramatically improve the robustness to mini-batch size of variance-reduced stochastic gradient methods, making…

Optimization and Control · Mathematics 2024-04-24 Sachin Garg , Albert S. Berahas , Michał Dereziński

Posterior inference in directed graphical models is commonly done using a probabilistic encoder (a.k.a inference model) conditioned on the input. Often this inference model is trained jointly with the probabilistic decoder (a.k.a generator…

Machine Learning · Computer Science 2019-12-21 Amir Zadeh , Smon Hessner , Yao-Chong Lim , Louis-Phlippe Morency

Approximating complex probability densities is a core problem in modern statistics. In this paper, we introduce the concept of Variational Inference (VI), a popular method in machine learning that uses optimization techniques to estimate…

Machine Learning · Computer Science 2021-11-23 Ankush Ganguly , Samuel W. F. Earp

Many modern unsupervised or semi-supervised machine learning algorithms rely on Bayesian probabilistic models. These models are usually intractable and thus require approximate inference. Variational inference (VI) lets us approximate a…

Machine Learning · Computer Science 2018-10-24 Cheng Zhang , Judith Butepage , Hedvig Kjellstrom , Stephan Mandt

First-order stochastic methods are the state-of-the-art in large-scale machine learning optimization owing to efficient per-iteration complexity. Second-order methods, while able to provide faster convergence, have been much less explored…

Machine Learning · Statistics 2017-12-01 Naman Agarwal , Brian Bullins , Elad Hazan

One of the core problems of modern statistics is to approximate difficult-to-compute probability densities. This problem is especially important in Bayesian statistics, which frames all inference about unknown quantities as a calculation…

Computation · Statistics 2018-05-11 David M. Blei , Alp Kucukelbir , Jon D. McAuliffe

The core principle of Variational Inference (VI) is to convert the statistical inference problem of computing complex posterior probability densities into a tractable optimization problem. This property enables VI to be faster than several…

Machine Learning · Computer Science 2023-10-25 Ankush Ganguly , Sanjana Jain , Ukrit Watchareeruetai
‹ Prev 1 2 3 10 Next ›