English
Related papers

Related papers: Variance Control for Black Box Variational Inferen…

200 papers

Automatic differentiation variational inference (ADVI) offers fast and easy-to-use posterior approximation in multiple modern probabilistic programming languages. However, its stochastic optimizer lacks clear convergence criteria and…

Machine Learning · Computer Science 2024-04-18 Ryan Giordano , Martin Ingram , Tamara Broderick

Many machine learning problems involve Monte Carlo gradient estimators. As a prominent example, we focus on Monte Carlo variational inference (MCVI) in this paper. The performance of MCVI crucially depends on the variance of its stochastic…

Machine Learning · Statistics 2018-07-05 Alexander Buchholz , Florian Wenzel , Stephan Mandt

We study control variate methods for Markov chain Monte Carlo (MCMC) in the setting of deterministic sweep sampling using $K\geq 2$ transition kernels. New variance reduction results are provided for MCMC averages based on sweeps over…

Statistics Theory · Mathematics 2019-12-17 Stephen Berg , Jun Zhu , Murray K. Clayton

This paper addresses the design and analysis of a multivariable gradient-based stochastic extremum-seeking control method for multi-input systems with arbitrary input delays. The approach accommodates systems with distinct time delays…

Optimization and Control · Mathematics 2024-11-19 Paulo Cesar Souza Silva , Paulo Cesar Pellanda , Tiago Roux Oliveira

Gradient-based optimization is the foundation of deep learning and reinforcement learning. Even when the mechanism being optimized is unknown or not differentiable, optimization using high-variance or biased gradient estimates is still…

Machine Learning · Computer Science 2018-02-27 Will Grathwohl , Dami Choi , Yuhuai Wu , Geoffrey Roeder , David Duvenaud

Black-box optimization is often encountered for decision-making in complex systems management, where the knowledge of system is limited. Under these circumstances, it is essential to balance the utilization of new information with…

Computation · Statistics 2025-01-15 Teng Lian , Jian-Qiang Hu , Yuhang Wu , Zeyu Zheng

We study the variational inference problem of minimizing a regularized R\'enyi divergence over an exponential family. We propose to solve this problem with a Bregman proximal gradient algorithm. We propose a sampling-based algorithm to…

Statistics Theory · Mathematics 2024-10-17 Thomas Guilmeau , Emilie Chouzenoux , Víctor Elvira

Standard approaches to stochastic gradient estimation, with only noisy black-box function evaluations, use the finite-difference method or its variants. While natural, it is open to our knowledge whether their statistical accuracy is the…

Statistics Theory · Mathematics 2020-11-13 Henry Lam , Haidong Li , Xuhui Zhang

Modern data analysis and statistical learning are marked by complex data structures and black-box algorithms. Data complexity stems from technologies such as imaging, remote sensing, wearable devices, and genomic sequencing. At the same…

Statistics Theory · Mathematics 2025-10-30 Jing Lei

Black-box optimization is primarily important for many compute-intensive applications, including reinforcement learning (RL), robot control, etc. This paper presents a novel theoretical framework for black-box optimization, in which our…

Machine Learning · Computer Science 2020-09-10 Yueming Lyu , Ivor W. Tsang

Optimization in the Bures-Wasserstein space has been gaining popularity in the machine learning community since it draws connections between variational inference and Wasserstein gradient flows. The variational inference objective function…

Machine Learning · Computer Science 2025-03-03 Hoang Phuc Hau Luu , Hanlin Yu , Bernardo Williams , Marcelo Hartmann , Arto Klami

We propose the use of U-statistics to reduce variance for gradient estimation in importance-weighted variational inference. The key observation is that, given a base gradient estimator that requires $m > 1$ samples and a total of $n > m$…

Machine Learning · Computer Science 2023-02-28 Javier Burroni , Kenta Takatsu , Justin Domke , Daniel Sheldon

A broad class of hybrid quantum-classical algorithms known as "variational algorithms" have been proposed in the context of quantum simulation, machine learning, and combinatorial optimization as a means of potentially achieving a quantum…

Quantum Physics · Physics 2021-04-09 Aram Harrow , John Napp

Stochastic variational inference and its derivatives in the form of variational autoencoders enjoy the ability to perform Bayesian inference on large datasets in an efficient manner. However, performing inference with a VAE requires a…

Neural and Evolutionary Computing · Computer Science 2023-08-17 Ahmad Ayaz Amin

Variational inference is a popular method for estimating model parameters and conditional distributions in hierarchical and mixed models, which arise frequently in many settings in the health, social, and biological sciences. Variational…

Methodology · Statistics 2019-01-10 Ted Westling , Tyler H. McCormick

The black-box adversarial attack has attracted impressive attention for its practical use in the field of deep learning security. Meanwhile, it is very challenging as there is no access to the network architecture or internal weights of the…

Machine Learning · Computer Science 2022-04-26 Yifeng Xiong , Jiadong Lin , Min Zhang , John E. Hopcroft , Kun He

Variational inference (VI) is widely used as an efficient alternative to Markov chain Monte Carlo. It posits a family of approximating distributions $q$ and finds the closest member to the exact posterior $p$. Closeness is usually measured…

Machine Learning · Statistics 2017-11-15 Adji B. Dieng , Dustin Tran , Rajesh Ranganath , John Paisley , David M. Blei

The James-Stein estimator has attracted much interest as a shrinkage estimator that yields better estimates than the maximum likelihood estimator. The James-Stein estimator is also very useful as an argument in favor of empirical Bayesian…

Methodology · Statistics 2025-08-05 Yoshiko Hayashi

Inference networks of traditional Variational Autoencoders (VAEs) are typically amortized, resulting in relatively inaccurate posterior approximation compared to instance-wise variational optimization. Recent semi-amortized approaches were…

Machine Learning · Computer Science 2020-11-18 Minyoung Kim , Vladimir Pavlovic

Bayesian calibration of black-box computer models offers an established framework to obtain a posterior distribution over model parameters. Traditional Bayesian calibration involves the emulation of the computer model and an additive model…

Machine Learning · Statistics 2018-10-30 Sébastien Marmin , Maurizio Filippone