English
Related papers

Related papers: Variational Cumulant Expansions for Intractable Di…

200 papers

A hybrid quantum-classical method for learning Boltzmann machines (BM) for a generative and discriminative task is presented. Boltzmann machines are undirected graphs with a network of visible and hidden nodes where the former is used as…

Quantum Physics · Physics 2022-07-21 Siddhartha Srivastava , Veera Sundararaghavan

This paper is concerned with a lesser-studied problem in the context of model-based, uncertainty quantification (UQ), that of optimization/design/control under uncertainty. The solution of such problems is hindered not only by the usual…

Computation · Statistics 2016-02-17 Phaedon-Stelios Koutsourelakis

Learning a causal directed acyclic graph from data is a challenging task that involves solving a combinatorial problem for which the solution is not always identifiable. A new line of work reformulates this problem as a continuous…

Machine Learning · Computer Science 2020-11-05 Philippe Brouillard , Sébastien Lachapelle , Alexandre Lacoste , Simon Lacoste-Julien , Alexandre Drouin

In regression tasks, aleatoric uncertainty is commonly addressed by considering a parametric distribution of the output variable, which is based on strong assumptions such as symmetry, unimodality or by supposing a restricted shape. These…

Machine Learning · Computer Science 2019-10-30 Axel Brando , Jose A. Rodríguez-Serrano , Jordi Vitrià , Alberto Rubio

Variational Inference makes a trade-off between the capacity of the variational family and the tractability of finding an approximate posterior distribution. Instead, Boosting Variational Inference allows practitioners to obtain…

Machine Learning · Computer Science 2021-05-20 Gideon Dresdner , Saurav Shekhar , Fabian Pedregosa , Francesco Locatello , Gunnar Rätsch

Stochastic variational Bayes algorithms have become very popular in the machine learning literature, particularly in the context of nonparametric Bayesian inference. These algorithms replace the true but intractable posterior distribution…

Methodology · Statistics 2024-10-04 Pedro Regueiro , Abel Rodríguez , Juan Sosa

We propose a deep generative approach to sampling from a conditional distribution based on a unified formulation of conditional distribution and generalized nonparametric regression function using the noise-outsourcing lemma. The proposed…

Statistics Theory · Mathematics 2021-10-22 Xingyu Zhou , Yuling Jiao , Jin Liu , Jian Huang

Variational approaches to approximate Bayesian inference provide very efficient means of performing parameter estimation and model selection. Among these, so-called variational-Laplace or VL schemes rely on Gaussian approximations to…

Methodology · Statistics 2018-01-17 Jean Daunizeau

In this paper we study algorithms to find a Gaussian approximation to a target measure defined on a Hilbert space of functions; the target measure itself is defined via its density with respect to a reference Gaussian measure. We employ the…

Numerical Analysis · Mathematics 2014-08-11 Frank J. Pinski , Gideon Simpson , Andrew M. Stuart , Hendrik Weber

A new adaptive approach is proposed for variational inequalities with a Lipschitz-continuous field. Estimates of the necessary number of iterations are obtained to achieve a given quality of the variational inequality solution. A…

Optimization and Control · Mathematics 2018-12-27 Fedor Stonyakin , Alexander Gasnikov , Pavel Dvurechensky , Alexander Titov

Optimization in the Bures-Wasserstein space has been gaining popularity in the machine learning community since it draws connections between variational inference and Wasserstein gradient flows. The variational inference objective function…

Machine Learning · Computer Science 2025-03-03 Hoang Phuc Hau Luu , Hanlin Yu , Bernardo Williams , Marcelo Hartmann , Arto Klami

We consider the estimation of average treatment effects in observational studies and propose a new framework of robust causal inference with unobserved confounders. Our approach is based on distributionally robust optimization and proceeds…

Methodology · Statistics 2023-02-06 Dimitris Bertsimas , Kosuke Imai , Michael Lingzhi Li

We present a method to probe rare molecular dynamics trajectories directly using reinforcement learning. We consider trajectories that are conditioned to transition between regions of configuration space in finite time, like those relevant…

Statistical Mechanics · Physics 2022-01-07 Avishek Das , Dominic C. Rose , Juan P. Garrahan , David T. Limmer

We analyze in full mathematical rigor the most general quartically perturbed invariant probability measure for a random tensor. Using a version of the Loop Vertex Expansion (which we call the mixed expansion) we show that the cumulants…

Mathematical Physics · Physics 2015-06-15 Razvan Gurau

We introduce a mini-batch stochastic variance-reduced algorithm to solve finite-sum scale invariant problems which cover several examples in machine learning and statistics such as principal component analysis (PCA) and estimation of…

Optimization and Control · Mathematics 2023-04-25 Cheolmin Kim , Youngseok Kim , Diego Klabjan

Modern deep neural networks are well known to be brittle in the face of unknown data instances and recognition of the latter remains a challenge. Although it is inevitable for continual-learning systems to encounter such unseen concepts,…

Machine Learning · Computer Science 2022-04-04 Martin Mundt , Iuliia Pliushch , Sagnik Majumder , Yongwon Hong , Visvanathan Ramesh

This paper focuses on variational inference with intractable likelihood functions that can be unbiasedly estimated. A flexible variational approximation based on Gaussian mixtures is developed, by adopting the mixture population Monte Carlo…

Numerical Analysis · Mathematics 2021-12-02 Zhijian He , Shifeng Huo , Tianhui Yang

We consider a distributed learning setup where a network of agents sequentially access realizations of a set of random variables with unknown distributions. The network objective is to find a parametrized distribution that best describes…

Optimization and Control · Mathematics 2016-05-10 Angelia Nedić , Alex Olshevsky , César Uribe

We develop unbiased implicit variational inference (UIVI), a method that expands the applicability of variational inference by defining an expressive variational family. UIVI considers an implicit variational distribution obtained in a…

Machine Learning · Statistics 2019-02-07 Michalis K. Titsias , Francisco J. R. Ruiz

We explore the probabilistic foundations of shared control in complex dynamic environments. In order to do this, we formulate shared control as a random process and describe the joint distribution that governs its behavior. For…

Robotics · Computer Science 2015-08-10 Pete Trautman