English
Related papers

Related papers: Moment-Based Variational Inference for Stochastic …

200 papers

A determinantal point process is a stochastic point process that is commonly used to capture negative correlations. It has become increasingly popular in machine learning in recent years. Sampling a determinantal point process however…

Numerical Analysis · Mathematics 2020-09-02 Lexing Ying

We consider a nonparametric Bayesian approach to estimate the diffusion coefficient of a stochastic differential equation given discrete time observations over a fixed time interval. As a prior on the diffusion coefficient, we employ a…

Statistics Theory · Mathematics 2020-07-22 Shota Gugushvili , Frank van der Meulen , Moritz Schauer , Peter Spreij

In a variety of scientific applications we wish to characterize a physical system using measurements or observations. This often requires us to solve an inverse problem, which usually has non-unique solutions so uncertainty must be…

Geophysics · Physics 2022-05-19 Xin Zhang , Muhammad Atif Nawaz , Xuebin Zhao , Andrew Curtis

Recently, a series of papers proposed deep learning-based approaches to sample from target distributions using controlled diffusion processes, being trained only on the unnormalized target densities without access to samples. Building on…

Machine Learning · Computer Science 2024-05-24 Lorenz Richter , Julius Berner

Building on recent advances in scientific machine learning and generative modeling for computational fluid dynamics, we propose a conditional score-based diffusion model designed for multi-scenarios fluid flow prediction. Our model…

Machine Learning · Computer Science 2025-06-02 Wilfried Genuist , Éric Savin , Filippo Gatti , Didier Clouteau

Recently, a novel linear model predictive control algorithm based on a physics-informed Gaussian Process has been introduced, whose realizations strictly follow a system of underlying linear ordinary differential equations with constant…

Optimization and Control · Mathematics 2025-05-01 Adrian Lepp , Jörn Tebbe , Andreas Besginow

Diffusion models have recently emerged as powerful stochastic frameworks for high-dimensional inference and generation. However, existing applications to partial differential equations (PDEs) predominantly rely on physics-informed training…

Numerical Analysis · Mathematics 2026-04-03 Yi Bing , Liu Jia , Fu Jinyang , Peng Xiang

We propose a black-box variational inference method to approximate intractable distributions with an increasingly rich approximating class. Our method, termed variational boosting, iteratively refines an existing variational approximation…

Machine Learning · Statistics 2017-02-21 Andrew C. Miller , Nicholas Foti , Ryan P. Adams

We cast episodic Markov decision process (MDP) planning as Bayesian inference over policies. A policy is treated as the latent variable and is assigned an unnormalized probability of optimality that is monotone in its expected return,…

Machine Learning · Computer Science 2026-04-14 David Tolpin

We investigate a numerical behaviour of robust deterministic optimal control problem subject to a convection diffusion equation containing uncertain inputs. Stochastic Galerkin approach, turning the original optimization problem containing…

Numerical Analysis · Mathematics 2023-03-01 Pelin Çiloğlu , Hamdullah Yücel

We consider a classical stochastic control problem in which a diffusion process is controlled by a withdrawal process up to a termination time. The objective is to maximize the expected discounted value of the withdrawals until the…

Probability · Mathematics 2024-06-19 Hélène Guérin , Dante Mata , Jean-François Renaud , Alexandre Roch

Recent advances in stochastic gradient variational inference have made it possible to perform variational Bayesian inference with posterior approximations containing auxiliary random variables. This enables us to explore a new synthesis of…

Computation · Statistics 2015-05-20 Tim Salimans , Diederik P. Kingma , Max Welling

Deep Gaussian processes (DGPs) provide a robust paradigm for Bayesian deep learning. In DGPs, a set of sparse integration locations called inducing points are selected to approximate the posterior distribution of the model. This is done to…

Machine Learning · Computer Science 2024-07-25 Jian Xu , Delu Zeng , John Paisley

This paper develops a unified methodology for probabilistic analysis and optimal control design for jump diffusion processes defined by polynomials. For such systems, the evolution of the moments of the state can be described via a system…

Optimization and Control · Mathematics 2017-02-03 Andrew Lamperski , Khem Raj Ghusinga , Abhyudai Singh

We present a new algorithm for approximate inference in probabilistic programs, based on a stochastic gradient for variational programs. This method is efficient without restrictions on the probabilistic program; it is particularly…

Machine Learning · Statistics 2013-01-08 David Wingate , Theophane Weber

In this research note we provide a variational basis for the optimal artificial diffusion method, which has been a cornerstone in developing many stabilized methods. The optimal artificial diffusion method produces exact nodal solutions…

Computational Engineering, Finance, and Science · Computer Science 2015-03-13 K. B. Nakshatrala , A. J. Valocchi

We present a novel formulation for motion planning under uncertainties based on variational inference where the optimal motion plan is modeled as a posterior distribution. We propose a Gaussian variational inference-based framework, termed…

Robotics · Computer Science 2025-06-25 Hongzhe Yu , Yongxin Chen

Approximate inference in high-dimensional, discrete probabilistic models is a central problem in computational statistics and machine learning. This paper describes discrete particle variational inference (DPVI), a new approach that…

Machine Learning · Statistics 2015-12-08 Ardavan Saeedi , Tejas D Kulkarni , Vikash Mansinghka , Samuel Gershman

For a general class of diffusion processes with multiplicative noise, describing a variety of physical as well as financial phenomena, mostly typical of complex systems, we obtain the analytical solution for the moments at all times. We…

Statistical Mechanics · Physics 2010-03-18 Giacomo Bormetti , Danilo Delpini

Structured variational inference constitutes a core methodology in modern statistical applications. Unlike mean-field variational inference, the approximate posterior is assumed to have interdependent structure. We consider the natural…

Machine Learning · Statistics 2025-11-14 Shunan Sheng , Bohan Wu , Bennett Zhu , Sinho Chewi , Aram-Alexandre Pooladian