English
Related papers

Related papers: Black-box Variational Inference for Stochastic Dif…

200 papers

This study introduces a training-free conditional diffusion model for learning unknown stochastic differential equations (SDEs) using data. The proposed approach addresses key challenges in computational efficiency and accuracy for modeling…

Machine Learning · Computer Science 2024-10-07 Yanfang Liu , Yuan Chen , Dongbin Xiu , Guannan Zhang

We address the problem of simulation and parameter inference for chemical reaction networks described by the chemical Langevin equation, a stochastic differential equation (SDE) representation of the dynamics of the chemical species. This…

Methodology · Statistics 2025-08-18 Petar Jovanovski , Andrew Golightly , Umberto Picchini , Massimiliano Tamborrino

We identify effective stochastic differential equations (SDE) for coarse observables of fine-grained particle- or agent-based simulations; these SDE then provide useful coarse surrogate models of the fine scale dynamics. We approximate the…

We propose a novel framework for adaptively learning the time-evolving solutions of stochastic partial differential equations (SPDEs) using score-based diffusion models within a recursive Bayesian inference setting. SPDEs play a central…

Computation · Statistics 2025-08-12 Toan Huynh , Ruth Lopez Fajardo , Guannan Zhang , Lili Ju , Feng Bao

Stochastic Differential Equations (SDEs) serve as a powerful modeling tool in various scientific domains, including systems science, engineering, and ecological science. While the specific form of SDEs is typically known for a given…

Methodology · Statistics 2024-02-27 Xin Cai , Jingyu Yang , Zhibao Li , Hongqiao Wang , Miao Huang

Stochastic variational inference and its derivatives in the form of variational autoencoders enjoy the ability to perform Bayesian inference on large datasets in an efficient manner. However, performing inference with a VAE requires a…

Neural and Evolutionary Computing · Computer Science 2023-08-17 Ahmad Ayaz Amin

Recent variational inference methods use stochastic gradient estimators whose variance is not well understood. Theoretical guarantees for these estimators are important to understand when these methods will or will not work. This paper…

Machine Learning · Computer Science 2019-10-29 Justin Domke

We develop a novel approach towards causal inference. Rather than structural equations over a causal graph, we learn stochastic differential equations (SDEs) whose stationary densities model a system's behavior under interventions. These…

Machine Learning · Computer Science 2024-03-19 Lars Lorch , Andreas Krause , Bernhard Schölkopf

We introduce an inferential framework for a wide class of semi-linear stochastic differential equations (SDEs). Recent work has shown that numerical splitting schemes can preserve critical properties of such types of SDEs, give rise to…

Computation · Statistics 2025-07-22 Shu Huang , Richard G. Everitt , Massimiliano Tamborrino , Adam M. Johansen

We present a class of diffusion-based algorithms to draw samples from high-dimensional probability distributions given their unnormalized densities. Ideally, our methods can transport samples from a Gaussian distribution to a specified…

Machine Learning · Computer Science 2025-02-04 Anand Jerry George , Nicolas Macris

Learning models with discrete latent variables using stochastic gradient descent remains a challenge due to the high variance of gradient estimates. Modern variance reduction techniques mostly consider categorical distributions and have…

Machine Learning · Computer Science 2019-11-25 Artyom Gadetsky , Kirill Struminsky , Christopher Robinson , Novi Quadrianto , Dmitry Vetrov

Black-box variational inference tries to approximate a complex target distribution though a gradient-based optimization of the parameters of a simpler distribution. Provable convergence guarantees require structural properties of the…

Machine Learning · Computer Science 2020-08-17 Justin Domke

Deep learning algorithms have recently shown to be a successful tool in estimating parameters of statistical models for which simulation is easy, but likelihood computation is challenging. But the success of these approaches depends on…

Machine Learning · Statistics 2024-02-20 Amanda Lenzi , Haavard Rue

We address the problem of Bayesian inference for parameters in ordinary differential equation (ODE) models based on observational data. Conventional approaches in this setting typically rely on numerical solvers such as the Euler or…

Methodology · Statistics 2025-12-01 Shoji Toyota , Yuto Miyatake

Motivated by the traditional Lotka-Volterra competitive models, this paper proposes and analyzes a class of stochastic reaction-diffusion partial differential equations. In contrast to the models in the literature, the new formulation…

Probability · Mathematics 2021-05-10 N. N. Nguyen , G. Yin

We present a novel variational framework for performing inference in (neural) stochastic differential equations (SDEs) driven by Markov-approximate fractional Brownian motion (fBM). SDEs offer a versatile tool for modeling real-world…

Machine Learning · Computer Science 2023-10-20 Rembert Daems , Manfred Opper , Guillaume Crevecoeur , Tolga Birdal

We consider one-step methods for integrating stochastic differential equations and prove pathwise convergence using ideas from rough path theory. In contrast to alternative theories of pathwise convergence, no knowledge is required of…

Numerical Analysis · Mathematics 2015-02-24 Tony Shardlow , Phillip Taylor

We propose a predictor-corrector adaptive method for the study of hyperbolic partial differential equations (PDEs) under uncertainty. Constructed around the framework of stochastic finite volume (SFV) methods, our approach circumvents…

Numerical Analysis · Mathematics 2024-01-24 Jake J. Harmon , Svetlana Tokareva , Anatoly Zlotnik , Pieter J. Swart

We consider the problem of variational Bayesian inference in a latent variable model where a (possibly complex) observed stochastic process is governed by the solution of a latent stochastic differential equation (SDE). Motivated by the…

Machine Learning · Computer Science 2024-02-22 Sebastian Zeng , Florian Graf , Roland Kwitt

Stochastic variational inference makes it possible to approximate posterior distributions induced by large datasets quickly using stochastic optimization. The algorithm relies on the use of fully factorized variational distributions.…

Machine Learning · Computer Science 2014-11-27 Matthew D. Hoffman , David M. Blei