English
Related papers

Related papers: Black-box Variational Inference for Stochastic Dif…

200 papers

We introduce and test methods for the calibration of the diffusion term in Stochastic Partial Differential Equations (SPDEs) describing fluids. We take two approaches, one uses ideas from the singular value decomposition and the Biot-Savart…

Fluid Dynamics · Physics 2024-05-02 James Woodfield

Deep Gaussian process models typically employ discrete hierarchies, but recent advancements in differential Gaussian processes (DiffGPs) have extended these models to infinite depths. However, existing DiffGP approaches often overlook the…

Machine Learning · Computer Science 2025-12-16 Jian Xu , Zhiqi Lin , Min Chen , Junmei Yang , Delu Zeng , John Paisley

We propose denoising diffusion variational inference (DDVI), a black-box variational inference algorithm for latent variable models which relies on diffusion models as flexible approximate posteriors. Specifically, our method introduces an…

Machine Learning · Computer Science 2026-03-16 Wasu Top Piriyakulkij , Yingheng Wang , Volodymyr Kuleshov

We consider the problem of Bayesian estimation of static parameters associated to a partially and discretely observed diffusion process. We assume that the exact transition dynamics of the diffusion process are unavailable, even up-to an…

Computation · Statistics 2023-09-26 Pierre Del Moral , Shulan Hu , Ajay Jasra , Hamza Ruzayqat , Xinyu Wang

Switching dynamical systems provide a powerful, interpretable modeling framework for inference in time-series data in, e.g., the natural sciences or engineering applications. Since many areas, such as biology or discrete-event systems, are…

Machine Learning · Computer Science 2021-09-30 Lukas Köhs , Bastian Alt , Heinz Koeppl

Score-based modeling through stochastic differential equations (SDEs) has provided a new perspective on diffusion models, and demonstrated superior performance on continuous data. However, the gradient of the log-likelihood function, i.e.,…

Machine Learning · Computer Science 2023-03-07 Haoran Sun , Lijun Yu , Bo Dai , Dale Schuurmans , Hanjun Dai

Mathematically modelling diffusive and advective transport of particles in heterogeneous layered media is important to many applications in computational, biological and medical physics. While deterministic continuum models of such…

Computational Physics · Physics 2024-09-16 Elliot J. Carr

Learning unknown stochastic differential equations (SDEs) from observed data is a significant and challenging task with applications in various fields. Current approaches often use neural networks to represent drift and diffusion functions,…

Machine Learning · Computer Science 2024-06-21 Aiqing Zhu , Qianxiao Li

Parameter inference for stochastic differential equation mixed effects models (SDEMEMs) is a challenging problem. Analytical solutions for these models are rarely available, which means that the likelihood is also intractable. In this case,…

Computation · Statistics 2019-09-30 Imke Botha , Robert Kohn , Christopher Drovandi

We develop a Bayesian inference method for diffusions observed discretely and with noise, which is free of discretisation bias. Unlike existing unbiased inference methods, our method does not rely on exact simulation techniques. Instead,…

Methodology · Statistics 2021-03-10 Neil K. Chada , Jordan Franks , Ajay Jasra , Kody J. H. Law , Matti Vihola

This paper investigates the approximation of stochastic delay differential equations (SDDEs) via the backward Euler-Maruyama (BEM) method under generalized monotonicity and Khasminskii-type conditions in the infinite horizon. First, by…

Numerical Analysis · Mathematics 2025-05-20 Yudong Wang , Hongjiong Tian

For many decades now, Bayesian Model Averaging (BMA) has been a popular framework to systematically account for model uncertainty that arises in situations when multiple competing models are available to describe the same or similar…

Computation · Statistics 2022-03-29 Vojtech Kejzlar , Shrijita Bhattacharya , Mookyong Son , Tapabrata Maiti

Black box variational inference allows researchers to easily prototype and evaluate an array of models. Recent advances allow such algorithms to scale to high dimensions. However, a central question remains: How to specify an expressive…

Machine Learning · Statistics 2016-06-01 Rajesh Ranganath , Dustin Tran , David M. Blei

Latent force models are systems whereby there is a mechanistic model describing the dynamics of the system state, with some unknown forcing term that is approximated with a Gaussian process. If such dynamics are non-linear, it can be…

Machine Learning · Statistics 2019-11-05 Wil O. C. Ward , Tom Ryder , Dennis Prangle , Mauricio A. Álvarez

We introduce a novel paradigm for learning non-parametric drift and diffusion functions for stochastic differential equation (SDE). The proposed model learns to simulate path distributions that match observations with non-uniform time…

Machine Learning · Statistics 2018-08-01 Cagatay Yildiz , Markus Heinonen , Jukka Intosalmi , Henrik Mannerström , Harri Lähdesmäki

We propose a black-box variational inference method to approximate intractable distributions with an increasingly rich approximating class. Our method, termed variational boosting, iteratively refines an existing variational approximation…

Machine Learning · Statistics 2017-02-21 Andrew C. Miller , Nicholas Foti , Ryan P. Adams

We study the problem of parameter estimation for a univariate discretely observed ergodic diffusion process given as a solution to a stochastic differential equation. The estimation procedure we propose consists of two steps. In the first…

Statistics Theory · Mathematics 2018-04-17 Shota Gugushvili , Peter Spreij

We consider the inference problem for parameters in stochastic differential equation models from discrete time observations (e.g. experimental or simulation data). Specifically, we study the case where one does not have access to…

Numerical Analysis · Mathematics 2018-04-10 Sebastian Krumscheid

We propose an unbiased Monte-Carlo estimator for $\mathbb{E}[g(X_{t_1}, \cdots, X_{t_n})]$, where $X$ is a diffusion process defined by a multi-dimensional stochastic differential equation (SDE). The main idea is to start instead from a…

Probability · Mathematics 2016-03-08 Pierre Henry-Labordere , Xiaolu Tan , Nizar Touzi

We address the problem of approximating the moments of the solution, $\boldsymbol{X}(t)$, of an It\^o stochastic differential equation (SDE) with drift and a diffusion terms over a time-grid $t_0, t_1, \ldots, t_n$. In particular, we assume…

Numerical Analysis · Mathematics 2021-06-14 Albert López-Yela , Joaquin Miguez