English
Related papers

Related papers: DynGMA: a robust approach for learning stochastic …

200 papers

Diffusion-based generative models use stochastic differential equations (SDEs) and their equivalent ordinary differential equations (ODEs) to establish a smooth connection between a complex data distribution and a tractable prior…

Machine Learning · Computer Science 2024-08-25 Defang Chen , Zhenyu Zhou , Can Wang , Chunhua Shen , Siwei Lyu

Strongly nonlinear flows, which commonly arise in geophysical and engineering turbulence, are characterized by persistent and intermittent energy transfer between various spatial and temporal scales. These systems are difficult to model and…

Dynamical Systems · Mathematics 2022-01-25 Hassan Arbabi , Themistoklis Sapsis

Diffusion-based generative models learn to iteratively transfer unstructured noise to a complex target distribution as opposed to Generative Adversarial Networks (GANs) or the decoder of Variational Autoencoders (VAEs) which produce samples…

Machine Learning · Computer Science 2022-10-26 Sarthak Mittal , Guillaume Lajoie , Stefan Bauer , Arash Mehrjou

We develop a class of non-Gaussian translation processes that extend classical stochastic differential equations (SDEs) by prescribing arbitrary absolutely continuous marginal distributions. Our approach uses a copula-based transformation…

Statistics Theory · Mathematics 2025-08-06 Robert Richardson , H. Dennis Tolley , Kenneth Kuttler

The task of sampling from a probability density can be approached as transporting a tractable density function to the target, known as dynamical measure transport. In this work, we tackle it through a principled unified framework using…

We present a novel model Graph Neural Stochastic Differential Equations (Graph Neural SDEs). This technique enhances the Graph Neural Ordinary Differential Equations (Graph Neural ODEs) by embedding randomness into data representation using…

Machine Learning · Computer Science 2023-08-25 Richard Bergna , Felix Opolka , Pietro Liò , Jose Miguel Hernandez-Lobato

Many consequential real-world systems, like wind fields and ocean currents, are dynamic and hard to model. Learning their governing dynamics remains a central challenge in scientific machine learning. Dynamic Mode Decomposition (DMD)…

Machine Learning · Computer Science 2025-11-26 Yujin Kim , Sarah Dean

Constructions of numerous approximate sampling algorithms are based on the well-known fact that certain Gibbs measures are stationary distributions of ergodic stochastic differential equations (SDEs) driven by the Brownian motion. However,…

Probability · Mathematics 2020-07-07 Lu-Jing Huang , Mateusz B. Majka , Jian Wang

Stochastic differential equations (SDEs) are a fundamental tool for modelling dynamic processes, including gene regulatory networks (GRNs), contaminant transport, financial markets, and image generation. However, learning the underlying SDE…

We propose a stochastic optimization method for minimizing loss functions, expressed as an expected value, that adaptively controls the batch size used in the computation of gradient approximations and the step size used to move along such…

Machine Learning · Computer Science 2020-03-04 Achraf Bahamou , Donald Goldfarb

In this paper, enlightened by the asymptotic expansion methodology developed by Li(2013b) and Li and Chen (2016), we propose a Taylor-type approximation for the transition densities of the stochastic differential equations (SDEs) driven by…

Computational Finance · Quantitative Finance 2020-03-16 Fan Jiang , Xin Zang , Jingping Yang

In this paper, we study dimension reduction techniques for large-scale controlled stochastic differential equations (SDEs). The drift of the considered SDEs contains a polynomial term satisfying a one-sided growth condition. Such…

Probability · Mathematics 2023-03-10 Martin Redmann

Recent success of diffusion models has inspired a surge of interest in developing sampling techniques using reverse diffusion processes. However, accurately estimating the drift term in the reverse stochastic differential equation (SDE)…

Machine Learning · Statistics 2024-10-22 Zhekun Shi , Longlin Yu , Tianyu Xie , Cheng Zhang

We present a novel variational framework for performing inference in (neural) stochastic differential equations (SDEs) driven by Markov-approximate fractional Brownian motion (fBM). SDEs offer a versatile tool for modeling real-world…

Machine Learning · Computer Science 2023-10-20 Rembert Daems , Manfred Opper , Guillaume Crevecoeur , Tolga Birdal

In this article, we introduce a system of stochastic differential equations (SDEs) consisting of time-dependent covariates and consider both fixed and random effects set-ups. We also allow the functional part associated with the drift…

Statistics Theory · Mathematics 2017-10-16 Trisha Maitra , Sourabh Bhattacharya

We present an explicit method for simulating stochastic differential equations (SDEs) that have variable diffusion coefficients and satisfy the detailed balance condition with respect to a known equilibrium density. In Tupper and Yang…

Numerical Analysis · Mathematics 2014-06-27 Paul Tupper , Xin Yang

Learning in deep neural networks (DNNs) is implemented through minimizing a highly non-convex loss function, typically by a stochastic gradient descent (SGD) method. This learning process can effectively find good wide minima without being…

Machine Learning · Computer Science 2021-07-27 Guozhang Chen , Cheng Kevin Qu , Pulin Gong

It is critical yet challenging for deep learning models to properly characterize uncertainty that is pervasive in real-world environments. Although a lot of efforts have been made, such as heteroscedastic neural networks (HNNs), little work…

Machine Learning · Computer Science 2021-03-30 Peng Cui , Zhijie Deng , Wenbo Hu , Jun Zhu

Stochastic differential equations (SDEs) have been widely used to model real world random phenomena. Existing works mainly focus on the case where the time series is modeled by a single SDE, which might be restrictive for modeling time…

Machine Learning · Computer Science 2024-01-23 Zhongchang Sun , Yousef El-Laham , Svitlana Vyetrenko

Diffusion models (DMs) are a class of generative machine learning methods that sample a target distribution by transforming samples of a trivial (often Gaussian) distribution using a learned stochastic differential equation. In standard…

Statistical Mechanics · Physics 2024-08-15 Luke Causer , Grant M. Rotskoff , Juan P. Garrahan