English
Related papers

Related papers: Neural Stochastic Differential Equations: Deep Lat…

200 papers

This work aims to estimate the drift and diffusion functions in stochastic differential equations (SDEs) driven by a particular class of L\'evy processes with finite jump intensity, using neural networks. We propose a framework that…

Machine Learning · Statistics 2025-07-10 Jose-Hermenegildo Ramirez-Gonzalez , Ying Sun

We study how stochastic differential equation (SDE) based ideas can inspire new modifications to existing algorithms for a set of problems in computer vision. Loosely speaking, our formulation is related to both explicit and implicit…

Computer Vision and Pattern Recognition · Computer Science 2021-08-23 Zihang Meng , Vikas Singh , Sathya N. Ravi

The logit outputs of a feedforward neural network at initialization are conditionally Gaussian, given a random covariance matrix defined by the penultimate layer. In this work, we study the distribution of this random matrix. Recent work…

Machine Learning · Statistics 2023-06-16 Mufan Bill Li , Mihai Nica , Daniel M. Roy

The distributions of $ N $-particle systems of Gaussian unitary ensembles converge to Sine$_2$ point processes under bulk-scaling limits. These scalings are parameterized by a macro-position $ \theta $ in the support of the semicircle…

Probability · Mathematics 2018-03-29 Yosuke Kawamoto , Hirofumi Osada

Stochastic differential equations (SDEs) provide a natural framework for modelling intrinsic stochasticity inherent in many continuous-time physical processes. When such processes are observed in multiple individuals or experimental units,…

Computation · Statistics 2016-05-19 Gavin A. Whitaker , Andrew Golightly , Richard J. Boys , Chris Sherlock

We propose a latent score-based generative AI framework for learning stochastic, non-local closure models and constitutive laws in nonlinear dynamical systems of computational mechanics. This work addresses a key challenge of modeling…

Machine Learning · Computer Science 2025-06-27 Xinghao Dong , Huchen Yang , Jin-Long Wu

Diffusion models have emerged as a dominant framework for generative modeling, but their mathematical foundations are often presented separately through diffusion probabilistic models, score-based modeling, stochastic differential…

Machine Learning · Computer Science 2026-05-29 Jiayi Fu , Yuxia Wang

In this work we study how diffusion-based generative models produce high-dimensional data, such as an image, by implicitly relying on a manifestation of a low-dimensional set of latent abstractions, that guide the generative process. We…

Machine Learning · Computer Science 2024-10-07 Giulio Franzese , Mattia Martini , Giulio Corallo , Paolo Papotti , Pietro Michiardi

Strongly nonlinear flows, which commonly arise in geophysical and engineering turbulence, are characterized by persistent and intermittent energy transfer between various spatial and temporal scales. These systems are difficult to model and…

Dynamical Systems · Mathematics 2022-01-25 Hassan Arbabi , Themistoklis Sapsis

Diffusion models (DMs) are a class of generative machine learning methods that sample a target distribution by transforming samples of a trivial (often Gaussian) distribution using a learned stochastic differential equation. In standard…

Statistical Mechanics · Physics 2024-08-15 Luke Causer , Grant M. Rotskoff , Juan P. Garrahan

Irregular sampling intervals and missing values in real-world time series data present challenges for conventional methods that assume consistent intervals and complete data. Neural Ordinary Differential Equations (Neural ODEs) offer an…

Machine Learning · Computer Science 2025-01-28 YongKyung Oh , Dong-Young Lim , Sungil Kim

We provide an explicit rigorous derivation of a diffusion limit - a stochastic differential equation with additive noise - from a deterministic skew-product flow. This flow is assumed to exhibit time-scale separation and has the form of a…

Dynamical Systems · Mathematics 2015-05-27 I. Melbourne , A. M. Stuart

Recent advances in the estimation of deep directed graphical models and recurrent networks let us contribute to the removal of a blind spot in the area of probabilistc modelling of time series. The proposed methods i) can infer distributed…

Machine Learning · Statistics 2014-10-01 Justin Bayer , Christian Osendorfer

We consider Markov models of large-scale networks where nodes are characterized by their local behavior and by a mobility model over a two-dimensional lattice. By assuming random walk, we prove convergence to a system of partial…

Networking and Internet Architecture · Computer Science 2016-04-27 Max Tschaikowski , Mirco Tribastone

Mathematically modelling diffusive and advective transport of particles in heterogeneous layered media is important to many applications in computational, biological and medical physics. While deterministic continuum models of such…

Computational Physics · Physics 2024-09-16 Elliot J. Carr

Dynamical systems driven by nonlinear delay SDEs with small noise can exhibit important rare events on long timescales. When there is no delay, classical large deviations theory quantifies rare events such as escapes from metastable fixed…

Probability · Mathematics 2018-01-04 Robert Azencott , Brett Geiger , William Ott

The proposed BSDE-based diffusion model represents a novel approach to diffusion modeling, which extends the application of stochastic differential equations (SDEs) in machine learning. Unlike traditional SDE-based diffusion models, our…

Machine Learning · Computer Science 2023-04-27 Zihao Wang

In this article, we consider McKean stochastic differential equations, as well as their corresponding McKean-Vlasov partial differential equations, which admit a unique stationary state, and we study the linearized It\^o diffusion process…

Probability · Mathematics 2025-08-05 Grigorios A. Pavliotis , Andrea Zanoni

The generation of discontinuous distributions is a difficult task for most known frameworks such as generative autoencoders and generative adversarial networks. Generative non-invertible models are unable to accurately generate such…

Machine Learning · Computer Science 2021-12-20 Mariia Drozdova , Vitaliy Kinakh , Guillaume Quétant , Tobias Golling , Slava Voloshynovskiy

The Stochastic Burgers Equation (SBE) is a singular, non-linear Stochastic Partial Differential Equation (SPDE) that describes, on mesoscopic scales, the fluctuations of stochastic driven diffusive systems with a conserved scalar quantity.…

Probability · Mathematics 2025-01-10 Giuseppe Cannizzaro , Quentin Moulard , Fabio Toninelli