English
Related papers

Related papers: Neural Stochastic Flows: Solver-Free Modelling and…

200 papers

Recent years have witnessed significant progress in developing effective training and fast sampling techniques for diffusion models. A remarkable advancement is the use of stochastic differential equations (SDEs) and their…

Computer Vision and Pattern Recognition · Computer Science 2024-08-26 Defang Chen , Zhenyu Zhou , Jian-Ping Mei , Chunhua Shen , Chun Chen , Can Wang

In this work, we introduce a new class of neural network operators designed to handle problems where memory effects and randomness play a central role. In this work, we introduce a new class of neural network operators designed to handle…

Machine Learning · Computer Science 2025-05-22 Rômulo Damasclin Chaves dos Santos , Jorge Henrique de Oliveira Sales

Irregularly sampled time series with missing values are often observed in multiple real-world applications such as healthcare, climate and astronomy. They pose a significant challenge to standard deep learning models that operate only on…

Machine Learning · Computer Science 2024-10-04 Christian Klötergens , Vijaya Krishna Yalavarthi , Maximilian Stubbemann , Lars Schmidt-Thieme

Stochastic Partial Differential Equations (SPDEs) driven by random noise play a central role in modeling physical processes with rough spatio-temporal dynamics, such as turbulence flows, superconductors, and quantum dynamics. Although…

Machine Learning · Computer Science 2026-05-18 Yuantu Zhu , Zheyan Li , Dai Shi , Luke Thompson , Oliver Nash , Jose Miguel Lara Rangel , Siran Li , Bingguang Chen , Rongchan Zhu , Qi Meng , Hao Ni

Neural Processes combine the strengths of neural networks and Gaussian processes to achieve both flexible learning and fast prediction in stochastic processes. However, a large class of problems comprises underlying temporal dependency…

Machine Learning · Computer Science 2019-10-29 Gautam Singh , Jaesik Yoon , Youngsung Son , Sungjin Ahn

We develop an approach to learn an interpretable semi-parametric model of a latent continuous-time stochastic dynamical system, assuming noisy high-dimensional outputs sampled at uneven times. The dynamics are described by a nonlinear…

Machine Learning · Statistics 2019-02-13 Lea Duncker , Gergo Bohner , Julien Boussard , Maneesh Sahani

A systematic Bayesian framework is developed for physics constrained parameter inference ofstochastic differential equations (SDE) from partial observations. The physical constraints arederived for stochastic climate models but are…

Data Analysis, Statistics and Probability · Physics 2016-11-25 Daniel Peavoy , Christian L. E. Franzke , Gareth O. Roberts

Non-equilibrium Monte Carlo simulations based on Jarzynski's equality are a well-understood method to compute differences in free energy and also to sample from a target probability distribution without the need to thermalize the system…

High Energy Physics - Lattice · Physics 2024-10-07 Andrea Bulgarelli , Elia Cellini , Alessandro Nada

The numerical simulation and optimization of technical systems described by partial differential equations is expensive, especially in multi-query scenarios in which the underlying equations have to be solved for different parameters. A…

Numerical Analysis · Mathematics 2025-04-09 Franziska Griese , Fabian Hoppe , Alexander Rüttgers , Philipp Knechtges

The performance of flow matching and diffusion models can be greatly improved at inference time using reward alignment algorithms, yet efficiency remains a major limitation. While several algorithms were proposed, we demonstrate that a…

Machine Learning · Computer Science 2026-02-12 Peter Holderrieth , Uriel Singer , Tommi Jaakkola , Ricky T. Q. Chen , Yaron Lipman , Brian Karrer

Fractional Differential Equations (FDEs) are essential tools for modelling complex systems in science and engineering. They extend the traditional concepts of differentiation and integration to non-integer orders, enabling a more precise…

Machine Learning · Computer Science 2025-03-27 C. Coelho , M. Fernanda P. Costa , L. L. Ferrás

We introduce a lattice random walk discretisation scheme for stochastic differential equations (SDEs) that samples binary or ternary increments at each step, suppressing complex drift and diffusion computations to simple 1 or 2 bit random…

Numerical Analysis · Mathematics 2026-02-18 Samuel Duffield , Maxwell Aifer , Denis Melanson , Zach Belateche , Patrick J. Coles

We study the dynamics of a continuous-time model of the Stochastic Gradient Descent (SGD) for the least-square problem. Indeed, pursuing the work of Li et al. (2019), we analyze Stochastic Differential Equations (SDEs) that model SGD either…

Machine Learning · Computer Science 2024-07-03 Adrien Schertzer , Loucas Pillaud-Vivien

Stochastic Volterra equations (SVEs) serve as mathematical models for the time evolutions of random systems with memory effects and irregular behaviour. We introduce neural stochastic Volterra equations as a physics-inspired architecture,…

Machine Learning · Computer Science 2025-12-30 Martin Bergerhausen , David J. Prömel , David Scheffels

Parameter estimation for non-stationary stochastic differential equations (SDE) with an arbitrary nonlinear drift, and nonlinear diffusion is accomplished in combination with a non-parametric clustering methodology. Such a model-based…

Optimization and Control · Mathematics 2021-09-07 Vyacheslav Boyko , Sebastian Krumscheid , Nikki Vercauteren

In this article we study (possibly degenerate) stochastic differential equations (SDE) with irregular (or discontiuous) coefficients, and prove that under certain conditions on the coefficients, there exists a unique almost everywhere…

Probability · Mathematics 2009-08-18 Xicheng Zhang

Diffusion or flow-based models are powerful generative paradigms that are notoriously hard to sample as samples are defined as solutions to high-dimensional Ordinary or Stochastic Differential Equations (ODEs/SDEs) which require a large…

Machine Learning · Computer Science 2023-10-31 Neta Shaul , Juan Perez , Ricky T. Q. Chen , Ali Thabet , Albert Pumarola , Yaron Lipman

Creating noise from data is easy; creating data from noise is generative modeling. We present a stochastic differential equation (SDE) that smoothly transforms a complex data distribution to a known prior distribution by slowly injecting…

Machine Learning · Computer Science 2021-02-11 Yang Song , Jascha Sohl-Dickstein , Diederik P. Kingma , Abhishek Kumar , Stefano Ermon , Ben Poole

We propose new limiting dynamics for stochastic gradient descent in the small learning rate regime called stochastic modified flows. These SDEs are driven by a cylindrical Brownian motion and improve the so-called stochastic modified…

Probability · Mathematics 2023-02-15 Benjamin Gess , Sebastian Kassing , Vitalii Konarovskyi

Diffusion-based generative models have achieved state-of-the-art performance for perceptual quality in speech enhancement (SE). However, their iterative nature requires numerous Neural Function Evaluations (NFEs), posing a challenge for…