English
Related papers

Related papers: Forecasting Turbulent Modes with Nonparametric Dif…

200 papers

Diffusion models are a powerful tool for probabilistic forecasting, yet most applications in high-dimensional complex systems predict future states individually. This approach struggles to model complex temporal dependencies and fails to…

Machine Learning · Computer Science 2025-12-10 Salva Rühling Cachay , Miika Aittala , Karsten Kreis , Noah Brenowitz , Arash Vahdat , Morteza Mardani , Rose Yu

Diffusion Probabilistic Models (DPMs) are powerful generative models that have achieved unparalleled success in a number of generative tasks. In this work, we aim to build inductive biases into the training and sampling of diffusion models…

Machine Learning · Computer Science 2025-03-14 Thomas Jiralerspong , Berton Earnshaw , Jason Hartford , Yoshua Bengio , Luca Scimeca

High-fidelity numerical simulations of chaotic, high dimensional nonlinear dynamical systems are computationally expensive, necessitating the development of efficient surrogate models. Most surrogate models for such systems are…

Machine Learning · Computer Science 2026-03-16 Dibyajyoti Chakraborty , Hojin Kim , Romit Maulik

Generative diffusion models are extensively used in unsupervised and self-supervised machine learning with the aim to generate new samples from a probability distribution estimated with a set of known samples. They have demonstrated…

Fluid Dynamics · Physics 2026-01-28 Wilfried Genuist , Éric Savin , Filippo Gatti , Didier Clouteau

We propose a novel denoising diffusion generative model for predicting nonlinear fluid fields named FluidDiff. By performing a diffusion process, the model is able to learn a complex representation of the high-dimensional dynamic system,…

Machine Learning · Computer Science 2023-01-31 Gefan Yang , Stefan Sommer

Diffusion models are powerful tools for sampling from high-dimensional distributions by progressively transforming pure noise into structured data through a denoising process. When equipped with a guidance mechanism, these models can also…

Machine Learning · Computer Science 2026-05-04 Saeed Mohseni-Sehdeh , Walid Saad , Kei Sakaguchi , Tao Yu

We present a Bayesian non-parametric way of inferring stochastic differential equations for both regression tasks and continuous-time dynamical modelling. The work has high emphasis on the stochastic part of the differential equation, also…

Machine Learning · Statistics 2020-06-29 Martin Jørgensen , Marc Peter Deisenroth , Hugh Salimbeni

We consider the problem of designing almost optimal predictors for dynamical systems from a finite sequence of noisy observations and incomplete knowledge of the dynamics and the noise. We first discuss the properties of the optimal (Bayes)…

Chaotic Dynamics · Physics 2007-07-30 Marian Anghel , Ingo Steinwart

Denoising diffusion models, a class of generative models, have garnered immense interest lately in various deep-learning problems. A diffusion probabilistic model defines a forward diffusion stage where the input data is gradually perturbed…

Image and Video Processing · Electrical Eng. & Systems 2023-06-06 Amirhossein Kazerouni , Ehsan Khodapanah Aghdam , Moein Heidari , Reza Azad , Mohsen Fayyaz , Ilker Hacihaliloglu , Dorit Merhof

Diffusion models have recently shown promise in time series forecasting, particularly for probabilistic predictions. However, they often fail to achieve state-of-the-art point estimation performance compared to regression-based methods.…

Artificial Intelligence · Computer Science 2025-11-25 Hang Ding , Xue Wang , Tian Zhou , Tao Yao

This letter presents a non-parametric modeling approach for forecasting stochastic dynamical systems on low-dimensional manifolds. The key idea is to represent the discrete shift maps on a smooth basis which can be obtained by the diffusion…

Dynamical Systems · Mathematics 2015-03-25 Tyrus Berry , Dimitrios Giannakis , John Harlim

Due to the dynamics of underlying physics and external influences, the uncertainty of time series often varies over time. However, existing Denoising Diffusion Probabilistic Models (DDPMs) often fail to capture this non-stationary nature,…

Machine Learning · Computer Science 2026-04-14 Weiwei Ye , Zhuopeng Xu , Ning Gui

This book presents the core principles that have guided the development of diffusion models, tracing their origins and showing how diverse formulations arise from shared mathematical ideas. Diffusion modeling starts by defining a forward…

Machine Learning · Computer Science 2026-05-28 Chieh-Hsin Lai , Yang Song , Dongjun Kim , Yuki Mitsufuji , Stefano Ermon

Diffusion Models (DMs) have demonstrated state-of-the-art performance in content generation without requiring adversarial training. These models are trained using a two-step process. First, a forward - diffusion - process gradually adds…

Computer Vision and Pattern Recognition · Computer Science 2024-03-13 Anwaar Ulhaq , Naveed Akhtar

Diffusion models have achieved state-of-the-art synthesis quality on both visual and audio tasks, and recent works further adapt them to textual data by diffusing on the embedding space. In this paper, we conduct systematic studies of the…

Computation and Language · Computer Science 2024-04-23 Zhujin Gao , Junliang Guo , Xu Tan , Yongxin Zhu , Fang Zhang , Jiang Bian , Linli Xu

Diffusion models have gained traction as powerful algorithms for synthesizing high-quality images. Central to these algorithms is the diffusion process, a set of equations which maps data to noise in a way that can significantly affect…

Machine Learning · Computer Science 2024-11-12 Subham Sekhar Sahoo , Aaron Gokaslan , Chris De Sa , Volodymyr Kuleshov

Recent innovations in diffusion probabilistic models have paved the way for significant progress in image, text and audio generation, leading to their applications in generative time series forecasting. However, leveraging such abilities to…

Machine Learning · Computer Science 2025-11-07 Yuansan Liu , Sudanthi Wijewickrema , Dongting Hu , Christofer Bester , Stephen O'Leary , James Bailey

Temporal data such as time series can be viewed as discretized measurements of the underlying function. To build a generative model for such data we have to model the stochastic process that governs it. We propose a solution by defining the…

Machine Learning · Computer Science 2023-05-22 Marin Biloš , Kashif Rasul , Anderson Schneider , Yuriy Nevmyvaka , Stephan Günnemann

In this work, we study the problem of learning the volatility under market microstructure noise. Specifically, we consider noisy discrete time observations from a stochastic differential equation and develop a novel computational method to…

Methodology · Statistics 2024-03-19 Shota Gugushvili , Frank van der Meulen , Moritz Schauer , Peter Spreij

Data-driven, model-free analytics are natural choices for discovery and forecasting of complex, nonlinear systems. Methods that operate in the system state-space require either an explicit multidimensional state-space, or, one approximated…

Machine Learning · Statistics 2021-03-15 Joseph Park , Gerald M Pao , Erik Stabenau , George Sugihara , Thomas Lorimer