English
Related papers

Related papers: DEF: Diffusion-augmented Ensemble Forecasting

200 papers

We propose a framework for probabilistic forecasting of dynamical systems based on generative modeling. Given observations of the system state over time, we formulate the forecasting problem as sampling from the conditional distribution of…

Machine Learning · Computer Science 2024-08-29 Yifan Chen , Mark Goldstein , Mengjian Hua , Michael S. Albergo , Nicholas M. Boffi , Eric Vanden-Eijnden

Accurate forecasting of spatiotemporal data remains challenging due to complex spatial dependencies and temporal dynamics. The inherent uncertainty and variability in such data often render deterministic models insufficient, prompting a…

Machine Learning · Computer Science 2024-11-05 Mingze Gong , Lei Chen , Jia Li

We introduce a general framework for solving partial differential equations (PDEs) using generative diffusion models. In particular, we focus on the scenarios where we do not have the full knowledge of the scene necessary to apply classical…

Machine Learning · Computer Science 2024-11-04 Jiahe Huang , Guandao Yang , Zichen Wang , Jeong Joon Park

In this paper, we propose Diffusion Domain Expansion (DDE), a method that efficiently extends pre-trained diffusion models to generate larger objects and handle more complex conditioning beyond their original capabilities. Our method…

Machine Learning · Computer Science 2026-05-25 Egor Lifar , Semyon Savkin , Timur Garipov , Shangyuan Tong , Tommi Jaakkola

Machine learning methods have been shown to be effective for weather forecasting, based on the speed and accuracy compared to traditional numerical models. While early efforts primarily concentrated on deterministic predictions, the field…

Machine Learning · Computer Science 2025-04-11 Erik Larsson , Joel Oskarsson , Tomas Landelius , Fredrik Lindsten

The proliferation of intermittent distributed renewable energy sources (RES) in modern power systems has fundamentally compromised the reliability and accuracy of deterministic net load forecasting. Generative models, particularly diffusion…

Systems and Control · Electrical Eng. & Systems 2025-06-04 Yixiang Huang , Jianhua Pei , Luocheng Chen , Zhenchang Du , Jinfu Chen , Zirui Peng

Earth System Models (ESMs) are essential for understanding the interaction between human activities and the Earth's climate. However, the computational demands of ESMs often limit the number of simulations that can be run, hindering the…

Atmospheric and Oceanic Physics · Physics 2024-09-19 Seth Bassetti , Brian Hutchinson , Claudia Tebaldi , Ben Kravitz

Owing to the remarkable development of deep learning technology, there have been a series of efforts to build deep learning-based climate models. Whereas most of them utilize recurrent neural networks and/or graph neural networks, we design…

Machine Learning · Computer Science 2021-11-12 Jeehyun Hwang , Jeongwhan Choi , Hwangyong Choi , Kookjin Lee , Dongeun Lee , Noseong Park

Precipitation nowcasting is a critical spatio-temporal prediction task for society to prevent severe damage owing to extreme weather events. Despite the advances in this field, the complex and stochastic nature of this task still poses…

Machine Learning · Computer Science 2025-12-25 Shi Quan Foo , Chi-Ho Wong , Zhihan Gao , Dit-Yan Yeung , Ka-Hing Wong , Wai-Kin Wong

Diffusion models (DMs) represent state-of-the-art generative models for continuous inputs. DMs work by constructing a Stochastic Differential Equation (SDE) in the input space (ie, position space), and using a neural network to reverse it.…

Machine Learning · Computer Science 2024-05-14 Tianrong Chen , Jiatao Gu , Laurent Dinh , Evangelos A. Theodorou , Joshua Susskind , Shuangfei Zhai

Stochastic differential equations (SDEs) provide a natural framework for modelling intrinsic stochasticity inherent in many continuous-time physical processes. When such processes are observed in multiple individuals or experimental units,…

Computation · Statistics 2016-05-19 Gavin A. Whitaker , Andrew Golightly , Richard J. Boys , Chris Sherlock

Diffusion models have recently emerged as powerful stochastic frameworks for high-dimensional inference and generation. However, existing applications to partial differential equations (PDEs) predominantly rely on physics-informed training…

Numerical Analysis · Mathematics 2026-04-03 Yi Bing , Liu Jia , Fu Jinyang , Peng Xiang

Data scarcity is a primary obstacle in developing robust Machine Learning (ML) models for detecting rapidly intensifying tropical cyclones. Traditional data augmentation techniques (rotation, flipping, brightness adjustment) fail to…

Machine Learning · Computer Science 2026-03-10 Marawan Yakout , Tannistha Maiti , Monira Majhabeen , Tarry Singh

Ensemble weather forecasts enable a measure of uncertainty to be attached to each forecast, by computing the ensemble's spread. However, generating an ensemble with a good spread-error relationship is far from trivial, and a wide range of…

Atmospheric and Oceanic Physics · Physics 2021-01-05 Sebastian Scher , Gabriele Messori

Stochastic differential equations (SDEs) describe dynamical systems where deterministic flows, governed by a drift function, are superimposed with random fluctuations, dictated by a diffusion function. The accurate estimation (or discovery)…

Machine Learning · Computer Science 2025-10-22 Patrick Seifner , Kostadin Cvejoski , David Berghaus , Cesar Ojeda , Ramses J. Sanchez

The Cambrian explosion of easily accessible pre-trained diffusion models suggests a demand for methods that combine multiple different pre-trained diffusion models without incurring the significant computational burden of re-training a…

Machine Learning · Computer Science 2025-03-04 Marta Skreta , Lazar Atanackovic , Avishek Joey Bose , Alexander Tong , Kirill Neklyudov

Weather forecasting is fundamentally challenged by the chaotic nature of the atmosphere, necessitating probabilistic approaches to quantify uncertainty. While traditional ensemble prediction (EPS) addresses this through computationally…

Machine Learning · Computer Science 2025-11-19 Xinlei Xiong , Wenbo Hu , Shuxun Zhou , Kaifeng Bi , Lingxi Xie , Ying Liu , Richang Hong , Qi Tian

Earth system forecasting has traditionally relied on complex physical models that are computationally expensive and require significant domain expertise. In the past decade, the unprecedented increase in spatiotemporal Earth observation…

Machine Learning · Computer Science 2023-12-29 Zhihan Gao , Xingjian Shi , Boran Han , Hao Wang , Xiaoyong Jin , Danielle Maddix , Yi Zhu , Mu Li , Yuyang Wang

Diffusion models are a class of probabilistic generative models that have been widely used as a prior for image processing tasks like text conditional generation and inpainting. We demonstrate that these models can be adapted to make…

Machine Learning · Computer Science 2023-06-14 Marc Finzi , Anudhyan Boral , Andrew Gordon Wilson , Fei Sha , Leonardo Zepeda-Núñez

We propose a simple, efficient, yet powerful framework for dense visual predictions based on the conditional diffusion pipeline. Our approach follows a "noise-to-map" generative paradigm for prediction by progressively removing noise from a…

Computer Vision and Pattern Recognition · Computer Science 2023-05-16 Yuanfeng Ji , Zhe Chen , Enze Xie , Lanqing Hong , Xihui Liu , Zhaoqiang Liu , Tong Lu , Zhenguo Li , Ping Luo