English
Related papers

Related papers: Data-Efficient Ensemble Weather Forecasting with D…

200 papers

Modern neural networks do not always produce well-calibrated predictions, even when trained with a proper scoring function such as cross-entropy. In classification settings, simple methods such as isotonic regression or temperature scaling…

Machine Learning · Computer Science 2021-03-26 Steven Reich , David Mueller , Nicholas Andrews

Diffusion models have shown promise in forecasting future data from multivariate time series. However, few existing methods account for recurring structures, or patterns, that appear within the data. We present Pattern-Guided Diffusion…

Machine Learning · Computer Science 2025-12-17 Vivian Lin , Kuk Jin Jang , Wenwen Si , Insup Lee

The advancements in the state of the art of generative Artificial Intelligence (AI) brought by diffusion models can be highly beneficial in novel contexts involving Earth observation data. After introducing this new family of generative…

Computer Vision and Pattern Recognition · Computer Science 2024-02-20 Fulvio Sanguigni , Mikolaj Czerkawski , Lorenzo Papa , Irene Amerini , Bertrand Le Saux

A deterministic multiscale toy model is studied in which a chaotic fast subsystem triggers rare transitions between slow regimes, akin to weather or climate regimes. Using homogenization techniques, a reduced stochastic parametrization…

Data Analysis, Statistics and Probability · Physics 2012-04-11 Lewis Mitchell , Georg A. Gottwald

The planning and operation of renewable energy, especially wind power, depend crucially on accurate, timely, and high-resolution weather information. Coarse-grid global numerical weather forecasts are typically downscaled to meet these…

Masked (or absorbing) diffusion is actively explored as an alternative to autoregressive models for generative modeling of discrete data. However, existing work in this area has been hindered by unnecessarily complex model formulations and…

Machine Learning · Computer Science 2025-01-17 Jiaxin Shi , Kehang Han , Zhe Wang , Arnaud Doucet , Michalis K. Titsias

Short- or mid-term rainfall forecasting is a major task with several environmental applications such as agricultural management or flood risk monitoring. Existing data-driven approaches, especially deep learning models, have shown…

Signal Processing · Electrical Eng. & Systems 2021-01-13 Vincent Bouget , Dominique Béréziat , Julien Brajard , Anastase Charantonis , Arthur Filoche

Accurate weather forecasting is critical for science and society. Yet, existing methods have not managed to simultaneously have the properties of high accuracy, low uncertainty, and high computational efficiency. On one hand, to quantify…

Machine Learning · Computer Science 2025-05-06 Jimeng Shi , Bowen Jin , Jiawei Han , Sundararaman Gopalakrishnan , Giri Narasimhan

Despite advances in test-time scaling and diffusion finetuning, guidance for Auto-Regressive Diffusion Models (ARDMs) remains underexplored. We introduce an amortized framework that augments a pretrained ARDM with an offline-trained…

Machine Learning · Computer Science 2026-05-12 Prakhar Srivastava , Farrin Marouf Sofian , Francesco Immorlano , Kushagra Pandey , Stephan Mandt

Data scarcity drives the need for more sample-efficient large language models. In this work, we use the double descent phenomenon to holistically compare the sample efficiency of discrete diffusion and autoregressive models. We show that…

Machine Learning · Computer Science 2025-09-30 Ahmad Fraij , Sam Dauncey

We study the compressive diffusion strategies over distributed networks based on the diffusion implementation and adaptive extraction of the information from the compressed diffusion data. We demonstrate that one can achieve a comparable…

Systems and Control · Computer Science 2015-06-18 Muhammed O. Sayin , Suleyman S. Kozat

Among the most relevant processes in the Earth system for human habitability are quasi-periodic, ocean-driven multi-year events whose dynamics are currently incompletely characterized by physical models, and hence poorly predictable. This…

Atmospheric and Oceanic Physics · Physics 2023-08-09 Matthew Bonas , Christopher K. Wikle , Stefano Castruccio

Diffusion adaptation is a powerful strategy for distributed estimation and learning over networks. Motivated by the concept of combining adaptive filters, this work proposes a combination framework that aggregates the operation of multiple…

Signal Processing · Electrical Eng. & Systems 2020-02-11 Danqi Jin , Jie Chen , Cedric Richard , Jingdong Chen , Ali H. Sayed

Weather data, comprising multiple variables, poses significant challenges due to its high dimensionality and multimodal nature. Creating low-dimensional embeddings requires compressing this data into a compact, shared latent space. This…

Machine Learning · Computer Science 2026-03-27 Nathan Bailey

The evolutionary processes of complex systems contain critical information regarding their functional characteristics. The generation time of edges provides insights into the historical evolution of various networked complex systems, such…

Artificial Intelligence · Computer Science 2025-01-14 En Xu , Can Rong , Jingtao Ding , Yong Li

Ensemble learning is a mainstay in modern data science practice. Conventional ensemble algorithms assign to base models a set of deterministic, constant model weights that (1) do not fully account for individual models' varying accuracy…

Methodology · Statistics 2019-04-02 Jeremiah Zhe Liu , John Paisley , Marianthi-Anna Kioumourtzoglou , Brent A. Coull

We propose an unsupervised anomaly detection approach based on a physics-informed diffusion model for multivariate time series data. Over the past years, diffusion model has demonstrated its effectiveness in forecasting, imputation,…

Machine Learning · Computer Science 2025-08-18 Juhi Soni , Markus Lange-Hegermann , Stefan Windmann

Joint machine learning models that allow synthesizing and classifying data often offer uneven performance between those tasks or are unstable to train. In this work, we depart from a set of empirical observations that indicate the…

Machine Learning · Computer Science 2023-04-06 Kamil Deja , Tomasz Trzcinski , Jakub M. Tomczak

Scenario-based probabilistic forecasts have become vital for decision-makers in handling intermittent renewable energies. This paper presents a recent promising deep learning generative approach called denoising diffusion probabilistic…

Machine Learning · Computer Science 2023-08-22 Esteban Hernandez Capel , Jonathan Dumas

Cloth manipulation is challenging due to its highly complex dynamics, near-infinite degrees of freedom, and frequent self-occlusions, which complicate both state estimation and dynamics modeling. Inspired by recent advances in generative…

Robotics · Computer Science 2025-09-03 Tongxuan Tian , Haoyang Li , Bo Ai , Xiaodi Yuan , Zhiao Huang , Hao Su