English
Related papers

Related papers: Training-Free Data Assimilation with GenCast

200 papers

The forecasting skill of numerical weather prediction (NWP) models critically depends on the accurate initial conditions, also known as analysis, provided by data assimilation (DA). Traditional DA methods often face a trade-off between…

Atmospheric and Oceanic Physics · Physics 2024-11-28 Yanfei Xiang , Weixin Jin , Haiyu Dong , Mingliang Bai , Zuliang Fang , Pengcheng Zhao , Hongyu Sun , Kit Thambiratnam , Qi Zhang , Xiaomeng Huang

Agent-based models are a powerful tool for studying the behaviour of complex systems that can be described in terms of multiple, interacting ``agents''. However, because of their inherently discrete and often highly non-linear nature, it is…

Multiagent Systems · Computer Science 2019-10-22 Daniel Tang

The knowledge of atmospheric parameters -- such as temperature, pressure, and humidity -- is very important for a proper reconstruction of air showers, especially with the fluorescence technique. The Global Data Assimilation System (GDAS)…

Instrumentation and Methods for Astrophysics · Physics 2019-08-13 Martin Will

Current deep networks are very data-hungry and benefit from training on largescale datasets, which are often time-consuming to collect and annotate. By contrast, synthetic data can be generated infinitely using generative models such as…

Computer Vision and Pattern Recognition · Computer Science 2023-10-11 Weijia Wu , Yuzhong Zhao , Hao Chen , Yuchao Gu , Rui Zhao , Yefei He , Hong Zhou , Mike Zheng Shou , Chunhua Shen

Learning dynamical systems from sparse observations is critical in numerous fields, including biology, finance, and physics. Even if tackling such problems is standard in general information fusion, it remains challenging for contemporary…

Machine Learning · Computer Science 2024-06-04 Ella Tamir , Arno Solin

A hybrid data assimilation algorithm is developed for complex dynamical systems with partial observations. The method starts with applying a spectral decomposition to the entire spatiotemporal fields, followed by creating a machine learning…

Computational Physics · Physics 2022-12-27 Changhong Mou , Leslie M. Smith , Nan Chen

Accurate characterization of subsurface heterogeneity is important for the safe and effective implementation of geological carbon storage (GCS) projects. This paper explores how machine learning methods can enhance data assimilation for GCS…

A thermal convection loop is a circular chamber filled with water, heated on the bottom half and cooled on the top half. With sufficiently large forcing of heat, the direction of fluid flow in the loop oscillates chaotically, forming an…

Dynamical Systems · Mathematics 2016-06-24 Andrew J. Reagan

In this paper, we apply a recently developed nonparametric modeling approach, the "diffusion forecast", to predict the time-evolution of Fourier modes of turbulent dynamical systems. While the diffusion forecasting method assumes the…

Chaotic Dynamics · Physics 2016-03-23 Tyrus Berry , John Harlim

Improving the representation of precipitation in Earth system models (ESMs) is critical for assessing the impacts of climate change and especially of extreme events like floods and droughts. In existing ESMs, precipitation is not resolved…

Machine Learning · Computer Science 2026-05-27 Michael Aich , Sebastian Bathiany , Philipp Hess , Yu Huang , Niklas Boers

Data assimilation (DA) in the geophysical sciences remains the cornerstone of robust forecasts from numerical models. Indeed, DA plays a crucial role in the quality of numerical weather prediction, and is a crucial building block that has…

This paper demonstrates how to use generative models trained for image synthesis as tools for visual data mining. Our insight is that since contemporary generative models learn an accurate representation of their training data, we can use…

Computer Vision and Pattern Recognition · Computer Science 2024-08-07 Ioannis Siglidis , Aleksander Holynski , Alexei A. Efros , Mathieu Aubry , Shiry Ginosar

This chapter describes a novel approach for the treatment of model error in geophysical data assimilation. In this method, model error is treated as a deterministic process fully correlated in time. This allows for the derivation of the…

Atmospheric and Oceanic Physics · Physics 2015-11-11 Alberto Carrassi , Stéphane Vannitsem

Data assimilation algorithms are used to estimate the states of a dynamical system using partial and noisy observations. The ensemble Kalman filter has become a popular data assimilation scheme due to its simplicity and robustness for a…

Numerical Analysis · Mathematics 2021-06-23 Gottfried Hastermann , Maria Reinhardt , Rupert Klein , Sebastian Reich

Recent years have seen a surge in interest in building deep learning-based fully data-driven models for weather prediction. Such deep learning models if trained on observations can mitigate certain biases in current state-of-the-art weather…

Machine Learning · Computer Science 2022-05-11 Ashesh Chattopadhyay , Jaideep Pathak , Ebrahim Nabizadeh , Wahid Bhimji , Pedram Hassanzadeh

Quantifying the impacts of anthropogenic global warming requires accurate Earth system model (ESM) simulations. Statistical bias correction and downscaling can be applied to reduce errors and increase the resolution of ESMs. However,…

Geophysics · Physics 2024-06-24 Philipp Hess , Niklas Boers

Generative diffusion models synthesize new samples by reversing a diffusive process that converts a given data set to generic noise. This is accomplished by training a neural network to match the gradient of the log of the probability…

Machine Learning · Computer Science 2023-10-11 Akhil Premkumar

The weather and climate domains are undergoing a significant transformation thanks to advances in AI-based foundation models such as FourCastNet, GraphCast, ClimaX and Pangu-Weather. While these models show considerable potential, they are…

Machine Learning · Computer Science 2024-07-18 Junqi Yin , Siming Liang , Siyan Liu , Feng Bao , Hristo G. Chipilski , Dan Lu , Guannan Zhang

Cloth manipulation is challenging due to its highly complex dynamics, near-infinite degrees of freedom, and frequent self-occlusions, which complicate both state estimation and dynamics modeling. Inspired by recent advances in generative…

Robotics · Computer Science 2025-09-03 Tongxuan Tian , Haoyang Li , Bo Ai , Xiaodi Yuan , Zhiao Huang , Hao Su

Diffusion Models~(DMs) have emerged as the dominant approach in Generative Artificial Intelligence (GenAI), owing to their remarkable performance in tasks such as text-to-image synthesis. However, practical DMs, such as stable diffusion,…

Machine Learning · Computer Science 2025-08-18 Xuhui Fan , Zhangkai Wu , Hongyu Wu