English
Related papers

Related papers: Global Attention with Linear Complexity for Exasca…

200 papers

``Online" data assimilation (DA) is used to generate a new seasonal-resolution reanalysis dataset over the last millennium by combining forecasts from an ocean--atmosphere--sea-ice coupled linear inverse model with climate proxy records.…

Atmospheric and Oceanic Physics · Physics 2025-01-27 Zilu Meng , Gregory J. Hakim , Eric J. Steig

Data assimilation (DA) addresses the problem of sequentially estimating the state of a dynamical system from noisy and incomplete observations. In this work, we employ a diffusion model as a world model to simulate and predict the system's…

Machine Learning · Statistics 2026-05-26 Lifu Wei , Yinuo Ren , Naichen Shi , Yiping Lu

Earth observation is becoming one of the largest data-producing activities in science, yet current pipelines still treat compression as a storage and transmission tool rather than a new way to use data. We present a generative compression…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-12 Jinxiao Zhang , Runmin Dong , Xiyong Wu , Xihan Huang , Shenggan Cheng , Yunkai Yang , Zheng Zhou , Yunpu Xu , Zhaoyang Luo , Miao Yang , Fan Wei , Mengxuan Chen , Yang You , Juepeng Zheng , Weijia Li , Yutong Lu , Haohuan Fu

Robust integration of physical knowledge and data is key to improve computational simulations, such as Earth system models. Data assimilation is crucial for achieving this goal because it provides a systematic framework to calibrate model…

Computer Vision and Pattern Recognition · Computer Science 2024-06-14 Yongquan Qu , Juan Nathaniel , Shuolin Li , Pierre Gentine

Data assimilation (DA) enables hydrologic models to update their internal states using near-real-time observations for more accurate forecasts. With deep neural networks like long short-term memory (LSTM), using either lagged observations…

Fluid Dynamics · Physics 2025-02-25 Amirmoez Jamaat , Yalan Song , Farshid Rahmani , Jiangtao Liu , Kathryn Lawson , Chaopeng Shen

Using a very cheap Data Assimilation (DA) method, I show an alternative approach to classical DA for numerical climate models which produce a large amount of "big data". The problematic features of state-of-the-art high resolution Regional…

Applications · Statistics 2016-10-12 Bijan Fallah

Data assimilation (DA) is a fundamental component of modern weather prediction, yet it remains a major computational bottleneck in machine learning (ML)-based forecasting pipelines due to reliance on traditional variational methods. Recent…

Machine Learning · Computer Science 2026-02-09 Ran Cheng , Lailai Zhu

Advances in data assimilation (DA) methods have greatly improved the accuracy of Earth system predictions. To fuse multi-source data and reconstruct the nonlinear evolution missing from observations, geoscientists are developing…

Atmospheric and Oceanic Physics · Physics 2024-12-19 Qingyu Zheng , Guijun Han , Wei Li , Lige Cao , Gongfu Zhou , Haowen Wu , Qi Shao , Ru Wang , Xiaobo Wu , Xudong Cui , Hong Li , Xuan Wang

Data assimilation (DA), as an indispensable component within contemporary Numerical Weather Prediction (NWP) systems, plays a crucial role in generating the analysis that significantly impacts forecast performance. Nevertheless, the…

Machine Learning · Computer Science 2026-03-17 Xiaoze Xu , Xiuyu Sun , Wei Han , Xiaohui Zhong , Lei Chen , Hao Li

Estimating background-error covariances remains a core challenge in variational data assimilation (DA). Operational systems typically approximate these covariances by transformations that separate geostrophically balanced components from…

Atmospheric and Oceanic Physics · Physics 2026-01-21 Boštjan Melinc , Uroš Perkan , Žiga Zaplotnik

Human activities accelerate consumption of fossil fuels and produce greenhouse gases, resulting in urgent issues today: global warming and the climate change. These indirectly cause severe natural disasters, plenty of lives suffering and…

Data assimilation (DA) aims at forecasting the state of a dynamical system by combining a mathematical representation of the system with noisy observations taking into account their uncertainties. State of the art methods are based on the…

Machine Learning · Computer Science 2023-05-26 Pierre Boudier , Anthony Fillion , Serge Gratton , Selime Gürol , Sixin Zhang

Data Assimilation is a cornerstone of atmospheric system modeling, tasked with reconstructing system states by integrating sparse, noisy observations with prior estimation. While traditional approaches like variational and ensemble Kalman…

Machine Learning · Computer Science 2025-11-04 Hao Wang , Zixuan Weng , Jindong Han , Wei Fan , Hao Liu

Research on Artificial Intelligence (AI)-based Data Assimilation (DA) is expanding rapidly. However, the absence of an objective, comprehensive, and real-world benchmark hinders the fair comparison of diverse methods. Here, we introduce…

Machine Learning · Computer Science 2026-02-17 Wuxin Wang , Weicheng Ni , Ben Fei , Tao Han , Lilan Huang , Taikang Yuan , Xiaoyong Li , Lei Bai , Boheng Duan , Kaijun Ren

Time series forecasting is an important problem across many domains, playing a crucial role in multiple real-world applications. In this paper, we propose a forecasting architecture that combines deep autoregressive models with a Spectral…

Machine Learning · Statistics 2021-12-28 Fernando Moreno-Pino , Pablo M. Olmos , Antonio Artés-Rodríguez

The Data Assimilation (DA) community has been developing various diagnostics to understand the importance of the observing system in accurately forecasting the weather. They usually rely on the ability to compute the derivatives of the…

Atmospheric and Oceanic Physics · Physics 2025-11-03 Patrick Laloyaux , Mihai Alexe , Eulalie Boucher , Peter Lean , Ewan Pinnington , Simon Lang , Tobias Necker , Anthony McNally

We propose a novel learning-based surrogate data assimilation (DA) model for efficient state estimation in a limited area. Our model employs a feedforward neural network for online computation, eliminating the need for integrating…

Numerical Analysis · Mathematics 2023-07-17 Wei Kang , Liang Xu , Hong Zhou

We describe a new approach allowing for systematic causal attribution of weather and climate-related events, in near-real time. The method is purposely designed to facilitate its implementation at meteorological centers by relying on data…

The Global Change Analysis Model (GCAM) simulates complex interactions between the coupled Earth and human systems, providing valuable insights into the co-evolution of land, water, and energy sectors under different future scenarios.…

Data assimilation (DA) integrates observations with a dynamical model to estimate states of PDE-governed systems. Model-driven methods (e.g., Kalman, particle) presuppose full knowledge of the true dynamics, which is not always satisfied in…

Signal Processing · Electrical Eng. & Systems 2025-06-06 Siyi Chen , Yixuan Jia , Qing Qu , He Sun , Jeffrey A Fessler