English
Related papers

Related papers: A Scalable Real-Time Data Assimilation Framework f…

200 papers

Data assimilation techniques are often confronted with challenges handling complex high dimensional physical systems, because high precision simulation in complex high dimensional physical systems is computationally expensive and the exact…

Mathematical Software · Computer Science 2024-09-04 Sibo Cheng , Jinyang Min , Che Liu , Rossella Arcucci

Triggered by the realization that AI emulators can rival the performance of traditional numerical weather prediction models running on HPC systems, there is now an increasing number of large AI models that address use cases such as…

Data assimilation (DA) in the geophysical sciences remains the cornerstone of robust forecasts from numerical models. Indeed, DA plays a crucial role in the quality of numerical weather prediction, and is a crucial building block that has…

This work explores a dynamics-informed Temporal Fusion Transformer (TFT) as a data-driven surrogate for computationally intensive Earth system simulations. Focusing on multivariate time series describing global ocean transport, we…

Machine Learning · Computer Science 2026-05-21 Adeline Hillier , Jennifer Sleeman , Jay Brett , Caroline Tang , Jenelle Millison , Anand Gnanadesikan

The use of model order reduction techniques in combination with ensemble-based methods for estimating the state of systems described by nonlinear partial differential equations has been of great interest in recent years in the data…

Numerical Analysis · Mathematics 2024-12-18 Francesco A. B. Silva , Cecilia Pagliantini , Karen Veroy

In spite of astonishing advances and developments in remote sensing technologies, meeting the spatio-temporal requirements for flood hydrodynamic modeling remains a great challenge for Earth Observation. The assimilation of multi-source…

Image and Video Processing · Electrical Eng. & Systems 2024-09-09 Thanh Huy Nguyen , Sophie Ricci , Andrea Piacentini , Charlotte Emery , Raquel Rodriguez Suquet , Santiago Peña Luque

Data assimilation (DA) enables hydrologic models to update their internal states using near-real-time observations for more accurate forecasts. With deep neural networks like long short-term memory (LSTM), using either lagged observations…

Fluid Dynamics · Physics 2025-02-25 Amirmoez Jamaat , Yalan Song , Farshid Rahmani , Jiangtao Liu , Kathryn Lawson , Chaopeng Shen

Climate field reconstructions (CFR) attempt to estimate spatiotemporal fields of climate variables in the past using climate proxies such as tree rings, ice cores, and corals. Data Assimilation (DA) methods are a recent and promising new…

Methodology · Statistics 2020-08-06 Trevor Harris , Bo Li , Nathan Steiger , Jason Smerdon , Naveen Narisetty , Derek Tucker

This paper presents an innovative Reduced-Order Model (ROM) for merging experimental and simulation data using Data Assimilation (DA) to estimate the "True" state of a fluid dynamics system, leading to more accurate predictions. Our…

Computational Engineering, Finance, and Science · Computer Science 2025-07-03 Paul Jeanney , Ashton Hetherington , Shady E. Ahmed , David Lanceta , Susana Saiz , José Miguel Perez , Soledad Le Clainche

Cloud microphysical parameterizations in atmospheric models describe the formation and evolution of clouds and precipitation, a central weather and climate process. Cloud-associated latent heating is a primary driver of large and…

Precipitation remains one of the most challenging climate variables to observe and predict accurately. Existing datasets face intricate trade-offs: gauge observations are relatively trustworthy but sparse, satellites provide global coverage…

Atmospheric and Oceanic Physics · Physics 2025-06-24 Sencan Sun , Congyi Nai , Baoxiang Pan , Wentao Li , Lu Li , Xin Li , Efi Foufoula-Georgiou , Yanluan Lin

Data Assimilation is the process in which we improve the representation of the state of a physical system by combining information coming from a numerical model, real-world observations, and some prior modelling. It is widely used to model…

Optimization and Control · Mathematics 2025-01-09 Victor Trappler , Arthur Vidard

A deterministic multiscale toy model is studied in which a chaotic fast subsystem triggers rare transitions between slow regimes, akin to weather or climate regimes. Using homogenization techniques, a reduced stochastic parametrization…

Data Analysis, Statistics and Probability · Physics 2012-04-11 Lewis Mitchell , Georg A. Gottwald

We introduce a framework for Data Assimilation (DA) in which the data is split into multiple sets corresponding to low-rank projections of the state space. Algorithms are developed that assimilate some or all of the projected data,…

Computation · Statistics 2020-05-19 John Maclean , Erik S Van Vleck

Data assimilation techniques are crucial for accurately tracking complex dynamical systems by integrating observational data with numerical forecasts. Recently, score-based data assimilation methods emerged as powerful tools for…

Machine Learning · Statistics 2026-03-03 Pengpeng Xiao , Phillip Si , Peng Chen

The Efficient Adaptive Transformer (EAT) framework unifies three adaptive efficiency techniques - progressive token pruning, sparse attention, and dynamic early exiting - into a single, reproducible architecture for input-adaptive…

Computation and Language · Computer Science 2025-10-16 Jan Miller

Data assimilation is a core component of numerical weather prediction systems. The large quantity of data processed during assimilation requires the computation to be distributed across increasingly many compute nodes, yet existing…

Machine Learning · Computer Science 2025-01-15 Oscar Key , So Takao , Daniel Giles , Marc Peter Deisenroth

There has been a recent surge in development of accurate machine learning (ML) weather prediction models, but evaluation of these models has mainly been focused on medium-range forecasts, not their performance in cycling data assimilation…

Atmospheric and Oceanic Physics · Physics 2024-12-25 Laura C. Slivinski , Jeffrey S. Whitaker , Sergey Frolov , Timothy A. Smith , Niraj Agarwal

Addressing complex meteorological processes at a fine spatial resolution requires substantial computational resources. To accelerate meteorological simulations, researchers have utilized neural networks to downscale meteorological variables…

Atmospheric and Oceanic Physics · Physics 2024-04-30 Jing Hu , Honghu Zhang , Peng Zheng , Jialin Mu , Xiaomeng Huang , Xi Wu

Four-dimensional variational data assimilation (4D-Var) on a seasonal-to-interdecadal time scale under the existence of unstable modes can be viewed as an optimization problem of synchronized, coupled chaotic systems. The problem is tackled…

Data Analysis, Statistics and Probability · Physics 2015-11-17 Nozomi Sugiura , Shuhei Masuda , Yosuke Fujii , Masafumi Kamachi , Yoichi Ishikawa , Toshiyuki Awaji