English
Related papers

Related papers: AI-based data assimilation: Learning the functiona…

200 papers

In this paper, we present the first systematic comparison of Data Assimilation (DA) and Likelihood-Based Inference (LBI) in the context of an Agent-Based Model (ABM). These models generate observable time series driven by evolving,…

Machine Learning · Computer Science 2026-04-30 Blas Kolic , Corrado Monti , Gianmarco De Francisci Morales , Marco Pangallo

We propose two new methods based/inspired by machine learning for tabular data and distance-free localization to enhance the covariance estimations in an ensemble data assimilation. The main goal is to enhance the data assimilation results…

Machine Learning · Computer Science 2025-07-31 Vinicius L. S. Silva , Gabriel S. Seabra , Alexandre A. Emerick

Data assimilation algorithms estimate the state of a dynamical system from partial observations, where the successful performance of these algorithms hinges on costly parameter tuning and on employing an accurate model for the dynamics.…

Machine Learning · Statistics 2026-03-24 Melissa Adrian , Daniel Sanz-Alonso , Rebecca Willett

In the hydrology field, time series forecasting is crucial for efficient water resource management, improving flood and drought control and increasing the safety and quality of life for the general population. However, predicting long-term…

Machine Learning · Computer Science 2023-12-19 Yanhong Li , Jack Xu , David C. Anastasiu

A hybrid data assimilation algorithm is developed for complex dynamical systems with partial observations. The method starts with applying a spectral decomposition to the entire spatiotemporal fields, followed by creating a machine learning…

Computational Physics · Physics 2022-12-27 Changhong Mou , Leslie M. Smith , Nan Chen

Data assimilation (DA) improves prediction of chaotic systems by combining model forecasts with sparse, noisy observations. Many DA methods are inherently probabilistic, but accurate probabilistic DA is often computationally expensive…

Fluid Dynamics · Physics 2026-04-24 Aditya Sai Pranith Ayapilla , Kazuya Miyashita , Yuki Yasuda , Ryo Onishi

Meteorological agencies around the world rely on real-time flood guidance to issue life-saving advisories and warnings. For decades traditional numerical weather prediction (NWP) models have been state-of-the-art for precipitation…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Levi Harris , Tianlong Chen

The generation of initial conditions via accurate data assimilation is crucial for weather forecasting and climate modeling. We propose DiffDA as a denoising diffusion model capable of assimilating atmospheric variables using predicted…

Computational Engineering, Finance, and Science · Computer Science 2024-06-11 Langwen Huang , Lukas Gianinazzi , Yuejiang Yu , Peter D. Dueben , Torsten Hoefler

Numerical Weather Prediction (NWP) system is an infrastructure that exerts considerable impacts on modern society.Traditional NWP system, however, resolves it by solving complex partial differential equations with a huge computing cluster,…

Artificial Intelligence · Computer Science 2024-09-26 Junchao Gong , Tao Han , Kang Chen , Lei Bai

Incorporating unstructured data into physical models is a challenging problem that is emerging in data assimilation. Traditional approaches focus on well-defined observation operators whose functional forms are typically assumed to be…

Machine Learning · Statistics 2024-07-25 Alex Glyn-Davies , Connor Duffin , Ö. Deniz Akyildiz , Mark Girolami

We propose the Multi-Head Density Adaptive Attention Mechanism (DAAM), a novel probabilistic attention framework that can be used for Parameter-Efficient Fine-tuning (PEFT), and the Density Adaptive Transformer (DAT), designed to enhance…

Machine Learning · Computer Science 2024-10-01 Georgios Ioannides , Aman Chadha , Aaron Elkins

Robust integration of physical knowledge and data is key to improve computational simulations, such as Earth system models. Data assimilation is crucial for achieving this goal because it provides a systematic framework to calibrate model…

Computer Vision and Pattern Recognition · Computer Science 2024-06-14 Yongquan Qu , Juan Nathaniel , Shuolin Li , Pierre Gentine

The four-dimensional variational data assimilation methodology for assimilating noisy observations into a deterministic model has been the workhorse of forecasting centers for over three decades. While this method provides a computationally…

Optimization and Control · Mathematics 2023-07-19 Shady E Ahmed , Omer San , Sivaramakrishnan Lakshmivarahan , John M Lewis

Data assimilation provides algorithms for widespread applications in various fields. It is of practical use to deal with a large amount of information in the complex system that is hard to estimate. Weather forecasting is one of the…

Optimization and Control · Mathematics 2023-03-23 Yihua Yang

This paper develops a computational framework for optimizing the parameters of data assimilation systems in order to improve their performance. The approach formulates a continuous meta-optimization problem for parameters; the…

Computational Engineering, Finance, and Science · Computer Science 2015-06-16 Alexandru Cioaca , Adrian Sandu

This paper studies the role of sparse regularization in a properly chosen basis for variational data assimilation (VDA) problems. Specifically, it focuses on data assimilation of noisy and down-sampled observations while the state variable…

Data Analysis, Statistics and Probability · Physics 2014-06-25 A. M. Ebtehaj , M. Zupanski , G. Lerman , E. Foufoula-Georgiou

We present a convolution-based data assimilation method tailored to neuronal electrophysiology, addressing the limitations of traditional value-based synchronization approaches. While conventional methods rely on nudging terms and pointwise…

Neurons and Cognition · Quantitative Biology 2025-06-16 Dawei Li , Henry D. I. Abarbanel

Artificial Intelligence (AI) weather models are now reaching operational-grade performance for some variables, but like traditional Numerical Weather Prediction (NWP) models, they exhibit systematic biases and reliability issues. We test…

Interactive visualizations are crucial in ad hoc data exploration and analysis. However, with the growing number of massive datasets, generating visualizations in interactive timescales is increasingly challenging. One approach for…

Databases · Computer Science 2017-01-25 Yongjoo Park , Michael Cafarella , Barzan Mozafari

The accuracy of simulation-based forecasting in chaotic systems is heavily dependent on high-quality estimates of the system state at the time the forecast is initialized. Data assimilation methods are used to infer these initial conditions…

Machine Learning · Computer Science 2021-11-02 Michael McCabe , Jed Brown