English
Related papers

Related papers: LEVDA: Latent Ensemble Variational Data Assimilati…

200 papers

Data assimilation (DA) improves prediction of chaotic systems by combining model forecasts with sparse, noisy observations. Many DA methods are inherently probabilistic, but accurate probabilistic DA is often computationally expensive…

Fluid Dynamics · Physics 2026-04-24 Aditya Sai Pranith Ayapilla , Kazuya Miyashita , Yuki Yasuda , Ryo Onishi

Data assimilation techniques are often confronted with challenges handling complex high dimensional physical systems, because high precision simulation in complex high dimensional physical systems is computationally expensive and the exact…

Mathematical Software · Computer Science 2024-09-04 Sibo Cheng , Jinyang Min , Che Liu , Rossella Arcucci

Data assimilation (DA) enables hydrologic models to update their internal states using near-real-time observations for more accurate forecasts. With deep neural networks like long short-term memory (LSTM), using either lagged observations…

Fluid Dynamics · Physics 2025-02-25 Amirmoez Jamaat , Yalan Song , Farshid Rahmani , Jiangtao Liu , Kathryn Lawson , Chaopeng Shen

During the last few years discontinuous Galerkin (DG) methods have received increased interest from the geophysical community. In these methods the solution in each grid cell is approximated as a linear combination of basis functions.…

Atmospheric and Oceanic Physics · Physics 2025-02-19 Ivo Pasmans , Yumeng Chen , Alberto Carrassi , Chris K. R. T. Jones

4D-variational data assimilation is applied to the Lorenz '63 model to introduce a new method for parameter estimation in chaotic climate models. The approach aims to optimise an Earth system model (ESM), for which no adjoint exists, by…

Atmospheric and Oceanic Physics · Physics 2025-04-18 Philip David Kennedy , Abhirup Banerjee , Armin Köhl , Detlef Stammer

Understanding the structure of complex, nonstationary, high-dimensional time-evolving signals is a central challenge in scientific data analysis. In many domains, such as speech and biomedical signal processing, the ability to learn…

Machine Learning · Computer Science 2026-01-13 Ioannis Ziogas , Aamna Al Shehhi , Ahsan H. Khandoker , Leontios J. Hadjileontiadis

This paper is a contribution in the context of variational data assimilation combined with statistical learning. The framework of data assimilation traditionally uses data collected at sensor locations in order to bring corrections to a…

Numerical Analysis · Mathematics 2023-05-09 Amina Benaceur , Barbara Verfürth

Four-dimensional variational data assimilation (4DVar) has become an increasingly important tool in data science with wide applications in many engineering and scientific fields such as geoscience1-12, biology13 and the financial…

Data Analysis, Statistics and Probability · Physics 2018-05-28 Xiangjun Tian , Aiguo Dai , Xiaobing Feng , Hongqin Zhang , Rui Han , Lu Zhang

The past several years have witnessed Variational Auto-Encoder's superiority in various text generation tasks. However, due to the sequential nature of the text, auto-regressive decoders tend to ignore latent variables and then reduce to…

Computation and Language · Computer Science 2022-10-24 Jinyi Hu , Xiaoyuan Yi , Wenhao Li , Maosong Sun , Xing Xie

Popular (ensemble) Kalman filter data assimilation (DA) approaches assume that the errors in both the a priori estimate of the state and those in the observations are Gaussian. For constrained variables, e.g. sea ice concentration or…

Machine Learning · Computer Science 2025-02-19 Ivo Pasmans , Yumeng Chen , Tobias Sebastian Finn , Marc Bocquet , Alberto Carrassi

We revisit Deep Linear Discriminant Analysis (Deep LDA) from a likelihood-based perspective. While classical LDA is a simple Gaussian model with linear decision boundaries, attaching an LDA head to a neural encoder raises the question of…

Machine Learning · Statistics 2026-02-23 Maxat Tezekbayev , Arman Bolatov , Zhenisbek Assylbekov

The generation of initial conditions via accurate data assimilation is crucial for weather forecasting and climate modeling. We propose DiffDA as a denoising diffusion model capable of assimilating atmospheric variables using predicted…

Computational Engineering, Finance, and Science · Computer Science 2024-06-11 Langwen Huang , Lukas Gianinazzi , Yuejiang Yu , Peter D. Dueben , Torsten Hoefler

Urban wind flow reconstruction is essential for assessing air quality, heat dispersion, and pedestrian comfort, yet remains challenging when only sparse sensor data are available. We propose GenDA, a generative data assimilation framework…

Machine Learning · Computer Science 2026-02-18 Francisco Giral , Álvaro Manzano , Ignacio Gómez , Ricardo Vinuesa , Soledad Le Clainche

Dynamic downscaling typically involves using numerical weather prediction (NWP) solvers to refine coarse data to higher spatial resolutions. Data-driven models such as FourCastNet have emerged as a promising alternative to the traditional…

Atmospheric and Oceanic Physics · Physics 2025-03-05 Philip Dinenis , Vishwas Rao , Mihai Anitescu

We propose two new methods based/inspired by machine learning for tabular data and distance-free localization to enhance the covariance estimations in an ensemble data assimilation. The main goal is to enhance the data assimilation results…

Machine Learning · Computer Science 2025-07-31 Vinicius L. S. Silva , Gabriel S. Seabra , Alexandre A. Emerick

Data-driven machine learning (ML) models are reshaping weather forecasting and have shown the potential to accelerate and surpass traditional physics-based approaches, leading to a second revolution in the field after data assimilation.…

Machine Learning · Computer Science 2026-05-19 Hang Fan , Yi Xiao , Yongquan Qu , Juan Nathaniel , Fenghua Ling , Ben Fei , Lei Bai , Pierre Gentine

This paper presents a novel generative framework for learning shared latent representations across multimodal data. Many advanced multimodal methods focus on capturing all combinations of modality-specific details across inputs, which can…

Machine Learning · Computer Science 2025-08-26 Jiali Cui , Yan-Ying Chen , Yanxia Zhang , Matthew Klenk

In this work, we aim at studying ensemble based optimal control strategies for data assimilation. Such formulation nicely combines the ingredients of ensemble Kalman filters and variational data assimilation (4DVar). In the same way as…

Mathematical Physics · Physics 2014-01-17 Yin Yang , Cordelia Robinson , Dominique Heitz , Etienne Mémin

We present a deep-learning Variational Encoder-Decoder (VED) framework for learning data-driven low-dimensional representations of the relationship between high-dimensional parameters of a physical system and the system's high-dimensional…

Machine Learning · Computer Science 2024-12-09 Subashree Venkatasubramanian , David A. Barajas-Solano

This paper addresses the impact of assimilating data from the Earth Networks Total Lightning Network (ENTLN) during two cases of severe weather. Data from the ENTLN serve as a substitute for those from the upcoming launch of the GOES…

Optimization and Control · Mathematics 2013-06-11 Razvan Stefanescu , I. Michael Navon , Henry Fuelberg , Max Marchand