English
Related papers

Related papers: Neural Incremental Data Assimilation

200 papers

Given a decision process based on the approximate probability density function returned by a data assimilation algorithm, an interaction level between the decision making level and the data assimilation level is designed to incorporate the…

Computation · Statistics 2015-03-19 Gabriel Terejanu , Puneet Singla , Tarunraj Singh , Peter D. Scott

Data assimilation algorithms integrate prior information from numerical model simulations with observed data. Ensemble-based filters, regarded as state-of-the-art, are widely employed for large-scale estimation tasks in disciplines such as…

Numerical Analysis · Mathematics 2024-05-24 Iris Rammelmüller , Gottfried Hastermann , Jana de Wiljes

Data assimilation (DA) aims at optimally merging observational data and model outputs to create a coherent statistical and dynamical picture of the system under investigation. Indeed, DA aims at minimizing the effect of observational and…

Data Analysis, Statistics and Probability · Physics 2022-01-05 Yumeng Chen , Alberto Carrassi , Valerio Lucarini

The requirements of modern sensing are rapidly evolving, driven by increasing demands for data efficiency, real-time processing, and deployment under limited sensing coverage. Complex physical systems are often characterized through the…

Machine Learning · Computer Science 2025-12-02 Yuxuan Bao , J. Nathan Kutz

The spatio-temporal interpolation of large geophysical datasets has historically been addressed by Optimal Interpolation (OI) and more sophisticated equation-based or data-driven Data Assimilation (DA) techniques. Recent advances in the…

Reconstructing ocean dynamics from observational data is fundamentally limited by the sparse, irregular, and Lagrangian nature of spatial sampling, particularly in subsurface and remote regions. This sparsity poses significant challenges…

Atmospheric and Oceanic Physics · Physics 2025-07-10 Niloofar Asefi , Leonard Lupin-Jimenez , Tianning Wu , Ruoying He , Ashesh Chattopadhyay

Accurate weather and climate prediction relies on data assimilation (DA), which estimates the Earth system state by integrating observations with models. While exascale computing has significantly advanced earth simulation, scalable and…

Improved estimation of hydrometeorological states from down-sampled observations and background model forecasts in a noisy environment, has been a subject of growing research in the past decades. Here, we introduce a unified framework that…

Data Analysis, Statistics and Probability · Physics 2014-09-15 Ardeshir Mohammad Ebtehaj , Efi Foufoula-Georgiou

We propose closed-form conditional diffusion models for data assimilation. Diffusion models use data to learn the score function (defined as the gradient of the log-probability density of a data distribution), allowing them to generate new…

Machine Learning · Statistics 2026-04-02 Brianna Binder , Agnimitra Dasgupta , Assad Oberai

Complex systems are often described with competing models. Such divergence of interpretation on the system may stem from model fidelity, mathematical simplicity, and more generally, our limited knowledge of the underlying processes.…

Numerical Analysis · Mathematics 2017-07-21 Lun Yang , Akil Narayan , Peng Wang

This article develops a novel data assimilation methodology, addressing challenges that are common in real-world settings, such as severe sparsity of observations, lack of reliable models, and non-stationarity of the system dynamics. These…

Optimization and Control · Mathematics 2024-11-05 David J. Abers , George Hripcsak , Lena Mamykina , Melike Sirlanci , Esteban G. Tabak

Compressing large data sets to a manageable number of summaries that are informative about the underlying parameters vastly simplifies both frequentist and Bayesian inference. When only simulations are available, these summaries are…

Instrumentation and Methods for Astrophysics · Physics 2018-08-06 Tom Charnock , Guilhem Lavaux , Benjamin D. Wandelt

Imitation learning enables robots to learn and replicate human behavior from training data. Recent advances in machine learning enable end-to-end learning approaches that directly process high-dimensional observation data, such as images.…

Robotics · Computer Science 2024-01-22 Koki Yamane , Sho Sakaino , Toshiaki Tsuji

We propose a new family of neural networks to predict the behaviors of physical systems by learning their underpinning constraints. A neural projection operator lies at the heart of our approach, composed of a lightweight network with an…

Neural and Evolutionary Computing · Computer Science 2020-12-15 Shuqi Yang , Xingzhe He , Bo Zhu

Particle filters are computational techniques for estimating the state of dynamical systems by integrating observational data with model predictions. This work introduces a class of Localized Particle Filters (LPFs) that exploit spatial…

Applications · Statistics 2025-07-10 Dan Crisan , Eliana Fausti

Deep metric learning maps visually similar images onto nearby locations and visually dissimilar images apart from each other in an embedding manifold. The learning process is mainly based on the supplied image negative and positive training…

Computer Vision and Pattern Recognition · Computer Science 2020-09-14 Chang-Hui Liang , Wan-Lei Zhao , Run-Qing Chen

Traditional data assimilation uses information obtained from the propagation of one physics-driven model and combines it with information derived from real-world observations in order to obtain a better estimate of the truth of some natural…

Computational Engineering, Finance, and Science · Computer Science 2022-10-24 Andrey A Popov , Adrian Sandu

Ensemble data assimilation techniques form an indispensable part of numerical weather prediction. As the ensemble size grows and model resolution increases, the amount of required storage becomes a major issue. Data compression schemes may…

Machine learning techniques are powerful tools for construction of emulators for complex systems. We explore different machine learning methods and conceptual methodologies, ranging from functional approximations to dynamical…

Dynamical Systems · Mathematics 2021-01-01 Hannah Lu , Dinara Ermakova , Haruko Murakami Wainwright , Liange Zheng , Daniel M. Tartakovsky

An alternative data-driven modeling approach has been proposed and employed to gain fundamental insights into robot motion interaction with granular terrain at certain length scales. The approach is based on an integration of dimension…

Robotics · Computer Science 2025-06-13 Guanjin Wang , Xiangxue Zhao , Shapour Azarm , Balakumar Balachandran