English
Related papers

Related papers: Variational Data Assimilation with a Learned Inver…

200 papers

Data assimilation aims to estimate the states of a dynamical system by optimally combining sparse and noisy observations of the physical system with uncertain forecasts produced by a computational model. The states of many dynamical systems…

Optimization and Control · Mathematics 2024-05-08 Amit N. Subrahmanya , Andrey A. Popov , Reid J. Gomillion , Adrian Sandu

Variational data assimilation and deep learning share many algorithmic aspects in common. While the former focuses on system state estimation, the latter provides great inductive biases to learn complex relationships. We here design a…

Machine Learning · Computer Science 2022-11-18 Arthur Filoche , Julien Brajard , Anastase Charantonis , Dominique Béréziat

We show how the 3DVAR data assimilation methodology can be used in the astrophysical context of a two-dimensional convection flow. We study the way this variational approach finds best estimates of the current state of the flow from a…

Solar and Stellar Astrophysics · Physics 2013-08-09 Andreas Svedin , Milena C. Cuellar , Axel Brandenburg

Data-driven methods have demonstrated strong predictive capabilities in fluid mechanics, yet most current applications still focus on simplified configurations, often characterised by statistical stationarity or limited temporal…

Fluid Dynamics · Physics 2025-11-21 Miguel M. Valero , Marcello Meldi

Data assimilation (DA) aims at optimally merging observational data and model outputs to create a coherent statistical and dynamical picture of the system under investigation. Indeed, DA aims at minimizing the effect of observational and…

Data Analysis, Statistics and Probability · Physics 2022-01-05 Yumeng Chen , Alberto Carrassi , Valerio Lucarini

Improved estimation of hydrometeorological states from down-sampled observations and background model forecasts in a noisy environment, has been a subject of growing research in the past decades. Here, we introduce a unified framework that…

Data Analysis, Statistics and Probability · Physics 2014-09-15 Ardeshir Mohammad Ebtehaj , Efi Foufoula-Georgiou

Ensemble data assimilation techniques form an indispensable part of numerical weather prediction. As the ensemble size grows and model resolution increases, the amount of required storage becomes a major issue. Data compression schemes may…

Data assimilation combines information from physical observations and numerical simulation results to obtain better estimates of the state and parameters of a physical system. A wide class of physical systems of interest have solutions that…

Optimization and Control · Mathematics 2025-05-02 Amit N. Subrahmanya , Adrian Sandu

We address the problem of estimating the inputs of a dynamical system from measurements of the system's outputs. To this end, we introduce a novel estimation algorithm that explicitly trades off bias and variance to optimally reduce the…

Machine Learning · Computer Science 2019-09-20 Sebastian Curi , Kfir Y. Levy , Andreas Krause

Data-driven machine learning (ML) models are reshaping weather forecasting and have shown the potential to accelerate and surpass traditional physics-based approaches, leading to a second revolution in the field after data assimilation.…

Machine Learning · Computer Science 2026-05-19 Hang Fan , Yi Xiao , Yongquan Qu , Juan Nathaniel , Fenghua Ling , Ben Fei , Lei Bai , Pierre Gentine

Variational Data Assimilation (DA) has been broadly used in engineering problems for field reconstruction and prediction by performing a weighted combination of multiple sources of noisy data. In recent years, the integration of deep…

Machine Learning · Computer Science 2023-10-26 Sibo Cheng , Che Liu , Yike Guo , Rossella Arcucci

A thermal convection loop is a annular chamber filled with water, heated on the bottom half and cooled on the top half. With sufficiently large forcing of heat, the direction of fluid flow in the loop oscillates chaotically, dynamics…

Dynamical Systems · Mathematics 2016-06-24 Andrew J. Reagan , Yves Dubief , Peter Sheridan Dodds , Christopher M. Danforth

A framework for data assimilation combining aspects of operator-theoretic ergodic theory and quantum mechanics is developed. This framework adapts the Dirac--von Neumann formalism of quantum dynamics and measurement to perform sequential…

Mathematical Physics · Physics 2019-09-18 Dimitrios Giannakis

Chaos is ubiquitous in physical systems. The associated sensitivity to initial conditions is a significant obstacle in forecasting the weather and other geophysical fluid flows. Data assimilation is the process whereby the uncertainty in…

Data Analysis, Statistics and Probability · Physics 2020-11-03 Alberto Carrassi , Marc Bocquet , Jonathan Demaeyer , Colin Grudzien , Patrick Raanes , Stephane Vannitsem

Understanding and predicting people flow in urban areas is useful for decision-making in urban planning and marketing strategies. Traditional methods for understanding people flow can be divided into measurement-based approaches and…

Human-Computer Interaction · Computer Science 2024-01-18 Ryo Murata , Kenji Tanaka

We commonly refer to state-estimation theory in geosciences as data assimilation. This term encompasses the entire sequence of operations that, starting from the observations of a system, and from additional statistical and dynamical…

Atmospheric and Oceanic Physics · Physics 2018-06-11 Alberto Carrassi , Marc Bocquet , Laurent Bertino , Geir Evensen

Extensive numerical evidence shows that the assimilation of observations has a stabilizing effect on unstable dynamics, in numerical weather prediction and elsewhere. In this paper, we apply mathematically rigorous methods to showing why…

Statistics Theory · Mathematics 2023-03-08 Dan Crisan , Michael Ghil

In data-driven inverse optimization an observer aims to learn the preferences of an agent who solves a parametric optimization problem depending on an exogenous signal. Thus, the observer seeks the agent's objective function that best…

Optimization and Control · Mathematics 2017-07-25 Peyman Mohajerin Esfahani , Soroosh Shafieezadeh-Abadeh , Grani Adiwena Hanasusanto , Daniel Kuhn

In this study, two classes of methods including statistical and variational data assimilation algorithms will be described. In statistical methods, the model state is updated sequentially based on the previous estimate. Variational methods,…

Systems and Control · Electrical Eng. & Systems 2021-10-25 Loc Luong

A variational model for learning convolutional image atoms from corrupted and/or incomplete data is introduced and analyzed both in function space and numerically. Building on lifting and relaxation strategies, the proposed approach is…

Optimization and Control · Mathematics 2018-12-10 Antonin Chambolle , Martin Holler Thomas Pock