English
Related papers

Related papers: Learning Variational Data Assimilation Models and …

200 papers

Data assimilation is uniquely challenging in weather forecasting due to the high dimensionality of the employed models and the nonlinearity of the governing equations. Although current operational schemes are used successfully, our…

Atmospheric and Oceanic Physics · Physics 2018-05-09 Lea Oljača , Jochen Bröcker , Tobias Kuna

The integration of observational data into numerical models, known as data assimilation (DA), is fundamental for making Numerical Weather Prediction (NWP) possible, with breathtaking success over the past 60 years (Bauer et al. 2015).…

Atmospheric and Oceanic Physics · Physics 2024-06-04 Jan D. Keller , Roland Potthast

The identification of the governing equations of chaotic dynamical systems from data has recently emerged as a hot topic. While the seminal work by Brunton et al. reported proof-of-concepts for idealized observation setting for…

Machine Learning · Computer Science 2019-03-26 Duong Nguyen , Said Ouala , Lucas Drumetz , Ronan Fablet

This paper applies variational data assimilation to inundation problems governed by the shallow water equations with wetting and drying. The objective of the assimilation is to recover an unknown time-varying wave profile at an open ocean…

Fluid Dynamics · Physics 2017-06-07 S. W Funke , P. E Farrell , M. D. Piggott

We propose an unsupervised approach for learning end-to-end reconstruction operators for ill-posed inverse problems. The proposed method combines the classical variational framework with iterative unrolling, which essentially seeks to…

Computer Vision and Pattern Recognition · Computer Science 2021-06-08 Subhadip Mukherjee , Marcello Carioni , Ozan Öktem , Carola-Bibiane Schönlieb

Variational Data Assimilation (DA) has been broadly used in engineering problems for field reconstruction and prediction by performing a weighted combination of multiple sources of noisy data. In recent years, the integration of deep…

Machine Learning · Computer Science 2023-10-26 Sibo Cheng , Che Liu , Yike Guo , Rossella Arcucci

Data assimilation techniques are widely used to predict complex dynamical systems with uncertainties, based on time-series observation data. Error covariance matrices modelling is an important element in data assimilation algorithms which…

Machine Learning · Computer Science 2021-11-15 Sibo Cheng , Mingming Qiu

Data assimilation refers to the process of obtaining an estimate of a system's state using a model for the system's time evolution and a time series of measurements that are possibly noisy and incomplete. However, for practical reasons, the…

Chaotic Dynamics · Physics 2007-05-23 Matthew Cornick , Brian Hunt , Edward Ott , Michael F. Schatz

Purpose: To allow fast and high-quality reconstruction of clinical accelerated multi-coil MR data by learning a variational network that combines the mathematical structure of variational models with deep learning. Theory and Methods:…

Computer Vision and Pattern Recognition · Computer Science 2017-04-04 Kerstin Hammernik , Teresa Klatzer , Erich Kobler , Michael P Recht , Daniel K Sodickson , Thomas Pock , Florian Knoll

In this article we develop algorithms for data assimilation based upon a computational time dependent stable/unstable splitting. Our particular method is based upon shadowing refinement and synchronization techniques and is motivated by…

Dynamical Systems · Mathematics 2017-07-31 Bart de Leeuw , Svetlana Dubinkina , Jason Frank , Andrew Steyer , Xuemin Tu , Erik Van Vleck

A central challenge in data visualization is to understand which data samples are required to generate an image of a data set in which the relevant information is encoded. In this work, we make a first step towards answering the question of…

Graphics · Computer Science 2021-03-12 Sebastian Weiss , Mustafa Işık , Justus Thies , Rüdiger Westermann

We propose closed-form conditional diffusion models for data assimilation. Diffusion models use data to learn the score function (defined as the gradient of the log-probability density of a data distribution), allowing them to generate new…

Machine Learning · Statistics 2026-04-02 Brianna Binder , Agnimitra Dasgupta , Assad Oberai

We provide a clear and concise introduction to the subjects of inverse problems and data assimilation, and their inter-relations. The first part of our notes covers inverse problems; this refers to the study of how to estimate unknown model…

Methodology · Statistics 2023-02-15 Daniel Sanz-Alonso , Andrew M. Stuart , Armeen Taeb

A variational model for learning convolutional image atoms from corrupted and/or incomplete data is introduced and analyzed both in function space and numerically. Building on lifting and relaxation strategies, the proposed approach is…

Optimization and Control · Mathematics 2018-12-10 Antonin Chambolle , Martin Holler Thomas Pock

Learning an explainable classifier often results in low accuracy model or ends up with a huge rule set, while learning a deep model is usually more capable of handling noisy data at scale, but with the cost of hard to explain the result and…

Artificial Intelligence · Computer Science 2022-11-11 Yuanlong Li , Gaopan Huang , Min Zhou , Chuan Fu , Honglin Qiao , Yan He

Data assimilation (DA) enables hydrologic models to update their internal states using near-real-time observations for more accurate forecasts. With deep neural networks like long short-term memory (LSTM), using either lagged observations…

Fluid Dynamics · Physics 2025-02-25 Amirmoez Jamaat , Yalan Song , Farshid Rahmani , Jiangtao Liu , Kathryn Lawson , Chaopeng Shen

Resampling is a key component of sample-based recursive state estimation in particle filters. Recent work explores differentiable particle filters for end-to-end learning. However, resampling remains a challenge in these works, as it is…

Machine Learning · Computer Science 2020-04-28 Michael Zhu , Kevin Murphy , Rico Jonschkowski

In this paper, we develop a new optimization framework for the least squares learning problem via fully connected neural networks or physics-informed neural networks. The gradient descent sometimes behaves inefficiently in deep learning…

Machine Learning · Computer Science 2025-05-01 Yaru Liu , Yiqi Gu , Michael K. Ng

Variational data assimilation and machine-learning based super-resolution are two alternative approaches to state estimation in turbulent flows. The former is an optimisation problem featuring a time series of coarse observations, the…

Fluid Dynamics · Physics 2025-10-21 Markus Weyrauch , Moritz Linkmann , Jacob Page

We identify a strong equivalence between neural network based machine learning (ML) methods and the formulation of statistical data assimilation (DA), known to be a problem in statistical physics. DA, as used widely in physical and…

Machine Learning · Computer Science 2017-10-23 H. D. I. Abarbanel , P. J. Rozdeba , S. Shirman