English
Related papers

Related papers: Learning 4DVAR inversion directly from observation…

200 papers

Diverse inverse problems in imaging can be cast as variational problems composed of a task-specific data fidelity term and a regularization term. In this paper, we propose a novel learnable general-purpose regularizer exploiting recent…

Optimization and Control · Mathematics 2020-02-19 Erich Kobler , Alexander Effland , Karl Kunisch , Thomas Pock

Given a set of observations generated by an optimization process, the goal of inverse optimization is to determine likely parameters of that process. We cast inverse optimization as a form of deep learning. Our method, called deep inverse…

Machine Learning · Computer Science 2018-12-04 Yingcong Tan , Andrew Delong , Daria Terekhov

We present a supervised learning method to learn the propagator map of a dynamical system from partial and noisy observations. In our computationally cheap and easy-to-implement framework a neural network consisting of random feature maps…

Machine Learning · Computer Science 2021-10-27 Georg A. Gottwald , Sebastian Reich

In this paper, we consider domain-adaptive imitation learning with visual observation, where an agent in a target domain learns to perform a task by observing expert demonstrations in a source domain. Domain adaptive imitation learning…

Machine Learning · Computer Science 2023-12-04 Sungho Choi , Seungyul Han , Woojun Kim , Jongseong Chae , Whiyoung Jung , Youngchul Sung

Four-dimensional variational data assimilation (4D-Var) on a seasonal-to-interdecadal time scale under the existence of unstable modes can be viewed as an optimization problem of synchronized, coupled chaotic systems. The problem is tackled…

Data Analysis, Statistics and Probability · Physics 2015-11-17 Nozomi Sugiura , Shuhei Masuda , Yosuke Fujii , Masafumi Kamachi , Yoichi Ishikawa , Toshiyuki Awaji

Symmetry transformations induce invariances which are frequently described with deep latent variable models. In many complex domains, such as the chemical space, invariances can be observed, yet the corresponding symmetry transformation…

Machine Learning · Computer Science 2020-10-23 Mario Wieser , Sonali Parbhoo , Aleksander Wieczorek , Volker Roth

Motivated by recent progress in data assimilation, we develop an algorithm to dynamically learn the parameters of a chaotic system from partial observations. Under reasonable assumptions, we rigorously establish the convergence of this…

Classical Analysis and ODEs · Mathematics 2021-08-20 Elizabeth Carlson , Joshua Hudson , Adam Larios , Vincent R. Martinez , Eunice Ng , Jared P. Whitehead

Data-driven prediction and physics-agnostic machine-learning methods have attracted increased interest in recent years achieving forecast horizons going well beyond those to be expected for chaotic dynamical systems. In a separate strand of…

Data Analysis, Statistics and Probability · Physics 2021-05-19 Georg A. Gottwald , Sebastian Reich

This paper presents a practical computational approach to quantify the effect of individual observations in estimating the state of a system. Such an analysis can be used for pruning redundant measurements, and for designing future sensor…

Computational Engineering, Finance, and Science · Computer Science 2013-07-22 Alexandru Cioaca , Adrian Sandu , Eric de Sturler

Designing learning systems which are invariant to certain data transformations is critical in machine learning. Practitioners can typically enforce a desired invariance on the trained model through the choice of a network architecture, e.g.…

Machine Learning · Computer Science 2022-10-26 Cédric Rommel , Thomas Moreau , Alexandre Gramfort

The nudging data assimilation algorithm is a powerful tool used to forecast phenomena of interest given incomplete and noisy observations. Machine learning is becoming increasingly popular in data assimilation given its ease of computation…

Numerical Analysis · Mathematics 2021-11-24 Harbir Antil , Rainald Löhner , Randy Price

The integration of observational data into numerical models, known as data assimilation (DA), is fundamental for making Numerical Weather Prediction (NWP) possible, with breathtaking success over the past 60 years (Bauer et al. 2015).…

Atmospheric and Oceanic Physics · Physics 2024-06-04 Jan D. Keller , Roland Potthast

Four-dimensional variational data assimilation (4DVAR) is a cornerstone of numerical weather prediction, but its cost function is difficult to optimize and computationally intensive. We propose a neural field-based reformulation in which…

Machine Learning · Computer Science 2025-09-29 Jaemin Oh

This work introduces a new class of four-dimensional variational data assimilation (4D-Var) methods grounded in data-consistent inversion (DCI) theory. The methods extend classical 4D-Var by incorporating a predictability-aware…

Numerical Analysis · Mathematics 2025-11-04 Rylan Spence , Troy Butler , Clint Dawson

We propose $\textit{iterative inversion}$ -- an algorithm for learning an inverse function without input-output pairs, but only with samples from the desired output distribution and access to the forward function. The key challenge is a…

Machine Learning · Computer Science 2023-05-31 Gal Leibovich , Guy Jacob , Or Avner , Gal Novik , Aviv Tamar

This paper studies the role of sparse regularization in a properly chosen basis for variational data assimilation (VDA) problems. Specifically, it focuses on data assimilation of noisy and down-sampled observations while the state variable…

Data Analysis, Statistics and Probability · Physics 2014-06-25 A. M. Ebtehaj , M. Zupanski , G. Lerman , E. Foufoula-Georgiou

State estimates from weak constraint 4D-Var data assimilation can vary significantly depending on the data and model error covariances. As a result, the accuracy of these estimates heavily depends on the correct specification of both model…

Methodology · Statistics 2025-04-28 Sandra R. Babyale , Jodi Mead , Donna Calhoun , Patricia O. Azike

In this work, we aim at studying ensemble based optimal control strategies for data assimilation. Such formulation nicely combines the ingredients of ensemble Kalman filters and variational data assimilation (4DVar). In the same way as…

Mathematical Physics · Physics 2014-01-17 Yin Yang , Cordelia Robinson , Dominique Heitz , Etienne Mémin

Regardless of the marked differences between biological and artificial neural systems, one fundamental similarity is that they are essentially dynamical systems that can learn to imitate other dynamical systems, without knowing their…

Neurons and Cognition · Quantitative Biology 2019-11-06 Zhixin Lu , Danielle S. Bassett

A key a priori information used in 4DVar is the knowledge of the system's evolution equations. In this paper we propose a method for taking full advantage of the knowledge of the system's dynamical instabilities in order to improve the…

Chaotic Dynamics · Physics 2009-11-18 Anna Trevisan , Massimo D'Isidoro , Olivier Talagrand