English
Related papers

Related papers: Adjoint-Matching Neural Network Surrogates for Fas…

200 papers

In this article we develop algorithms for data assimilation based upon a computational time dependent stable/unstable splitting. Our particular method is based upon shadowing refinement and synchronization techniques and is motivated by…

Dynamical Systems · Mathematics 2017-07-31 Bart de Leeuw , Svetlana Dubinkina , Jason Frank , Andrew Steyer , Xuemin Tu , Erik Van Vleck

This paper provides a detailed theoretical analysis of methods to approximate the solutions of high-dimensional (>10^6) linear Bayesian problems. An optimal low-rank projection that maximizes the information content of the Bayesian…

Data Analysis, Statistics and Probability · Physics 2019-10-28 Nicolas Bousserez , Daven K. Henze

This paper discusses the practical use of the saddle variational formulation for the weakly-constrained 4D-VAR method in data assimilation. It is shown that the method, in its original form, may produce erratic results or diverge because of…

Numerical Analysis · Mathematics 2021-05-31 S. Gratton , S. Gürol , E. Simon , Ph. L. Toint

We introduce the concept of decision-focused surrogate modeling for solving computationally challenging nonlinear optimization problems in real-time settings. The proposed data-driven framework seeks to learn a simpler, e.g. convex,…

Optimization and Control · Mathematics 2023-12-27 Rishabh Gupta , Qi Zhang

Data assimilation refers to the process of obtaining an estimate of a system's state using a model for the system's time evolution and a time series of measurements that are possibly noisy and incomplete. However, for practical reasons, the…

Chaotic Dynamics · Physics 2007-05-23 Matthew Cornick , Brian Hunt , Edward Ott , Michael F. Schatz

Variational data assimilation optimizes for an initial state of a dynamical system such that its evolution fits observational data. The physical model can subsequently be evolved into the future to make predictions. This principle is a…

Machine Learning · Computer Science 2021-05-21 Thomas Frerix , Dmitrii Kochkov , Jamie A. Smith , Daniel Cremers , Michael P. Brenner , Stephan Hoyer

Variational data assimilation and deep learning share many algorithmic aspects in common. While the former focuses on system state estimation, the latter provides great inductive biases to learn complex relationships. We here design a…

Machine Learning · Computer Science 2022-11-18 Arthur Filoche , Julien Brajard , Anastase Charantonis , Dominique Béréziat

In this article we develop further an algorithm for data assimilation based upon a shadowing refinement technique [de Leeuw et al., SIAM J. Appl. Dyn. Sys., 17 (2018)] to take partial observations into account. Our method is based on…

Optimization and Control · Mathematics 2020-11-13 Bart de Leeuw , Svetlana Dubinkina

Adjoint-based optimization methods are attractive for aerodynamic shape design primarily due to their computational costs being independent of the dimensionality of the input space and their ability to generate high-fidelity gradients that…

Computational Physics · Physics 2020-08-18 S. Ashwin Renganathan , Romit Maulik and , Jai Ahuja

In the past couple of years, there is a proliferation in the use of machine learning approaches to represent subgrid scale processes in geophysical flows with an aim to improve the forecasting capability and to accelerate numerical…

Computational Physics · Physics 2021-04-13 Suraj Pawar , Omer San

We consider the problem of constructing surrogate operators for parameter-to-solution maps arising from parametric partial differential equations, where repeated forward model evaluations are computationally expensive. We present a…

Machine Learning · Computer Science 2026-04-02 Josephine Westermann , Benno Huber , Thomas O'Leary-Roseberry , Jakob Zech

Variational data assimilation is a technique for combining measured data with dynamical models. It is a key component of Earth system state estimation and is commonly used in weather and ocean forecasting. The approach involves a…

Numerical Analysis · Mathematics 2026-04-30 I. Daužickaitė , M. A. Freitag , S. Gürol , A. S. Lawless , A. Ramage , J. A. Scott , J. M. Tabeart

Data assimilation addresses the problem of identifying plausible state trajectories of dynamical systems given noisy or incomplete observations. In geosciences, it presents challenges due to the high-dimensionality of geophysical dynamical…

Machine Learning · Statistics 2023-11-03 François Rozet , Gilles Louppe

This paper proposes a technique for training a neural network by minimizing a surrogate loss that approximates the target evaluation metric, which may be non-differentiable. The surrogate is learned via a deep embedding where the Euclidean…

Computer Vision and Pattern Recognition · Computer Science 2020-07-20 Yash Patel , Tomas Hodan , Jiri Matas

Four-dimensional weak-constraint variational data assimilation estimates a state given partial noisy observations and dynamical model by minimizing a cost function that takes into account both discrepancy between the state and observations…

Dynamical Systems · Mathematics 2023-04-13 Nazanin Abedini , Svetlana Dubinkina

Four-dimensional variational data assimilation (4D-Var) on a seasonal-to-interdecadal time scale under the existence of unstable modes can be viewed as an optimization problem of synchronized, coupled chaotic systems. The problem is tackled…

Data Analysis, Statistics and Probability · Physics 2015-11-17 Nozomi Sugiura , Shuhei Masuda , Yosuke Fujii , Masafumi Kamachi , Yoichi Ishikawa , Toshiyuki Awaji

Incremental 4D-Var is a data assimilation algorithm used routinely at operational numerical weather predictions centers worldwide.This paper implements a new method for parallelizing incremental 4D-Var, the Randomized Incremental Optimal…

Numerical Analysis · Mathematics 2024-09-23 Nicolas Bousserez , Jonathan J. Guerrette , Daven K. Henze

An intrinsic property of almost any physical measuring device is that it makes observations which are slightly blurred in time. We consider a nudging-based approach for data assimilation that constructs an approximate solution based on a…

Analysis of PDEs · Mathematics 2018-09-05 Michael S. Jolly , Vincent R. Martinez , Eric J. Olson , Edriss S. Titi

Neural networks are increasingly used in complex (data-driven) simulations as surrogates or for accelerating the computation of classical surrogates. In many applications physical constraints, such as mass or energy conservation, must be…

Computational Physics · Physics 2020-02-25 Jim Magiera , Deep Ray , Jan S. Hesthaven , Christian Rohde

Data assimilation combines (imperfect) knowledge of a flow's physical laws with (noisy, time-lagged, and otherwise imperfect) observations to produce a more accurate prediction of flow statistics. Assimilation by nudging (from 1964), while…

Numerical Analysis · Mathematics 2024-07-31 Aytekin Çıbık , Rui Fang , William Layton , Farjana Siddiqua