English
Related papers

Related papers: Generalised Latent Assimilation in Heterogeneous R…

200 papers

A deep-learning-based surrogate model is developed and applied for predicting dynamic subsurface flow in channelized geological models. The surrogate model is based on deep convolutional and recurrent neural network architectures,…

Machine Learning · Computer Science 2020-05-20 Meng Tang , Yimin Liu , Louis J. Durlofsky

Data assimilation (DA) methods combine model predictions with observational data to improve state estimation in dynamical systems, inspiring their increasingly prominent role in geophysical and climate applications. Classical DA methods…

Numerical Analysis · Mathematics 2025-10-23 Lizuo Liu , Tongtong Li , Anne Gelb

Surrogate models provide compact relations between user-defined input parameters and output quantities of interest, enabling the efficient evaluation of complex parametric systems in many-query settings. Such capabilities are essential in a…

Numerical Analysis · Mathematics 2026-03-16 Matteo Giacomini , Pedro Díez

In this article we develop algorithms for data assimilation based upon a computational time dependent stable/unstable splitting. Our particular method is based upon shadowing refinement and synchronization techniques and is motivated by…

Dynamical Systems · Mathematics 2017-07-31 Bart de Leeuw , Svetlana Dubinkina , Jason Frank , Andrew Steyer , Xuemin Tu , Erik Van Vleck

Long-range geophysical forecasts are fundamentally limited by chaotic dynamics and numerical errors. While data assimilation can mitigate these issues, classical variational smoothers require computationally expensive tangent-linear and…

Machine Learning · Computer Science 2026-02-24 Phillip Si , Peng Chen

Taking agent-based models (ABM) closer to the data is an open challenge. This paper explicitly tackles parameter space exploration and calibration of ABMs combining supervised machine-learning and intelligent sampling to build a surrogate…

Economics · Quantitative Finance 2017-04-07 Francesco Lamperti , Andrea Roventini , Amir Sani

Shallow water equations are extensively considered in the domains of oceans, atmospheric modelling, and engineering research (Franca et al., 2022), which play significant roles in floods and tsunami governance. Nonetheless, the accurate…

Fluid Dynamics · Physics 2023-09-22 Ruijia Yu

Data assimilation (DA) plays a pivotal role in numerical weather prediction by systematically integrating sparse observations with model forecasts to estimate optimal atmospheric initial condition for forthcoming forecasts. Traditional…

Atmospheric and Oceanic Physics · Physics 2025-10-28 Jing-An Sun , Hang Fan , Junchao Gong , Ben Fei , Kun Chen , Fenghua Ling , Wenlong Zhang , Wanghan Xu , Li Yan , Pierre Gentine , Lei Bai

We demonstrate the adaption of three established methods to the field of surrogate machine learning model development. These methods are data augmentation, custom loss functions and transfer learning. Each of these methods have seen…

Machine Learning · Computer Science 2022-11-04 H. Rhys Jones , Tingting Mu , Andrei C. Popescu , Yusuf Sulehman

A method of data assimilation (DA) is employed to estimate electrophysiological parameters of neurons simultaneously with their synaptic connectivity in a small model biological network. The DA procedure is cast as an optimization, with a…

Neurons and Cognition · Quantitative Biology 2020-02-05 Eve Armstrong

The accuracy of simulation-based forecasting in chaotic systems is heavily dependent on high-quality estimates of the system state at the time the forecast is initialized. Data assimilation methods are used to infer these initial conditions…

Machine Learning · Computer Science 2021-11-02 Michael McCabe , Jed Brown

In modern large-scale machine learning applications, the training data are often partitioned and stored on multiple machines. It is customary to employ the "data parallelism" approach, where the aggregated training loss is minimized without…

Machine Learning · Computer Science 2017-08-28 Shun Zheng , Jialei Wang , Fen Xia , Wei Xu , Tong Zhang

Data assimilation (DA) combines model forecasts and observations to estimate the optimal state of the atmosphere with its uncertainty, providing initial conditions for weather prediction and reanalyses for climate research. Yet, existing…

Machine Learning · Computer Science 2026-03-05 Hang Fan , Juan Nathaniel , Yi Xiao , Ce Bian , Fenghua Ling , Ben Fei , Lei Bai , Pierre Gentine

The dominant paradigm for power system dynamic simulation is to build system-level simulations by combining physics-based models of individual components. The sheer size of the system along with the rapid integration of inverter-based…

Systems and Control · Electrical Eng. & Systems 2024-10-24 Matthew Bossart , Jose Daniel Lara , Ciaran Roberts , Rodrigo Henriquez-Auba , Duncan Callaway , Bri-Mathias Hodge

We propose a data assimilation scheme that produces the analyses for a global and an embedded limited area model simultaneously, considering forecast information from both models. The purpose of the proposed approach is twofold. First, we…

Chaotic Dynamics · Physics 2011-08-20 Young-noh Yoon , Brian R. Hunt , Edward Ott , Istvan Szunyogh

Data assimilation (DA) aims at optimally merging observational data and model outputs to create a coherent statistical and dynamical picture of the system under investigation. Indeed, DA aims at minimizing the effect of observational and…

Data Analysis, Statistics and Probability · Physics 2022-01-05 Yumeng Chen , Alberto Carrassi , Valerio Lucarini

Data assimilation (DA) enables hydrologic models to update their internal states using near-real-time observations for more accurate forecasts. With deep neural networks like long short-term memory (LSTM), using either lagged observations…

Fluid Dynamics · Physics 2025-02-25 Amirmoez Jamaat , Yalan Song , Farshid Rahmani , Jiangtao Liu , Kathryn Lawson , Chaopeng Shen

This study proposes a new discrete neural operator for surrogate modeling of transient Darcy flow fields in heterogeneous porous media with random parameters. The new method integrates temporal encoding, operator learning and UNet to…

Numerical Analysis · Mathematics 2025-12-04 Zhenglong Chen , Zhao Zhang , Xia Yan , Jiayu Zhai , Piyang Liu , Kai Zhang

We conjecture that the inherent difference in generalisation between adaptive and non-adaptive gradient methods in deep learning stems from the increased estimation noise in the flattest directions of the true loss surface. We demonstrate…

Machine Learning · Statistics 2022-03-17 Diego Granziol , Nicholas Baskerville

Data assimilation is a central problem in many geophysical applications, such as weather forecasting. It aims to estimate the state of a potentially large system, such as the atmosphere, from sparse observations, supplemented by prior…

Machine Learning · Computer Science 2024-06-24 Matthieu Blanke , Ronan Fablet , Marc Lelarge