English
Related papers

Related papers: Using Data Assimilation to Train a Hybrid Forecast…

200 papers

In meteorology, engineering and computer sciences, data assimilation is routinely employed as the optimal way to combine noisy observations with prior model information for obtaining better estimates of a state, and thus better forecasts,…

Geophysics · Physics 2009-08-12 M. J. Werner , K. Ide , D. Sornette

There is growing interest in data-driven weather prediction (DDWP), for example using convolutional neural networks such as U-NETs that are trained on data from models or reanalysis. Here, we propose 3 components to integrate with commonly…

Atmospheric and Oceanic Physics · Physics 2025-07-04 Ashesh Chattopadhyay , Mustafa Mustafa , Pedram Hassanzadeh , Eviatar Bach , Karthik Kashinath

Ensemble data assimilation in flood forecasting depends strongly on the density, frequency and statistics of errors associated with the observation network. This work focuses on the assimilation of 2D flood extent data, expressed in terms…

Image and Video Processing · Electrical Eng. & Systems 2023-05-24 Thanh Huy Nguyen , Sophie Ricci , Andrea Piacentini , Raquel Rodriguez Suquet , Gwendoline Blanchet , Santiago Pena Luque , Peter Kettig

We consider the problem of learning the dynamics of a linear system when one has access to data generated by an auxiliary system that shares similar (but not identical) dynamics, in addition to data from the true system. We use a weighted…

Machine Learning · Statistics 2025-01-20 Lei Xin , Lintao Ye , George Chiu , Shreyas Sundaram

Traditional data assimilation uses information obtained from the propagation of one physics-driven model and combines it with information derived from real-world observations in order to obtain a better estimate of the truth of some natural…

Computational Engineering, Finance, and Science · Computer Science 2022-10-24 Andrey A Popov , Adrian Sandu

Accurate prediction of atmospheric optical turbulence in localized environments is essential for estimating the performance of free-space optical systems. Macro-meteorological models developed to predict turbulent effects in one environment…

Atmospheric and Oceanic Physics · Physics 2023-10-30 Christopher Jellen , Charles Nelson , John Burkhardt , Cody Brownell

We develop data-driven algorithms to fully automate sensor fault detection in systems governed by underlying physics. The proposed machine learning method uses a time series of typical behavior to approximate the evolution of measurements…

We scrutinize the use of machine learning, based on reservoir computing, to build data-driven effective models of multiscale chaotic systems. We show that, for a wide scale separation, machine learning generates effective models akin to…

Adaptation and Self-Organizing Systems · Physics 2020-11-11 Francesco Borra , Angelo Vulpiani , Massimo Cencini

The use of model order reduction techniques in combination with ensemble-based methods for estimating the state of systems described by nonlinear partial differential equations has been of great interest in recent years in the data…

Numerical Analysis · Mathematics 2024-12-18 Francesco A. B. Silva , Cecilia Pagliantini , Karen Veroy

Methods: This work introduces a method supporting the collaborative definition of machine learning tasks by leveraging model-based engineering in the formalization of the systems modeling language SysML. The method supports the…

Software Engineering · Computer Science 2023-07-11 Simon Raedler , Juergen Mangler , Stefanie Rinderle-Ma

Data assimilation (DA) is integrated with machine learning in order to perform entirely data-driven online state estimation. To achieve this, recurrent neural networks (RNNs) are implemented as surrogate models to replace key components of…

In this study, we explore data assimilation for the Stochastic Camassa-Holm equation through the application of the particle filtering framework. Specifically, our approach integrates adaptive tempering, jittering, and nudging techniques to…

Numerical Analysis · Mathematics 2024-02-13 Colin John Cotter , Dan Crisan , Maneesh Kumar Singh

We explore the use of Physics Informed Neural Networks to analyse nonlinear Hamiltonian Dynamical Systems with a first integral of motion. In this work, we propose an architecture which combines existing Hamiltonian Neural Network…

Machine Learning · Computer Science 2023-08-09 Vedanta Thapar

Estimating background-error covariances remains a core challenge in variational data assimilation (DA). Operational systems typically approximate these covariances by transformations that separate geostrophically balanced components from…

Atmospheric and Oceanic Physics · Physics 2026-01-21 Boštjan Melinc , Uroš Perkan , Žiga Zaplotnik

This paper presents a data-assimilation (DA)-based approach to forecast the phase-resolved wave evolution process and ship motion, which is developed by coupling the high-order spectral method (HOS), ensemble Kalman filter (EnKF), and a…

Systems and Control · Electrical Eng. & Systems 2025-04-22 Guangyao Wang , Yulin Pan

Global data assimilation enables weather forecasting at all scales and provides valuable data for studying the Earth system. However, the computational demands of physics-based algorithms used in operational systems limits the volume and…

Machine Learning · Computer Science 2024-07-17 Thomas J. Vandal , Kate Duffy , Daniel McDuff , Yoni Nachmany , Chris Hartshorn

Earth system modeling presents a fundamental challenge in scientific computing: capturing complex, multiscale nonlinear dynamics in computationally efficient models while minimizing forecast errors caused by necessary simplifications. Even…

Machine Learning · Computer Science 2025-08-04 Yongquan Qu , Matthieu Blanke , Sara Shamekh , Pierre Gentine

The recent revolution in data-driven methods for weather forecasting has lead to a fragmented landscape of complex, bespoke architectures and training strategies, obscuring the fundamental drivers of forecast accuracy. Here, we demonstrate…

Short- or mid-term rainfall forecasting is a major task with several environmental applications such as agricultural management or flood risk monitoring. Existing data-driven approaches, especially deep learning models, have shown…

Signal Processing · Electrical Eng. & Systems 2021-01-13 Vincent Bouget , Dominique Béréziat , Julien Brajard , Anastase Charantonis , Arthur Filoche

Modern data-driven surrogate models for weather forecasting provide accurate short-term predictions but inaccurate and nonphysical long-term forecasts. This paper investigates online weather prediction using machine learning surrogates…

Signal Processing · Electrical Eng. & Systems 2025-02-12 Melissa Adrian , Daniel Sanz-Alonso , Rebecca Willett