English
Related papers

Related papers: SURGE: Approximation and Training Free Particle Fi…

200 papers

The accuracy of simulation-based forecasting in chaotic systems is heavily dependent on high-quality estimates of the system state at the time the forecast is initialized. Data assimilation methods are used to infer these initial conditions…

Machine Learning · Computer Science 2021-11-02 Michael McCabe , Jed Brown

Fitting nonlinear dynamical models to sparse and noisy observations is fundamentally challenging. Identifying dynamics requires data assimilation (DA) to estimate system states, but DA requires an accurate dynamical model. To break this…

Machine Learning · Computer Science 2024-09-12 Vadim Zinchenko , David S. Greenberg

Data assimilation of observational data into full atmospheric states is essential for weather forecast model initialization. Recently, methods for deep generative data assimilation have been proposed which allow for using new input data…

Temporal data such as time series can be viewed as discretized measurements of the underlying function. To build a generative model for such data we have to model the stochastic process that governs it. We propose a solution by defining the…

Machine Learning · Computer Science 2023-05-22 Marin Biloš , Kashif Rasul , Anderson Schneider , Yuriy Nevmyvaka , Stephan Günnemann

There has been a recent surge in development of accurate machine learning (ML) weather prediction models, but evaluation of these models has mainly been focused on medium-range forecasts, not their performance in cycling data assimilation…

Atmospheric and Oceanic Physics · Physics 2024-12-25 Laura C. Slivinski , Jeffrey S. Whitaker , Sergey Frolov , Timothy A. Smith , Niraj Agarwal

We describe a new approach allowing for systematic causal attribution of weather and climate-related events, in near-real time. The method is purposely designed to facilitate its implementation at meteorological centers by relying on data…

We apply two data assimilation (DA) methods, a smoother and a filter, and a model-free machine learning (ML) shallow network to forecast two weakly turbulent systems. We analyse the effect of the spatial sparsity of observations on accuracy…

Fluid Dynamics · Physics 2024-07-16 Vikrant Gupta , Yuanqing Chen , Minping Wan

Using a very cheap Data Assimilation (DA) method, I show an alternative approach to classical DA for numerical climate models which produce a large amount of "big data". The problematic features of state-of-the-art high resolution Regional…

Applications · Statistics 2016-10-12 Bijan Fallah

Data assimilation plays a crucial role in numerical modeling, enabling the integration of real-world observations into mathematical models to enhance the accuracy and predictive capabilities of simulations. This approach is widely applied…

Numerical Analysis · Mathematics 2024-11-08 Alexander Lobbe , Dan Crisan , Oana Lang

A novel method, based on the combination of data assimilation and machine learning is introduced. The new hybrid approach is designed for a two-fold scope: (i) emulating hidden, possibly chaotic, dynamics and (ii) predicting their future…

Machine Learning · Statistics 2020-07-27 Julien Brajard , Alberto Carassi , Marc Bocquet , Laurent Bertino

Data assimilation (DA) in the geophysical sciences remains the cornerstone of robust forecasts from numerical models. Indeed, DA plays a crucial role in the quality of numerical weather prediction, and is a crucial building block that has…

This paper is concerned with differentiable resampling in the context of sequential Monte Carlo (e.g., particle filtering). Drawing on reparametrisation, we propose a new resampling method that is informative and instantly differentiable,…

Machine Learning · Statistics 2026-05-29 Jennifer Rosina Andersson , Zheng Zhao

Earth system modeling presents a fundamental challenge in scientific computing: capturing complex, multiscale nonlinear dynamics in computationally efficient models while minimizing forecast errors caused by necessary simplifications. Even…

Machine Learning · Computer Science 2025-08-04 Yongquan Qu , Matthieu Blanke , Sara Shamekh , Pierre Gentine

In this study, we explore data assimilation for the Stochastic Camassa-Holm equation through the application of the particle filtering framework. Specifically, our approach integrates adaptive tempering, jittering, and nudging techniques to…

Numerical Analysis · Mathematics 2024-02-13 Colin John Cotter , Dan Crisan , Maneesh Kumar Singh

Data assimilation (DA) is widely used to combine physical knowledge and observations. It is nowadays commonly used in geosciences to perform parametric calibration. In a context of climate change, old calibrations can not necessarily be…

Machine Learning · Statistics 2021-06-23 Rem-Sophia Mouradi , Cédric Goeury , Olivier Thual , Fabrice Zaoui , Pablo Tassi

We study the numerical solution of nonlinear partially observed optimal stopping problems. The system state is taken to be a multi-dimensional diffusion and drives the drift of the observation process, which is another multi-dimensional…

Optimization and Control · Mathematics 2010-01-20 Mike Ludkovski

Data assimilation (DA) enables hydrologic models to update their internal states using near-real-time observations for more accurate forecasts. With deep neural networks like long short-term memory (LSTM), using either lagged observations…

Fluid Dynamics · Physics 2025-02-25 Amirmoez Jamaat , Yalan Song , Farshid Rahmani , Jiangtao Liu , Kathryn Lawson , Chaopeng Shen

The requirements of modern sensing are rapidly evolving, driven by increasing demands for data efficiency, real-time processing, and deployment under limited sensing coverage. Complex physical systems are often characterized through the…

Machine Learning · Computer Science 2025-12-02 Yuxuan Bao , J. Nathan Kutz

Data Assimilation is the process in which we improve the representation of the state of a physical system by combining information coming from a numerical model, real-world observations, and some prior modelling. It is widely used to model…

Optimization and Control · Mathematics 2025-01-09 Victor Trappler , Arthur Vidard

Subsampling is commonly used to mitigate costs associated with data acquisition, such as time or energy requirements, motivating the development of algorithms for estimating the fully-sampled signal of interest $x$ from partially observed…

Machine Learning · Computer Science 2025-04-23 Oisin Nolan , Tristan S. W. Stevens , Wessel L. van Nierop , Ruud J. G. van Sloun