English
Related papers

Related papers: FNP: Fourier Neural Processes for Arbitrary-Resolu…

200 papers

Data assimilation (DA) is integrated with machine learning in order to perform entirely data-driven online state estimation. To achieve this, recurrent neural networks (RNNs) are implemented as surrogate models to replace key components of…

In-situ ocean wave observations are critical to improve model skill and validate remote sensing wave measurements. Historically, such observations are extremely sparse due to the large costs and complexity of traditional wave buoys and…

Atmospheric and Oceanic Physics · Physics 2020-03-11 Pieter B. Smit , Isabel A. Houghton , Kalina Jordanova , Thomas Portwood , Evan Shapiro , David Clark , Michael Sosa , Tim T. Janssen

We present a new continuous data assimilation algorithm based on ideas that have been developed for designing finite-dimensional feedback controls for dissipative dynamical systems, in particular, in the context of the incompressible…

Analysis of PDEs · Mathematics 2015-06-15 Abderrahim Azouani , Eric Olson , Edriss S. Titi

Data assimilation is often viewed as a framework for correcting short-term error growth in dynamical climate model forecasts. When viewed on the time scales of climate however, these short-term corrections, or analysis increments, can…

Atmospheric and Oceanic Physics · Physics 2023-10-02 William Gregory , Mitchell Bushuk , Alistair Adcroft , Yongfei Zhang , Laure Zanna

Data assimilation involves estimating the state of a system by combining observations from various sources with a background estimate of the state. The weights given to the observations and background state depend on their specified error…

Numerical Analysis · Mathematics 2025-03-13 Olivier Goux , Anthony Weaver , Selime Gürol , Oliver Guillet , Andrea Piacentini

The goal of this study was to improve the post-processing of precipitation forecasts using convolutional neural networks (CNNs). Instead of post-processing forecasts on a per-pixel basis, as is usually done when employing machine learning…

Machine Learning · Computer Science 2021-05-18 Bob de Ruiter

An intrinsic property of almost any physical measuring device is that it makes observations which are slightly blurred in time. We consider a nudging-based approach for data assimilation that constructs an approximate solution based on a…

Analysis of PDEs · Mathematics 2018-09-05 Michael S. Jolly , Vincent R. Martinez , Eric J. Olson , Edriss S. Titi

The generation of initial conditions via accurate data assimilation is crucial for weather forecasting and climate modeling. We propose DiffDA as a denoising diffusion model capable of assimilating atmospheric variables using predicted…

Computational Engineering, Finance, and Science · Computer Science 2024-06-11 Langwen Huang , Lukas Gianinazzi , Yuejiang Yu , Peter D. Dueben , Torsten Hoefler

Data assimilation (DA) is crucial for enhancing solutions to partial differential equations (PDEs), such as those in numerical weather prediction, by optimizing initial conditions using observational data. Variational DA methods are widely…

Machine Learning · Computer Science 2025-09-30 Hamidreza Moazzami , Asma Jamali , Nicholas Kevlahan , Rodrigo A. Vargas-Hernández

Relevant comprehension of flood hazards has emerged as a crucial necessity, especially as the severity and the occurrence of flood events intensify with climate changes. Flood simulation and forecast capability have been greatly improved…

Image and Video Processing · Electrical Eng. & Systems 2022-11-18 Thanh Huy Nguyen , Anthéa Delmotte , Christophe Fatras , Peter Kettig , Andrea Piacentini , Sophie Ricci

We describe a new approach allowing for systematic causal attribution of weather and climate-related events, in near-real time. The method is purposely designed to facilitate its implementation at meteorological centers by relying on data…

Data-driven models, such as FourCastNet (FCN), have shown exemplary performance in high-resolution global weather forecasting. This performance, however, is based on supervision on mesh-gridded weather data without the utilization of raw…

Atmospheric and Oceanic Physics · Physics 2022-10-25 Tao Ge , Jaideep Pathak , Akshay Subramaniam , Karthik Kashinath

Analyzing the validity and success of a data assimilation algorithm when some state variable observations are not available is an important problem in meteorology and engineering. We present an improved data assimilation algorithm for…

Analysis of PDEs · Mathematics 2016-08-18 Aseel Farhat , Evelyn Lunasin , Edriss S. Titi

Data assimilation (DA) is a fundamental component of modern weather prediction, yet it remains a major computational bottleneck in machine learning (ML)-based forecasting pipelines due to reliance on traditional variational methods. Recent…

Machine Learning · Computer Science 2026-02-09 Ran Cheng , Lailai Zhu

The generalisation of Neural Networks (NN) to multiple datasets is often overlooked in literature due to NNs typically being optimised for specific data sources. This becomes especially challenging in time-series-based multi-dataset models…

Machine Learning · Computer Science 2024-10-28 Ayman Elhalwagy , Tatiana Kalganova

Post-processing typically takes the outputs of a Numerical Weather Prediction (NWP) model and applies linear statistical techniques to produce improve localized forecasts, by including additional observations, or determining systematic…

Accurate estimation and forecasting of energy consumption are important for power-system operation, planning, and demand-side management. In practice, however, complete and timely measurements may not always be available, and the observed…

Machine Learning · Computer Science 2026-05-29 Ruoyu Hu , Dahai Yu , Feng Bao , Guang Wang , Guannan Zhang

We propose the Distance-informed Neural Process (DNP), a novel variant of Neural Processes that improves uncertainty estimation by combining global and distance-aware local latent structures. Standard Neural Processes (NPs) often rely on a…

Machine Learning · Computer Science 2025-08-27 Aishwarya Venkataramanan , Joachim Denzler

Using a very cheap Data Assimilation (DA) method, I show an alternative approach to classical DA for numerical climate models which produce a large amount of "big data". The problematic features of state-of-the-art high resolution Regional…

Applications · Statistics 2016-10-12 Bijan Fallah

Modern deep learning techniques, which mimic traditional numerical weather prediction (NWP) models and are derived from global atmospheric reanalysis data, have caused a significant revolution within a few years. In this new paradigm, our…

Artificial Intelligence · Computer Science 2024-02-14 Minjong Cheon , Daehyun Kang , Yo-Hwan Choi , Seon-Yu Kang