English
Related papers

Related papers: 4D-Var using Hessian approximation and backpropaga…

200 papers

Accurately representing surface weather at the sub-kilometer scale is crucial for optimal decision-making in a wide range of applications. This motivates the use of statistical techniques to provide accurate and calibrated probabilistic…

Atmospheric and Oceanic Physics · Physics 2024-11-15 Francesco Zanetta , Daniele Nerini , Matteo Buzzi , Henry Moss

We propose a second-order (Hessian or Hessian-free) based optimization method for variational inference inspired by Gaussian backpropagation, and argue that quasi-Newton optimization can be developed as well. This is accomplished by…

Machine Learning · Statistics 2017-03-30 Kai Fan , Ziteng Wang , Jeff Beck , James Kwok , Katherine Heller

Data-driven machine learning (ML) models are reshaping weather forecasting and have shown the potential to accelerate and surpass traditional physics-based approaches, leading to a second revolution in the field after data assimilation.…

Machine Learning · Computer Science 2026-05-19 Hang Fan , Yi Xiao , Yongquan Qu , Juan Nathaniel , Fenghua Ling , Ben Fei , Lei Bai , Pierre Gentine

Modern deep learning techniques, which mimic traditional numerical weather prediction (NWP) models and are derived from global atmospheric reanalysis data, have caused a significant revolution within a few years. In this new paradigm, our…

Artificial Intelligence · Computer Science 2024-02-14 Minjong Cheon , Daehyun Kang , Yo-Hwan Choi , Seon-Yu Kang

Data assimilation refers to a set of algorithms designed to compute the optimal estimate of a system's state by refining the prior prediction (known as background states) using observed data. Variational assimilation methods rely on the…

Machine Learning · Computer Science 2024-05-24 Yi Xiao , Qilong Jia , Wei Xue , Lei Bai

This study demonstrates how the incremental 4D-Var data assimilation method can be applied efficiently preconditione d in an application to an oceanographic problem. The approach consists in performing a few iterations of the reduced-order…

Geophysics · Physics 2007-09-19 Céline Robert , Eric Blayo , Jacques Verron

In this thesis, we disentangle the generalized Gauss-Newton and approximate inference for Bayesian deep learning. The generalized Gauss-Newton method is an optimization method that is used in several popular Bayesian deep learning…

Machine Learning · Statistics 2020-07-24 Alexander Immer

Data assimilation leads naturally to a Bayesian formulation in which the posterior probability distribution of the system state, given the observations, plays a central conceptual role. The aim of this paper is to use this Bayesian…

Data Analysis, Statistics and Probability · Physics 2013-01-01 K. J. H. Law , A. M. Stuart

Four-dimensional variational data assimilation (4DVAR) is a cornerstone of numerical weather prediction, but its cost function is difficult to optimize and computationally intensive. We propose a neural field-based reformulation in which…

Machine Learning · Computer Science 2025-09-29 Jaemin Oh

Forecasting global precipitation patterns and, in particular, extreme precipitation events is of critical importance to preparing for and adapting to climate change. Making accurate high-resolution precipitation forecasts using traditional…

Machine Learning · Computer Science 2022-10-25 James Duncan , Shashank Subramanian , Peter Harrington

Accurate marine wind forecasts are essential for safe navigation, ship routing, and energy operations, yet they remain challenging because observations over the ocean are sparse, heterogeneous, and temporally variable. We reformulate wind…

Machine Learning · Computer Science 2025-12-04 Matteo Peduto , Qidong Yang , Jonathan Giezendanner , Devis Tuia , Sherrie Wang

Four-dimensional weak-constraint variational data assimilation estimates a state given partial noisy observations and dynamical model by minimizing a cost function that takes into account both discrepancy between the state and observations…

Dynamical Systems · Mathematics 2023-04-13 Nazanin Abedini , Svetlana Dubinkina

The use of machine learning (ML) models in meteorology has attracted significant attention for their potential to improve weather forecasting efficiency and accuracy. GraphCast and NeuralGCM, two promising ML-based weather models, are at…

Atmospheric and Oceanic Physics · Physics 2024-11-25 Xiaoxu Tian , Daniel Holdaway , Daryl Kleist

This work introduces a new class of four-dimensional variational data assimilation (4D-Var) methods grounded in data-consistent inversion (DCI) theory. The methods extend classical 4D-Var by incorporating a predictability-aware…

Numerical Analysis · Mathematics 2025-11-04 Rylan Spence , Troy Butler , Clint Dawson

In this article we develop further an algorithm for data assimilation based upon a shadowing refinement technique [de Leeuw et al., SIAM J. Appl. Dyn. Sys., 17 (2018)] to take partial observations into account. Our method is based on…

Optimization and Control · Mathematics 2020-11-13 Bart de Leeuw , Svetlana Dubinkina

While AI-based numerical weather prediction (NWP) enables rapid forecasting, generating high-resolution outputs remains computationally demanding due to limited multi-scale adaptability and inefficient data representations. We propose the…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Tao Han , Zhibin Wen , Zhenghao Chen , Fenghua Lin , Junyu Gao , Song Guo , Lei Bai

Balanced truncation is a well-established model order reduction method which has been applied to a variety of problems. Recently, a connection between linear Gaussian Bayesian inference problems and the system-theoretic concept of balanced…

Numerical Analysis · Mathematics 2024-01-04 Josie König , Melina A. Freitag

Data assimilation of atmospheric observations traditionally relies on variational and Kalman filter methods. Here, an alternative neural-network data assimilation (NNDA) with variational autoencoder (VAE) is proposed. The three-dimensional…

Atmospheric and Oceanic Physics · Physics 2024-04-29 Boštjan Melinc , Žiga Zaplotnik

In variational assimilation, the most probable state of a dynamical system under Gaussian assumptions for the prior and likelihood can be found by solving a least-squares minimization problem . In recent years, we have seen the popularity…

Numerical Analysis · Mathematics 2023-06-22 Shaerdan Shataer , Amos S. Lawless , Nancy K. Nichols

High-dimensional vector autoregressive (VAR) models have numerous applications in fields such as econometrics, biology, climatology, among others. While prior research has mainly focused on linear VAR models, these approaches can be…

Statistics Theory · Mathematics 2025-11-25 Yuefeng Han , Likai Chen , Wei Biao Wu