English
Related papers

Related papers: Ensemble regional data assimilation using joint st…

200 papers

A challenge arising from the local Bayesian assimilation of data in an atmospheric flow simulation is the imbalances it may introduce. Acoustic fast-mode imbalances of the order of the slower dynamics can be negated by employing a blended…

Numerical Analysis · Mathematics 2024-03-11 Ray Chew , Tommaso Benacchio , Gottfried Hastermann , Rupert Klein

Unsupervised representation learning methods are widely used for gaining insight into high-dimensional, unstructured, or structured data. In some cases, users may have prior topological knowledge about the data, such as a known cluster…

Machine Learning · Computer Science 2023-11-08 Edith Heiter , Robin Vandaele , Tijl De Bie , Yvan Saeys , Jefrey Lijffijt

Data assimilation (DA) plays a pivotal role in diverse applications, ranging from climate predictions and weather forecasts to trajectory planning for autonomous vehicles. A prime example is the widely used ensemble Kalman filter (EnKF),…

Dynamical Systems · Mathematics 2024-01-03 Mohamad Abed El Rahman Hammoud , Naila Raboudi , Edriss S. Titi , Omar Knio , Ibrahim Hoteit

This article develops a novel data assimilation methodology, addressing challenges that are common in real-world settings, such as severe sparsity of observations, lack of reliable models, and non-stationarity of the system dynamics. These…

Optimization and Control · Mathematics 2024-11-05 David J. Abers , George Hripcsak , Lena Mamykina , Melike Sirlanci , Esteban G. Tabak

Simulated annealing is a popular method for approaching the solution of a global optimization problem. Existing results on its performance apply to discrete combinatorial optimization where the optimization variables can assume only a…

Machine Learning · Statistics 2007-09-20 A. Lecchini-Visintini , J. Lygeros , J. Maciejowski

4D-variational data assimilation is applied to the Lorenz '63 model to introduce a new method for parameter estimation in chaotic climate models. The approach aims to optimise an Earth system model (ESM), for which no adjoint exists, by…

Atmospheric and Oceanic Physics · Physics 2025-04-18 Philip David Kennedy , Abhirup Banerjee , Armin Köhl , Detlef Stammer

Data assimilation, consisting in the combination of a dynamical model with a set of noisy and incomplete observations in order to infer the state of a system over time, involves uncertainty in most settings. Building upon an existing…

Machine Learning · Computer Science 2026-03-02 Anthony Frion , David S Greenberg

Extreme weather events epitomize high cost: to society through their physical impacts, and to computer servers that simulate them to assess risk and advance physical understanding. It costs hundreds of simulation years to sample a few…

Atmospheric and Oceanic Physics · Physics 2026-04-14 Justin Finkel , Paul A. O'Gorman

This work presents a unified framework that combines global approximations with locally built models to handle challenging nonconvex and nonsmooth composite optimization problems, including cases involving extended real-valued functions. We…

Optimization and Control · Mathematics 2026-02-19 Welington de Oliveira , Johannes O. Royset

For oceanographic applications, probabilistic forecasts typically have to deal with i) high-dimensional complex models, and ii) very sparse spatial observations. In search-and-rescue operations at sea, for instance, the short-term…

Applications · Statistics 2023-02-15 Florian Beiser , Håvard Heitlo Holm , Jo Eidsvik

We develop an optimal experimental design framework for adapting the covariance inflation and localization in data assimilation problems. Covariance inflation and localization are ubiquitously employed to alleviate the effect of using…

Computational Engineering, Finance, and Science · Computer Science 2019-03-26 Ahmed Attia , Emil Constantinescu

Data assimilation (DA) is widely used to combine physical knowledge and observations. It is nowadays commonly used in geosciences to perform parametric calibration. In a context of climate change, old calibrations can not necessarily be…

Machine Learning · Statistics 2021-06-23 Rem-Sophia Mouradi , Cédric Goeury , Olivier Thual , Fabrice Zaoui , Pablo Tassi

Shallow water equations are extensively considered in the domains of oceans, atmospheric modelling, and engineering research (Franca et al., 2022), which play significant roles in floods and tsunami governance. Nonetheless, the accurate…

Fluid Dynamics · Physics 2023-09-22 Ruijia Yu

Algorithms for simulating complex physical systems or solving difficult optimization problems often resort to an annealing process. Rather than simulating the system at the temperature of interest, an annealing algorithm starts at a…

Computational Physics · Physics 2015-04-02 Michael Habeck

Data assimilation algorithms estimate the state of a dynamical system from partial observations, where the successful performance of these algorithms hinges on costly parameter tuning and on employing an accurate model for the dynamics.…

Machine Learning · Statistics 2026-03-24 Melissa Adrian , Daniel Sanz-Alonso , Rebecca Willett

This chapter provides various perspective on an important challenge in data assimilation: model error. While the overall goal is to understand the implication of model error of any type in data assimilation, we emphasize on the effect of…

Dynamical Systems · Mathematics 2015-07-02 John Harlim

Recent studies have shown that it is possible to combine machine learning methods with data assimilation to reconstruct a dynamical system using only sparse and noisy observations of that system. The same approach can be used to correct the…

Machine Learning · Statistics 2021-09-09 Alban Farchi , Marc Bocquet , Patrick Laloyaux , Massimo Bonavita , Quentin Malartic

Data assimilation (DA) aims to estimate the full state of a dynamical system by combining partial and noisy observations with a prior model forecast, commonly referred to as the background. In atmospheric applications, this problem is…

Atmospheric and Oceanic Physics · Physics 2025-05-29 Jing-An Sun , Hang Fan , Junchao Gong , Ben Fei , Kun Chen , Fenghua Ling , Wenlong Zhang , Wanghan Xu , Li Yan , Pierre Gentine , Lei Bai

Modern data analytics take advantage of ensemble learning and transfer learning approaches to tackle some of the most relevant issues in data analysis, such as lack of labeled data to use to train the analysis models, sparsity of the…

We propose a trust-region method for finite-sum minimization with an adaptive sample size adjustment technique, which is practical in the sense that it leads to a globally convergent method that shows strong performance empirically without…

Optimization and Control · Mathematics 2019-10-09 Robert Mohr , Oliver Stein