English
Related papers

Related papers: Global optimization for data assimilation in lands…

200 papers

Many dynamical systems are difficult or impossible to model using high fidelity physics based models. Consequently, researchers are relying more on data driven models to make predictions and forecasts. Based on limited training data,…

Chaotic Dynamics · Physics 2025-04-09 Max M. Chumley , Firas A. Khasawneh

Global optimization is a challenging problem, with plenty of algorithms displaying empirical success, but scarce theoretical backing. In this work, we propose a new theoretical framework called Proximal Basin Hopping (PBH), carefully…

Machine Learning · Computer Science 2026-05-19 Guillaume Lauga , Cesare Molinari , Samuel Vaiter

Variational data assimilation optimizes for an initial state of a dynamical system such that its evolution fits observational data. The physical model can subsequently be evolved into the future to make predictions. This principle is a…

Machine Learning · Computer Science 2021-05-21 Thomas Frerix , Dmitrii Kochkov , Jamie A. Smith , Daniel Cremers , Michael P. Brenner , Stephan Hoyer

Reduced-order modelling and low-dimensional surrogate models generated using machine learning algorithms have been widely applied in high-dimensional dynamical systems to improve the algorithmic efficiency. In this paper, we develop a…

We propose a new gradient descent algorithm with added stochastic terms for finding the global optimizers of nonconvex optimization problems. A key component in the algorithm is the adaptive tuning of the randomness based on the value of…

Optimization and Control · Mathematics 2025-06-16 Björn Engquist , Kui Ren , Yunan Yang

The understanding of nonlinear, high dimensional flows, e.g, atmospheric and ocean flows, is critical to address the impacts of global climate change. Data Assimilation techniques combine physical models and observational data, often in a…

We present a global optimization routine for the variational quantum algorithms, which utilizes the dynamic tunneling flow. Originally designed to leverage information gathered by a gradient-based optimizer around local minima, we adapt the…

Quantum Physics · Physics 2024-08-05 Seung Park , Kyunghyun Baek , Seungjin Lee , Mahn-Soo Choi

The optimization of open-loop shallow geothermal systems, which includes both design and operational aspects, is an important research area aimed at improving their efficiency and sustainability and the effective management of groundwater…

Optimization and Control · Mathematics 2023-11-09 S. Halilovic , F. Böttcher , K. Zosseder , T. Hamacher

The accuracy of simulation-based forecasting in chaotic systems is heavily dependent on high-quality estimates of the system state at the time the forecast is initialized. Data assimilation methods are used to infer these initial conditions…

Machine Learning · Computer Science 2021-11-02 Michael McCabe , Jed Brown

Online augmentation of an oblique aerial image sequence with structural information is an essential aspect in the process of 3D scene interpretation and analysis. One key aspect in this is the efficient dense image matching and depth…

Computer Vision and Pattern Recognition · Computer Science 2019-09-24 Boitumelo Ruf , Thomas Pollok , Martin Weinmann

A novel method, based on the combination of data assimilation and machine learning is introduced. The new hybrid approach is designed for a two-fold scope: (i) emulating hidden, possibly chaotic, dynamics and (ii) predicting their future…

Machine Learning · Statistics 2020-07-27 Julien Brajard , Alberto Carassi , Marc Bocquet , Laurent Bertino

In this paper we propose a modified version of the simulated annealing algorithm for solving a stochastic global optimization problem. More precisely, we address the problem of finding a global minimizer of a function with noisy…

Machine Learning · Statistics 2017-03-02 Clément Bouttier , Ioana Gavra

In meteorology, engineering and computer sciences, data assimilation is routinely employed as the optimal way to combine noisy observations with prior model information for obtaining better estimates of a state, and thus better forecasts,…

Geophysics · Physics 2009-08-12 M. J. Werner , K. Ide , D. Sornette

Recently a new algorithm for sampling posteriors of unnormalised probability densities, called ABC Shadow, was proposed in [8]. This talk introduces a global optimisation procedure based on the ABC Shadow simulation dynamics. First the…

Computation · Statistics 2018-03-20 R. S. Stoica , M. Deaconu , L. Hurtado

We propose a new randomized optimization method for high-dimensional problems which can be seen as a generalization of coordinate descent to random subspaces. We show that an adaptive sampling strategy for the random subspace significantly…

Optimization and Control · Mathematics 2019-12-19 Jonathan Lacotte , Mert Pilanci , Marco Pavone

In this study, we explore data assimilation for the Stochastic Camassa-Holm equation through the application of the particle filtering framework. Specifically, our approach integrates adaptive tempering, jittering, and nudging techniques to…

Numerical Analysis · Mathematics 2024-02-13 Colin John Cotter , Dan Crisan , Maneesh Kumar Singh

For oceanographic applications, probabilistic forecasts typically have to deal with i) high-dimensional complex models, and ii) very sparse spatial observations. In search-and-rescue operations at sea, for instance, the short-term…

Applications · Statistics 2023-02-15 Florian Beiser , Håvard Heitlo Holm , Jo Eidsvik

Data assimilation addresses the problem of identifying plausible state trajectories of dynamical systems given noisy or incomplete observations. In geosciences, it presents challenges due to the high-dimensionality of geophysical dynamical…

Machine Learning · Statistics 2023-11-03 François Rozet , Gilles Louppe

Data assimilation is an iterative approach to the problem of estimating the state of a dynamical system using both current and past observations of the system together with a model for the system's time evolution. Rather than solving the…

Data Analysis, Statistics and Probability · Physics 2007-05-23 Brian R. Hunt , Eric J. Kostelich , Istvan Szunyogh

A hybrid data assimilation algorithm is developed for complex dynamical systems with partial observations. The method starts with applying a spectral decomposition to the entire spatiotemporal fields, followed by creating a machine learning…

Computational Physics · Physics 2022-12-27 Changhong Mou , Leslie M. Smith , Nan Chen