English
Related papers

Related papers: Data Assimilation: The Schr\"odinger Perspective

200 papers

Data assimilation (DA) is integrated with machine learning in order to perform entirely data-driven online state estimation. To achieve this, recurrent neural networks (RNNs) are implemented as surrogate models to replace key components of…

In this work, an adaptive predictive control scheme for linear systems with unknown parameters and bounded additive disturbances is proposed. In contrast to related adaptive control approaches that robustly consider the parametric…

Systems and Control · Electrical Eng. & Systems 2025-03-03 Johannes Teutsch , Christopher Narr , Sebastian Kerz , Dirk Wollherr , Marion Leibold

The data association problem is concerned with separating data coming from different generating processes, for example when data come from different data sources, contain significant noise, or exhibit multimodality. We present a fully…

Machine Learning · Statistics 2019-05-07 Markus Kaiser , Clemens Otte , Thomas Runkler , Carl Henrik Ek

A parameter estimation problem is considered, in which dispersed sensors transmit to the statistician partial information regarding their observations. The sensors observe the paths of continuous semimartingales, whose drifts are linear…

Methodology · Statistics 2013-02-01 Georgios Fellouris

We introduce a data assimilation method to estimate model parameters with observations of passive tracers by directly assimilating Lagrangian Coherent Structures. Our approach differs from the usual Lagrangian Data Assimilation approach,…

Atmospheric and Oceanic Physics · Physics 2017-11-22 John Maclean , Naratip Santitissadeekorn , Christopher KRT Jones

Data assimilation (DA) is a cornerstone of scientific and engineering applications, combining model forecasts with sparse and noisy observations to estimate latent system states. Classical high-dimensional DA methods, such as the ensemble…

Machine Learning · Statistics 2026-05-28 Martin Andrae , Erik Wikingsson , So Takao , Tomas Landelius , Fredrik Lindsten

We study the data selection problem, whose aim is to select a small representative subset of data that can be used to efficiently train a machine learning model. We present a new data selection approach based on $k$-means clustering and…

Data assimilation provides algorithms for widespread applications in various fields. It is of practical use to deal with a large amount of information in the complex system that is hard to estimate. Weather forecasting is one of the…

Optimization and Control · Mathematics 2023-03-23 Yihua Yang

With rapidly increasing data, clustering algorithms are important tools for data analytics in modern research. They have been successfully applied to a wide range of domains; for instance, bioinformatics, speech recognition, and financial…

Data Structures and Algorithms · Computer Science 2015-12-01 Ka-Chun Wong

Accurate estimation of error covariances (both background and observation) is crucial for efficient observation compression approaches in data assimilation of large-scale dynamical problems. We propose a new combination of a covariance…

Numerical Analysis · Mathematics 2021-06-11 Sibo Cheng , Didier Lucor , Jean-Philippe Argaud

Statistical Data Assimilation (SDA) is the transfer of information from field or laboratory observations to a user selected model of the dynamical system producing those observations. The data is noisy and the model has errors; the…

Computation · Statistics 2019-01-16 Adrian S. Wong , Kangbo Hao , Zheng Fang , Henry D. I. Abarbanel

Complex systems are often described with competing models. Such divergence of interpretation on the system may stem from model fidelity, mathematical simplicity, and more generally, our limited knowledge of the underlying processes.…

Numerical Analysis · Mathematics 2017-07-21 Lun Yang , Akil Narayan , Peng Wang

Recently a new algorithm for sampling posteriors of unnormalised probability densities, called ABC Shadow, was proposed in [8]. This talk introduces a global optimisation procedure based on the ABC Shadow simulation dynamics. First the…

Computation · Statistics 2018-03-20 R. S. Stoica , M. Deaconu , L. Hurtado

We propose a clustering-based iterative algorithm to solve certain optimization problems in machine learning, where we start the algorithm by aggregating the original data, solving the problem on aggregated data, and then in subsequent…

Machine Learning · Statistics 2017-01-23 Young Woong Park , Diego Klabjan

The reconstruction from observations of high-dimensional chaotic dynamics such as geophysical flows is hampered by (i) the partial and noisy observations that can realistically be obtained, (ii) the need to learn from long time series of…

Machine Learning · Statistics 2020-03-31 Marc Bocquet , Julien Brajard , Alberto Carrassi , Laurent Bertino

The purpose of this work is to develop a framework to calibrate signed datasets so as to be consistent with specified marginals by suitably extending the Schr\"odinger-Fortet-Sinkhorn paradigm. Specifically, we seek to revise…

Machine Learning · Statistics 2023-08-24 Anqi Dong , Tryphon T. Georgiou , Allen Tannenbaum

We address data assimilation for linear and nonlinear dynamical systems via the so-called \emph{model reference adaptive system}. Continuing our theoretical developments in \cite{Tram_Kaltenbacher_2021}, we deliver the first practical…

Optimization and Control · Mathematics 2026-02-12 Benedikt Kaltenbach , Christian Aarset , Tram Thi Ngoc Nguyen

This paper presents a novel centralized, variational data assimilation approach for calibrating transient dynamic models in electrical power systems, focusing on load model parameters. With the increasing importance of inverter-based…

Optimization and Control · Mathematics 2023-11-15 Ahmed Attia , D. Adrian Maldonado , Emil Constantinescu , Mihai Anitescu

A variational data assimilation technique was used to estimate optimal discretization of interpolation operators and derivatives in the nodes adjacent to the rigid boundary. Assimilation of artificially generated observational data in the…

Atmospheric and Oceanic Physics · Physics 2012-12-17 Eugene Kazantsev

Ensuring that analyses performed on a dataset are representative of the entire population is one of the central problems in statistics. Most classical techniques assume that the dataset is independent of the analyst's query and break down…

Machine Learning · Computer Science 2024-09-25 Guy Blanc