English
Related papers

Related papers: Data Assimilation in Optimal Transport Framework

200 papers

In many applications of optimal transport (OT), the object of primary interest is the optimal transport map. This map rearranges mass from one probability distribution to another in the most efficient way possible by minimizing a specified…

Statistics Theory · Mathematics 2025-06-25 Sivaraman Balakrishnan , Tudor Manole , Larry Wasserman

Accurate data assimilation (DA) for systems with piecewise-smooth or discontinuous state variables remains a significant challenge, as conventional covariance-based ensemble Kalman filter approaches often fail to effectively balance…

Numerical Analysis · Mathematics 2025-10-09 Tongtong Li , Anne Gelb , Yoonsang Lee

Practical data assimilation algorithms often contain hyper-parameters, which may arise due to, for instance, the use of certain auxiliary techniques like covariance inflation and localization in an ensemble Kalman filter, the…

Computation · Statistics 2022-06-08 Xiaodong Luo , Chuan-An Xia

We propose a method to compute optimal control paths for autonomous vehicles deployed for the purpose of inferring a velocity field. In addition to being advected by the flow, the vehicles are able to effect a fixed relative speed with…

Optimization and Control · Mathematics 2015-12-09 Damon McDougall , Richard Moore

We introduce a framework for Data Assimilation (DA) in which the data is split into multiple sets corresponding to low-rank projections of the state space. Algorithms are developed that assimilate some or all of the projected data,…

Computation · Statistics 2020-05-19 John Maclean , Erik S Van Vleck

This work presents a distributionally robust Kalman filter to address uncertainties in noise covariance matrices and predicted covariance estimates. We adopt a distributionally robust formulation using bicausal optimal transport to…

Optimization and Control · Mathematics 2025-06-18 Bingyan Han

Estimating the parameters of a probabilistic directed graphical model from incomplete data is a long-standing challenge. This is because, in the presence of latent variables, both the likelihood function and posterior distribution are…

Machine Learning · Computer Science 2024-06-04 Vy Vo , Trung Le , Tung-Long Vuong , He Zhao , Edwin Bonilla , Dinh Phung

A framework for data assimilation combining aspects of operator-theoretic ergodic theory and quantum mechanics is developed. This framework adapts the Dirac--von Neumann formalism of quantum dynamics and measurement to perform sequential…

Mathematical Physics · Physics 2019-09-18 Dimitrios Giannakis

Optimal transport is a geometrically intuitive, robust and flexible metric for sample comparison in data analysis and machine learning. Its formal Riemannian structure allows for a local linearization via a tangent space approximation. This…

Optimization and Control · Mathematics 2024-06-07 Clément Sarrazin , Bernhard Schmitzer

This paper develops a computational framework for optimizing the parameters of data assimilation systems in order to improve their performance. The approach formulates a continuous meta-optimization problem for parameters; the…

Computational Engineering, Finance, and Science · Computer Science 2015-06-16 Alexandru Cioaca , Adrian Sandu

Optimal Transport is a theory that allows to define geometrical notions of distance between probability distributions and to find correspondences, relationships, between sets of points. Many machine learning applications are derived from…

Machine Learning · Statistics 2020-11-10 Titouan Vayer

An optimal transport problem on finite spaces is a linear program. Recently, a relaxation of the optimal transport problem via strictly convex functions, especially via the Kullback--Leibler divergence, sheds new light on data sciences.…

Optimization and Control · Mathematics 2021-03-03 Asuka Takatsu

We introduce Kalman Gradient Descent, a stochastic optimization algorithm that uses Kalman filtering to adaptively reduce gradient variance in stochastic gradient descent by filtering the gradient estimates. We present both a theoretical…

Machine Learning · Statistics 2018-10-30 James Vuckovic

Ensemble transform Kalman filtering (ETKF) data assimilation is often used to combine available observations with numerical simulations to obtain statistically accurate and reliable state representations in dynamical systems. However, it is…

Numerical Analysis · Mathematics 2024-03-07 Tongtong Li , Anne Gelb , Yoonsang Lee

Chaos is ubiquitous in physical systems. The associated sensitivity to initial conditions is a significant obstacle in forecasting the weather and other geophysical fluid flows. Data assimilation is the process whereby the uncertainty in…

Data Analysis, Statistics and Probability · Physics 2020-11-03 Alberto Carrassi , Marc Bocquet , Jonathan Demaeyer , Colin Grudzien , Patrick Raanes , Stephane Vannitsem

Despite the great success of GANs in images translation with different conditioned inputs such as semantic segmentation and edge maps, generating high-fidelity realistic images with reference styles remains a grand challenge in conditional…

Computer Vision and Pattern Recognition · Computer Science 2021-06-22 Fangneng Zhan , Yingchen Yu , Kaiwen Cui , Gongjie Zhang , Shijian Lu , Jianxiong Pan , Changgong Zhang , Feiying Ma , Xuansong Xie , Chunyan Miao

Motivated by the challenge of incorporating data into misspecified and multiscale dynamical models, we study a McKean-Vlasov equation that contains the data stream as a common driving rough path. This setting allows us to prove…

Probability · Mathematics 2023-12-15 Michele Coghi , Torstein Nilssen , Nikolas Nüsken , Sebastian Reich

Data assimilation algorithms are used to estimate the states of a dynamical system using partial and noisy observations. The ensemble Kalman filter has become a popular data assimilation scheme due to its simplicity and robustness for a…

Numerical Analysis · Mathematics 2021-06-23 Gottfried Hastermann , Maria Reinhardt , Rupert Klein , Sebastian Reich

This paper proposes a novel localization framework based on collaborative training or federated learning paradigm, for highly accurate localization of autonomous vehicles. More specifically, we build on the standard approach of KalmanNet, a…

Robotics · Computer Science 2025-02-14 Nikos Piperigkos , Alexandros Gkillas , Christos Anagnostopoulos , Aris S. Lalos

This paper describes a method to filter oscillatory transients from measurements of a time series which were at least an order of magnitude larger than the signal to be measured. Based on a Kalman filter, it has an optimality property and a…

Optimization and Control · Mathematics 2008-09-29 Andreas Mueller