English
Related papers

Related papers: Latent Space Data Assimilation by using Deep Learn…

200 papers

Federated Learning (FL) enables clients to share learning parameters instead of local data, reducing communication overhead. Traditional wireless networks face latency challenges with FL. In contrast, Cell-Free Massive MIMO (CFmMIMO) can…

Machine Learning · Computer Science 2024-12-31 Afsaneh Mahmoudi , Ming Xiao , Emil Björnson

The Ensemble Kalman Filter (EnKF) has achieved great successes in data assimilation in atmospheric and oceanic sciences, but its failure in convergence to the right filtering distribution precludes its use for uncertainty quantification. We…

Methodology · Statistics 2021-05-13 Peiyi Zhang , Qifan Song , Faming Liang

This work introduces a new, distributed implementation of the Ensemble Kalman Filter (EnKF) that allows for non-sequential assimilation of large datasets in high-dimensional problems. The traditional EnKF algorithm is computationally…

Machine Learning · Statistics 2023-11-23 Cédric Travelletti , Jörg Franke , David Ginsbourger , Stefan Brönnimann

In this paper, we show that the performance of a learnt generative model is closely related to the model's ability to accurately represent the inferred \textbf{latent data distribution}, i.e. its topology and structural properties. We…

Computer Vision and Pattern Recognition · Computer Science 2020-09-02 Shuyu Lin , Ronald Clark

Data Augmentation (DA) is a technique to increase the quantity and diversity of the training data, and by that alleviate overfitting and improve generalisation. However, standard DA produces synthetic data for augmentation with limited…

Computer Vision and Pattern Recognition · Computer Science 2023-07-24 Lorenzo Tronchin , Minh H. Vu , Paolo Soda , Tommy Löfstedt

Kalman Filter requires the true parameters of the model and solves optimal state estimation recursively. Expectation Maximization (EM) algorithm is applicable for estimating the parameters of the model that are not available before Kalman…

Machine Learning · Computer Science 2021-05-26 Zhuangwei Shi

Machine learning-based weather models have shown great promise in producing accurate forecasts but have struggled when applied to data assimilation tasks, unlike traditional numerical weather prediction (NWP) models. This study introduces…

Machine Learning · Computer Science 2024-12-03 Xiaoxu Tian

Estimating background-error covariances remains a core challenge in variational data assimilation (DA). Operational systems typically approximate these covariances by transformations that separate geostrophically balanced components from…

Atmospheric and Oceanic Physics · Physics 2026-01-21 Boštjan Melinc , Uroš Perkan , Žiga Zaplotnik

The Kalman filter is a fundamental tool for state estimation in dynamical systems. While originally developed for linear Gaussian settings, it has been extended to nonlinear problems through approaches such as the extended and unscented…

Optimization and Control · Mathematics 2025-09-10 Yuan Wu , Sicheng He

The reconstruction of the dynamics of an observed physical system as a surrogate model has been brought to the fore by recent advances in machine learning. To deal with partial and noisy observations in that endeavor, machine learning…

Machine Learning · Statistics 2020-10-06 Marc Bocquet , Alban Farchi , Quentin Malartic

Data assimilation (DA) is integrated with machine learning in order to perform entirely data-driven online state estimation. To achieve this, recurrent neural networks (RNNs) are implemented as surrogate models to replace key components of…

Indoor localization is a challenging problem that - unlike outdoor localization - lacks a universal and robust solution. Machine Learning (ML), particularly Deep Learning (DL), methods have been investigated as a promising approach.…

Systems and Control · Electrical Eng. & Systems 2024-08-29 Omer Gokalp Serbetci , Daoud Burghal , Andreas F. Molisch

Learning compact and meaningful latent space representations has been shown to be very useful in generative modeling tasks for visual data. One particular example is applying Vector Quantization (VQ) in variational autoencoders (VQ-VAEs,…

Machine Learning · Computer Science 2024-09-18 Xin Li , Anand Sarwate

An ensemble Kalman filter (EnKF)-based mixed model (EnKF-MM) is proposed for the subgrid-scale (SGS) closure in the large-eddy simulation (LES) of turbulence. The model coefficients are determined through the EnKF-based data assimilation…

Fluid Dynamics · Physics 2023-08-16 Yunpeng Wang , Zelong Yuan , Jianchun Wang

In recent years, the prosperity of deep learning has revolutionized the Artificial Neural Networks. However, the dependence of gradients and the offline training mechanism in the learning algorithms prevents the ANN for further improvement.…

Machine Learning · Computer Science 2020-10-07 Chong Chen , Qinghui Xing , Xin Ding , Yaru Xue , Tianfu Zhong

The identification of the governing equations of chaotic dynamical systems from data has recently emerged as a hot topic. While the seminal work by Brunton et al. reported proof-of-concepts for idealized observation setting for…

Machine Learning · Computer Science 2019-03-26 Duong Nguyen , Said Ouala , Lucas Drumetz , Ronan Fablet

Particle filters are computational techniques for estimating the state of dynamical systems by integrating observational data with model predictions. This work introduces a class of Localized Particle Filters (LPFs) that exploit spatial…

Applications · Statistics 2025-07-10 Dan Crisan , Eliana Fausti

In Wang & Pan (J. Fluid Mech., vol. 918, A19, 2021), the authors developed the first ensemble-based data assimilation (DA) capability for the reconstruction and forecast of ocean surface waves, namely the EnKF-HOS method coupling an…

Fluid Dynamics · Physics 2022-10-12 Guangyao Wang , Jinfeng Zhang , Yuxiang Ma , Qinghe Zhang , Zhilin Li , Yulin Pan

This study investigates the integration of machine learning (ML) and data assimilation (DA) techniques, focusing on implementing surrogate models for Geological Carbon Storage (GCS) projects while maintaining high fidelity physical results…

Machine Learning · Computer Science 2025-11-10 G. S. Seabra , N. T. Mücke , V. L. S. Silva , D. Voskov , F. Vossepoel

Computational Fluid Dynamics (CFD) is a hugely important subject with applications in almost every engineering field, however, fluid simulations are extremely computationally and memory demanding. Towards this end, we present Lat-Net, a…

Machine Learning · Statistics 2017-05-26 Oliver Hennigh