English
Related papers

Related papers: 3D-Var Data Assimilation using a Variational Autoe…

200 papers

Data assimilation (DA) is a fundamental computational technique that integrates numerical simulation models and observation data on the basis of Bayesian statistics. Originally developed for meteorology, especially weather forecasting, DA…

In order to leverage the information embedded in the background state and observations, covariance matrices modelling is a pivotal point in data assimilation algorithms. These matrices are often estimated from an ensemble of observations or…

Methodology · Statistics 2019-10-22 Sibo Cheng , Jean-Philippe Argaud , Bertrand Iooss , Didier Lucor , Angélique Ponçot

Constructing a compressed latent space through a variational autoencoder (VAE) is the key for efficient 3D diffusion models. This paper introduces COD-VAE that encodes 3D shapes into a COmpact set of 1D latent vectors without sacrificing…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 In Cho , Youngbeom Yoo , Subin Jeon , Seon Joo Kim

This study evaluates the effectiveness of three-dimensional variational (3D-Var) data assimilation coupled with a Rapid Update Cycle (RUC) framework for improving short-range precipitation forecasts over the Indonesian Maritime Continent…

The problem of effectively combining data with a mathematical model constitutes a major challenge in applied mathematics. It is particular challenging for high-dimensional dynamical systems where data is received sequentially in time and…

Dynamical Systems · Mathematics 2013-04-08 K. J. H. Law , A. Shukla , A. M. Stuart

Variational Auto-encoders (VAEs) have been very successful as methods for forming compressed latent representations of complex, often high-dimensional, data. In this paper, we derive an alternative variational lower bound from the one…

Machine Learning · Computer Science 2019-03-20 Shuyu Lin , Ronald Clark , Robert Birke , Niki Trigoni , Stephen Roberts

The variational autoencoder (VAE) is a popular deep latent variable model used to analyse high-dimensional datasets by learning a low-dimensional latent representation of the data. It simultaneously learns a generative model and an…

Machine Learning · Computer Science 2023-11-21 Mine Öğretir , Siddharth Ramchandran , Dimitrios Papatheodorou , Harri Lähdesmäki

Learning interpretable and disentangled representations of data is a key topic in machine learning research. Variational Autoencoder (VAE) is a scalable method for learning directed latent variable models of complex data. It employs a clear…

Machine Learning · Computer Science 2020-06-04 Andriy Serdega , Dae-Shik Kim

As deep Variational Auto-Encoder (VAE) frameworks become more widely used for modeling biomolecular simulation data, we emphasize the capability of the VAE architecture to concurrently maximize the timescale of the latent space while…

Chemical Physics · Physics 2021-12-08 Hannah K. Wayment-Steele , Vijay S. Pande

Ultra-rapid data assimilation (URDA) is a method that rapidly updates preemptive forecasts derived from observations without integrating a dynamical model each time additional observations become available. Due to its computational…

Geophysics · Physics 2026-05-19 Fumitoshi Kawasaki , Atsushi Okazaki , Kenta Kurosawa , Shunji Kotsuki

We introduce an information-theoretic framework that uses variational autoencoders (VAEs) to extract compact, physically interpretable manifolds from high-dimensional flow-field data. To this end, the Kullback--Leibler (KL) divergence in…

Fluid Dynamics · Physics 2026-04-21 Zhiyuan Wang , Iacopo Tirelli , Stefano Discetti , Andrea Ianiro

Recent studies have demonstrated that it is possible to combine machine learning with data assimilation to reconstruct the dynamics of a physical model partially and imperfectly observed. Data assimilation is used to estimate the system…

Machine Learning · Statistics 2022-10-26 Alban Farchi , Marcin Chrust , Marc Bocquet , Patrick Laloyaux , Massimo Bonavita

While unsupervised variational autoencoders (VAE) have become a powerful tool in neuroimage analysis, their application to supervised learning is under-explored. We aim to close this gap by proposing a unified probabilistic model for…

Machine Learning · Computer Science 2019-07-15 Qingyu Zhao , Ehsan Adeli , Nicolas Honnorat , Tuo Leng , Kilian M. Pohl

In applications such as free-space optical communication, a signal is often recovered after propagation through a turbulent medium. In this setting, it is common to assume that limited information is known about the turbulent medium, such…

Optics · Physics 2025-10-13 Anjali Nair , Qin Li , Samuel N. Stechmann

The Reynolds-averaged Navier-Stokes (RANS) equations provide a computationally efficient method for solving fluid flow problems in engineering applications. However, the use of closure models to represent turbulence effects can reduce their…

Fluid Dynamics · Physics 2024-05-02 Oliver Brenner , Justin Plogmann , Pasha Piroozmand , Patrick Jenny

Data assimilation of observational data into full atmospheric states is essential for weather forecast model initialization. Recently, methods for deep generative data assimilation have been proposed which allow for using new input data…

Data assimilation algorithms estimate the state of a dynamical system from partial observations, where the successful performance of these algorithms hinges on costly parameter tuning and on employing an accurate model for the dynamics.…

Machine Learning · Statistics 2026-03-24 Melissa Adrian , Daniel Sanz-Alonso , Rebecca Willett

Distributed learning and Edge AI necessitate efficient data processing, low-latency communication, decentralized model training, and stringent data privacy to facilitate real-time intelligence on edge devices while reducing dependency on…

Machine Learning · Computer Science 2025-07-08 Lucas Heublein , Simon Kocher , Tobias Feigl , Alexander Rügamer , Christopher Mutschler , Felix Ott

We present an autoencoder that leverages learned representations to better measure similarities in data space. By combining a variational autoencoder with a generative adversarial network we can use learned feature representations in the…

Machine Learning · Computer Science 2016-02-12 Anders Boesen Lindbo Larsen , Søren Kaae Sønderby , Hugo Larochelle , Ole Winther

Data assimilation combines forecasts from a numerical model with observations. Most of the current data assimilation algorithms consider the model and observation error terms as additive Gaussian noise, specified by their covariance…