English
Related papers

Related papers: 3D-Var Data Assimilation using a Variational Autoe…

200 papers

In this paper we propose a continuous data assimilation (downscaling) algorithm for the B\'enard convection in porous media using only coarse mesh measurements of the temperature. In this algorithm, we incorporate the observables as a…

Analysis of PDEs · Mathematics 2015-10-12 Aseel Farhat , Evelyn Lunasin , Edriss S. Titi

A wide variety of real-world data, such as sea measurements, e.g., temperatures collected by distributed sensors and multiple unmanned aerial vehicles (UAV) trajectories, can be naturally represented as graphs, often exhibiting…

Machine Learning · Computer Science 2025-11-11 Sivaram Krishnan , Jinho Choi , Jihong Park

Data assimilation leads naturally to a Bayesian formulation in which the posterior probability distribution of the system state, given the observations, plays a central conceptual role. The aim of this paper is to use this Bayesian…

Data Analysis, Statistics and Probability · Physics 2013-01-01 K. J. H. Law , A. M. Stuart

Various types of measurement techniques, such as Light Detection and Ranging (LiDAR) devices, anemometers, and wind vanes, are extensively utilized in wind energy to characterize the inflow. However, these methods typically gather data at…

Fluid Dynamics · Physics 2025-02-13 Chang Yan , Shengfeng Xu , Zhenxu Sun , Thorsten Lutz , Dilong Guo , Guowei Yang

The variational autoencoder (VAE) is a generative model with continuous latent variables where a pair of probabilistic encoder (bottom-up) and decoder (top-down) is jointly learned by stochastic gradient variational Bayes. We first…

Machine Learning · Statistics 2016-04-19 Suwon Suh , Seungjin Choi

Data assimilation is the process of fusing information from imperfect computer simulations with noisy, sparse measurements of reality to obtain improved estimates of the state or parameters of a dynamical system of interest. The data…

Many real-world processes have complex tail dependence structures that cannot be characterized using classical Gaussian processes. More flexible spatial extremes models exhibit appealing extremal dependence properties but are often…

Machine Learning · Statistics 2024-12-19 Likun Zhang , Xiaoyu Ma , Christopher K. Wikle , Raphaël Huser

We introduce an anomaly detection method for multivariate time series data with the aim of identifying critical periods and features influencing extreme climate events like snowmelt in the Arctic. This method leverages the Variational…

Machine Learning · Computer Science 2024-07-16 Tolulope Ale , Nicole-Jeanne Schlegel , Vandana P. Janeja

Variational autoencoders (VAEs) employ Bayesian inference to interpret sensory inputs, mirroring processes that occur in primate vision across both ventral (Higgins et al., 2021) and dorsal (Vafaii et al., 2023) pathways. Despite their…

Machine Learning · Computer Science 2024-12-10 Hadi Vafaii , Dekel Galor , Jacob L. Yates

Building a scalable machine learning system for unsupervised anomaly detection via representation learning is highly desirable. One of the prevalent methods is using a reconstruction error from variational autoencoder (VAE) via maximizing…

Machine Learning · Computer Science 2020-05-08 Seonho Park , George Adosoglou , Panos M. Pardalos

Being one of the most popular generative framework, variational autoencoders(VAE) are known to suffer from a phenomenon termed posterior collapse, i.e. the latent variational distributions collapse to the prior, especially when a strong…

Machine Learning · Computer Science 2021-03-23 Renfei Tu , Yang Liu , Yongzeng Xue , Cheng Wang , Maozu Guo

For oceanographic applications, probabilistic forecasts typically have to deal with i) high-dimensional complex models, and ii) very sparse spatial observations. In search-and-rescue operations at sea, for instance, the short-term…

Applications · Statistics 2023-02-15 Florian Beiser , Håvard Heitlo Holm , Jo Eidsvik

To enable autonomous wind estimation for energy-efficient flight in small unmanned aerial vehicles (UAVs), this study proposes a method that estimates flight states and wind using only the low-cost essential onboard sensors required for…

Robotics · Computer Science 2026-04-23 Bingchen Cheng , Tielin Ma , Jingcheng Fu , Lulu Tao , Tianhui Guo

Variational Autoencoders (VAEs) are powerful generative models that have been widely used in various fields, including image and text generation. However, one of the known challenges in using VAEs is the model's sensitivity to its…

Machine Learning · Computer Science 2024-12-31 Gabriela Sejnova , Michal Vavrecka , Karla Stepanova

While the formulation of most data assimilation schemes assumes an unbiased observation model error, in real applications, model error with nontrivial biases is unavoidable. A practical example is the error in the radiative transfer model…

Methodology · Statistics 2016-11-17 John Harlim , Tyrus Berry

An Ensemble of Data Assimilations (EDA) can provide valuable information on the analysis and short-range forecast uncertainties. The present ECMWF operational ocean analysis and reanalysis system, called ORAS5, produces an ensemble but does…

Atmospheric and Oceanic Physics · Physics 2024-07-08 Marcin Chrust , Anthony T. Weaver , Philip Browne , Hao Zuo , Magdalena Alonso Balmaseda

As one of the most popular generative models, Variational Autoencoder (VAE) approximates the posterior of latent variables based on amortized variational inference. However, when the decoder network is sufficiently expressive, VAE may lead…

Machine Learning · Computer Science 2021-10-26 Dazhong Shen , Chuan Qin , Chao Wang , Hengshu Zhu , Enhong Chen , Hui Xiong

Large climate-model ensembles are computationally expensive; yet many downstream analyses would benefit from additional, statistically consistent realizations of spatiotemporal climate variables. We study a generative modeling approach for…

Machine Learning · Computer Science 2026-01-06 Jacquelyn Shelton , Przemyslaw Polewski , Alexander Robel , Matthew Hoffman , Stephen Price

Advances in data assimilation (DA) methods have greatly improved the accuracy of Earth system predictions. To fuse multi-source data and reconstruct the nonlinear evolution missing from observations, geoscientists are developing…

Atmospheric and Oceanic Physics · Physics 2024-12-19 Qingyu Zheng , Guijun Han , Wei Li , Lige Cao , Gongfu Zhou , Haowen Wu , Qi Shao , Ru Wang , Xiaobo Wu , Xudong Cui , Hong Li , Xuan Wang

Variational data assimilation and deep learning share many algorithmic aspects in common. While the former focuses on system state estimation, the latter provides great inductive biases to learn complex relationships. We here design a…

Machine Learning · Computer Science 2022-11-18 Arthur Filoche , Julien Brajard , Anastase Charantonis , Dominique Béréziat