English
Related papers

Related papers: Compressing high-resolution data through latent re…

200 papers

Scientists conduct large-scale simulations to compute derived quantities-of-interest (QoI) from primary data. Often, QoI are linked to specific features, regions, or time intervals, such that data can be adaptively reduced without…

Machine Learning · Computer Science 2024-05-03 Xiao Li , Qian Gong , Jaemoon Lee , Scott Klasky , Anand Rangarajan , Sanjay Ranka

In meteorology, finding similar weather patterns or analogs in historical datasets can be useful for data assimilation, forecasting, and postprocessing. In climate science, analogs in historical and climate projection data are used for…

Machine Learning · Computer Science 2025-04-29 Geert De Paepe , Lesley De Cruz

Data assimilation of atmospheric observations traditionally relies on variational and Kalman filter methods. Here, an alternative neural-network data assimilation (NNDA) with variational autoencoder (VAE) is proposed. The three-dimensional…

Atmospheric and Oceanic Physics · Physics 2024-04-29 Boštjan Melinc , Žiga Zaplotnik

The variational autoencoder (VAE) is a popular deep latent variable model used to analyse high-dimensional datasets by learning a low-dimensional latent representation of the data. It simultaneously learns a generative model and an…

Machine Learning · Computer Science 2023-11-21 Mine Öğretir , Siddharth Ramchandran , Dimitrios Papatheodorou , Harri Lähdesmäki

The demand for high-resolution information on climate change is critical for accurate projections and decision-making. Presently, this need is addressed through high-resolution climate models or downscaling. High-resolution models are…

High-energy large-scale particle colliders generate data at extraordinary rates. Developing real-time high-throughput data compression algorithms to reduce data volume and meet the bandwidth requirement for storage has become increasingly…

Variational Autoencoders and their many variants have displayed impressive ability to perform dimensionality reduction, often achieving state-of-the-art performance. Many current methods however, struggle to learn good representations in…

Machine Learning · Computer Science 2023-06-28 Navindu Leelarathna , Andrei Margeloiu , Mateja Jamnik , Nikola Simidjievski

Motivated by the ever-increasing demands for limited communication bandwidth and low-power consumption, we propose a new methodology, named joint Variational Autoencoders with Bernoulli mixture models (VAB), for performing clustering in the…

Image and Video Processing · Electrical Eng. & Systems 2020-06-11 Suya Wu , Enmao Diao , Jie Ding , Vahid Tarokh

Often the analysis of time-dependent chemical and biophysical systems produces high-dimensional time-series data for which it can be difficult to interpret which individual features are most salient. While recent work from our group and…

Variational Auto-encoders (VAEs) have been very successful as methods for forming compressed latent representations of complex, often high-dimensional, data. In this paper, we derive an alternative variational lower bound from the one…

Machine Learning · Computer Science 2019-03-20 Shuyu Lin , Ronald Clark , Robert Birke , Niki Trigoni , Stephen Roberts

Recently, numerous learning-based compression methods have been developed with outstanding performance for the coding of the geometry information of point clouds. On the contrary, limited explorations have been devoted to point cloud…

Image and Video Processing · Electrical Eng. & Systems 2022-04-05 Jianqiang Wang , Zhan Ma

Large-scale numerical simulations often produce high-dimensional gridded data that is challenging to process for downstream applications. A prime example is numerical weather prediction, where atmospheric processes are modeled using…

Machine Learning · Computer Science 2025-02-10 Jieyu Chen , Kevin Höhlein , Sebastian Lerch

Compressed sensing techniques enable efficient acquisition and recovery of sparse, high-dimensional data signals via low-dimensional projections. In this work, we propose Uncertainty Autoencoders, a learning framework for unsupervised…

Machine Learning · Statistics 2019-04-15 Aditya Grover , Stefano Ermon

Inverse problems often involve matching observational data using a physical model that takes a large number of parameters as input. These problems tend to be under-constrained and require regularization to impose additional structure on the…

Computational Physics · Physics 2019-06-07 Daniel O'Malley , John K. Golden , Velimir V. Vesselinov

In this paper, we propose a new method to perform data augmentation in a reliable way in the High Dimensional Low Sample Size (HDLSS) setting using a geometry-based variational autoencoder. Our approach combines a proper latent space…

Machine Learning · Statistics 2023-01-18 Clément Chadebec , Elina Thibeau-Sutre , Ninon Burgos , Stéphanie Allassonnière

Variational auto-encoders (VAEs) have proven to be a well suited tool for performing dimensionality reduction by extracting latent variables lying in a potentially much smaller dimensional space than the data. Their ability to capture…

Machine Learning · Statistics 2020-10-23 Clément Chadebec , Clément Mantoux , Stéphanie Allassonnière

Unmanned underwater image analysis for marine monitoring faces two key challenges: (i) degraded image quality due to light attenuation and (ii) hardware storage constraints limiting high-resolution image collection. Existing methods…

Computer Vision and Pattern Recognition · Computer Science 2024-11-25 Rita Pucci , Niki Martinel

Lidars are depth measuring sensors widely used in autonomous driving and augmented reality. However, the large volume of data produced by lidars can lead to high costs in data storage and transmission. While lidar data can be represented as…

Image and Video Processing · Electrical Eng. & Systems 2022-06-07 Xuanyu Zhou , Charles R. Qi , Yin Zhou , Dragomir Anguelov

In collider-based particle and nuclear physics experiments, data are produced at such extreme rates that only a subset can be recorded for later analysis. Typically, algorithms select individual collision events for preservation and store…

High Energy Physics - Phenomenology · Physics 2022-12-20 Jack H. Collins , Yifeng Huang , Simon Knapen , Benjamin Nachman , Daniel Whiteson

In recent years, the task of video prediction-forecasting future video given past video frames-has attracted attention in the research community. In this paper we propose a novel approach to this problem with Vector Quantized Variational…

Computer Vision and Pattern Recognition · Computer Science 2021-03-03 Jacob Walker , Ali Razavi , Aäron van den Oord