English
Related papers

Related papers: Compressing high-resolution data through latent re…

200 papers

Despite advances in the programmable logic capabilities of modern trigger systems, a significant bottleneck remains in the amount of data to be transported from the detector to off-detector logic where trigger decisions are made. We…

Today's HPC applications are producing extremely large amounts of data, such that data storage and analysis are becoming more challenging for scientific research. In this work, we design a new error-controlled lossy compression algorithm…

Information Theory · Computer Science 2017-06-14 Dingwen Tao , Sheng Di , Zizhong Chen , Franck Cappello

Representation learning seeks to expose certain aspects of observed data in a learned representation that's amenable to downstream tasks like classification. For instance, a good representation for 2D images might be one that describes only…

Machine Learning · Computer Science 2017-03-07 Xi Chen , Diederik P. Kingma , Tim Salimans , Yan Duan , Prafulla Dhariwal , John Schulman , Ilya Sutskever , Pieter Abbeel

Multivariate time series anomaly detection is a crucial problem in many industrial and research applications. Timely detection of anomalies allows, for instance, to prevent defects in manufacturing processes and failures in cyberphysical…

Machine Learning · Computer Science 2024-03-06 Marcin Pietroń , Dominik Żurek , Kamil Faber , Roberto Corizzo

Data assimilation (DA) combines model forecasts and observations to estimate the optimal state of the atmosphere with its uncertainty, providing initial conditions for weather prediction and reanalyses for climate research. Yet, existing…

Machine Learning · Computer Science 2026-03-05 Hang Fan , Juan Nathaniel , Yi Xiao , Ce Bian , Fenghua Ling , Ben Fei , Lei Bai , Pierre Gentine

Despite progress in training neural networks for lossy image compression, current approaches fail to maintain both perceptual quality and abstract features at very low bitrates. Encouraged by recent success in learning discrete…

Machine Learning · Computer Science 2020-10-19 Will Williams , Sam Ringer , Tom Ash , John Hughes , David MacLeod , Jamie Dougherty

In this paper, we introduce a Variational Autoencoder (VAE) based training approach that can compress and decompress cancer pathology slides at a compression ratio of 1:512, which is better than the previously reported state of the art…

We present Qwen-Image-VAE-2.0, a suite of high-compression Variational Autoencoders (VAEs) that achieve significant advances in both reconstruction fidelity and diffusability. To address the reconstruction bottlenecks of high compression,…

High-dimensional datasets often exhibit low-dimensional geometric structures, as suggested by the manifold hypothesis, which implies that data lie on a smooth manifold embedded in a higher-dimensional ambient space. While this insight…

Machine Learning · Computer Science 2025-07-11 Paola Causin , Alessio Marta

AI models have garnered significant research attention towards predictive task automation. However, a stationary training environment is an underlying assumption for most models and such models simply do not work on non-stationary data…

Machine Learning · Computer Science 2025-04-29 Hassan Wasswa , Aziida Nanyonga , Timothy Lynar

The manifold hypothesis states that high-dimensional data can be modeled as lying on or near a low-dimensional, nonlinear manifold. Variational Autoencoders (VAEs) approximate this manifold by learning mappings from low-dimensional latent…

Machine Learning · Statistics 2021-03-03 Marissa C. Connor , Gregory H. Canal , Christopher J. Rozell

Kilometer-scale Earth system models are essential for capturing local climate change. However, these models are computationally expensive and produce petabyte-scale outputs, which limits their utility for applications such as probabilistic…

Machine Learning · Computer Science 2026-01-22 Johannes Meuer , Maximilian Witte , Étiénne Plésiat , Thomas Ludwig , Christopher Kadow

Dataset condensation can be used to reduce the computational cost of training multiple models on a large dataset by condensing the training dataset into a small synthetic set. State-of-the-art approaches rely on matching the model gradients…

Machine Learning · Computer Science 2024-05-29 Mucong Ding , Yuancheng Xu , Tahseen Rabbani , Xiaoyu Liu , Brian Gravelle , Teresa Ranadive , Tai-Ching Tuan , Furong Huang

While most existing neural image compression (NIC) and neural video compression (NVC) methodologies have achieved remarkable success, their optimization is primarily focused on human visual perception. However, with the rapid development of…

Computer Vision and Pattern Recognition · Computer Science 2025-01-09 Lei Liu , Zhenghao Chen , Zhihao Hu , Dong Xu

Sensor fusion can significantly improve the performance of many computer vision tasks. However, traditional fusion approaches are either not data-driven and cannot exploit prior knowledge nor find regularities in a given dataset or they are…

Computer Vision and Pattern Recognition · Computer Science 2022-09-26 Fabian Duffhauss , Ngo Anh Vien , Hanna Ziesche , Gerhard Neumann

Error-bounded lossy compression is becoming an indispensable technique for the success of today's scientific projects with vast volumes of data produced during simulations or instrument data acquisitions. Not only can it significantly…

Machine Learning · Computer Science 2023-10-24 Jinyang Liu , Sheng Di , Kai Zhao , Sian Jin , Dingwen Tao , Xin Liang , Zizhong Chen , Franck Cappello

In this study, we develop a novel multi-fidelity deep learning approach that transforms low-fidelity solution maps into high-fidelity ones by incorporating parametric space information into a standard autoencoder architecture. This method's…

Computational Engineering, Finance, and Science · Computer Science 2024-05-08 Rasoul Najafi Koopas , Shahed Rezaei , Natalie Rauter , Richard Ostwald , Rolf Lammering

The ever-growing volume of data in imaging sciences stemming from the advancements in imaging technologies, necessitates efficient and reliable storage solutions for such large datasets. This study investigates the compression of industrial…

Image and Video Processing · Electrical Eng. & Systems 2025-10-24 Bardia Hejazi , Keerthana Chand , Tobias Fritsch , Giovanni Bruno

Image restoration under adverse weather conditions (e.g., rain, snow and haze) is a fundamental computer vision problem and has important indications for various downstream applications. Different from early methods that are specially…

Computer Vision and Pattern Recognition · Computer Science 2023-06-16 Zhentao Tan , Yue Wu , Qiankun Liu , Qi Chu , Le Lu , Jieping Ye , Nenghai Yu

An autoencoder is a self-supervised machine-learning network trained to output a quantity identical to the input. Owing to its structure possessing a bottleneck with a lower dimension, an autoencoder works to achieve data compression,…

Fluid Dynamics · Physics 2025-07-02 Koji Fukagata , Kai Fukami