English
Related papers

Related papers: Lossless Compression with Latent Variable Models

200 papers

This paper introduces Associative Compression Networks (ACNs), a new framework for variational autoencoding with neural networks. The system differs from existing variational autoencoders (VAEs) in that the prior distribution used to model…

Neural and Evolutionary Computing · Computer Science 2018-04-27 Alex Graves , Jacob Menick , Aaron van den Oord

Ensemble methods are among the state-of-the-art predictive modeling approaches. Applied to modern big data, these methods often require a large number of sub-learners, where the complexity of each learner typically grows with the size of…

Machine Learning · Computer Science 2018-10-29 Amichai Painsky , Saharon Rosset

Image compression using colour densities is historically impractical to decompress losslessly. We examine the use of conditional generative adversarial networks in making this transformation more feasible, through learning a mapping between…

Image and Video Processing · Electrical Eng. & Systems 2021-06-22 Arun Jose , Abraham Francis

We develop a lensless compressive imaging architecture, which consists of an aperture assembly and a single sensor, without using any lens. An anytime algorithm is proposed to reconstruct images from the compressive measurements; the…

Computer Vision and Pattern Recognition · Computer Science 2015-08-17 Xin Yuan , Hong Jiang , Gang Huang , Paul Wilford

Recently, large language models (LLMs) have driven promising progress in lossless image compression. However, directly adopting existing paradigms for medical images suffers from an unsatisfactory trade-off between compression performance…

Image and Video Processing · Electrical Eng. & Systems 2025-11-05 Pengcheng Zheng , Xiaorong Pu , Kecheng Chen , Jiaxin Huang , Meng Yang , Bai Feng , Yazhou Ren , Jianan Jiang , Chaoning Zhang , Yang Yang , Heng Tao Shen

Deep learning based image compression has recently witnessed exciting progress and in some cases even managed to surpass transform coding based approaches that have been established and refined over many decades. However, state-of-the-art…

Computer Vision and Pattern Recognition · Computer Science 2020-08-25 Leonhard Helminger , Abdelaziz Djelouah , Markus Gross , Christopher Schroers

Lossless image compression is required in various applications to reduce storage or transmission costs of images, while requiring the reconstructed images to have zero information loss compared to the original. Existing lossless image…

Information Theory · Computer Science 2024-09-12 Samar Agnihotri , Renu Rameshan , Ritwik Ghosal

Variational Autoencoders (VAEs) are powerful generative models that have been widely used in various fields, including image and text generation. However, one of the known challenges in using VAEs is the model's sensitivity to its…

Machine Learning · Computer Science 2024-12-31 Gabriela Sejnova , Michal Vavrecka , Karla Stepanova

Generative models have demonstrated strong performance in conditional settings and can be viewed as a form of data compression, where the condition serves as a compact representation. However, their limited controllability and…

Machine Learning · Computer Science 2025-07-04 Xiao Li , Liangji Zhu , Anand Rangarajan , Sanjay Ranka

Recent advances in generative compression methods have demonstrated remarkable progress in enhancing the perceptual quality of compressed data, especially in scenarios with low bitrates. However, their efficacy and applicability to achieve…

Computer Vision and Pattern Recognition · Computer Science 2023-12-18 Qi Mao , Tinghan Yang , Yinuo Zhang , Zijian Wang , Meng Wang , Shiqi Wang , Siwei Ma

Despite progress in training neural networks for lossy image compression, current approaches fail to maintain both perceptual quality and abstract features at very low bitrates. Encouraged by recent success in learning discrete…

Machine Learning · Computer Science 2020-10-19 Will Williams , Sam Ringer , Tom Ash , John Hughes , David MacLeod , Jamie Dougherty

This study presents a new lossy image compression method that utilizes the multi-scale features of natural images. Our model consists of two networks: multi-scale lossy autoencoder and parallel multi-scale lossless coder. The multi-scale…

Machine Learning · Statistics 2018-05-17 Ken Nakanishi , Shin-ichi Maeda , Takeru Miyato , Daisuke Okanohara

Digital imaging systems have traditionally relied on brute-force measurement and processing of pixels arranged on regular grids. In contrast, the human visual system performs significant data reduction from the large number of…

Image and Video Processing · Electrical Eng. & Systems 2025-03-25 Matheus Souza , Yidan Zheng , Kaizhang Kang , Yogeshwar Nath Mishra , Qiang Fu , Wolfgang Heidrich

Data used for analytics and machine learning often take the form of tables with categorical entries. We introduce a family of lossless compression algorithms for such data that proceed in four steps: $(i)$ Estimate latent variables…

Information Theory · Computer Science 2023-02-21 Andrea Montanari , Eric Weiner

The volume of remote sensing data is experiencing rapid growth, primarily due to the plethora of space and air platforms equipped with an array of sensors. Due to limited hardware and battery constraints the data is transmitted back to…

Image and Video Processing · Electrical Eng. & Systems 2024-04-18 Alessandro Giuliano , S. Andrew Gadsden , Waleed Hilal , John Yawney

Autoregressive models have achieved impressive results over a wide range of domains in terms of generation quality and downstream task performance. In the continuous domain, a key factor behind this success is the usage of quantized latent…

Machine Learning · Computer Science 2023-01-23 Emilian Postolache , Giorgio Mariani , Michele Mancusi , Andrea Santilli , Luca Cosmo , Emanuele Rodolà

We present a learned image compression system based on GANs, operating at extremely low bitrates. Our proposed framework combines an encoder, decoder/generator and a multi-scale discriminator, which we train jointly for a generative learned…

Computer Vision and Pattern Recognition · Computer Science 2019-08-20 Eirikur Agustsson , Michael Tschannen , Fabian Mentzer , Radu Timofte , Luc Van Gool

As an alternative to variable selection or shrinkage in high dimensional regression, we propose to randomly compress the predictors prior to analysis. This dramatically reduces storage and computational bottlenecks, performing well when the…

Machine Learning · Statistics 2013-03-26 Rajarshi Guhaniyogi , David B. Dunson

Early works on medical image compression date to the 1980's with the impetus on deployment of teleradiology systems for high-resolution digital X-ray detectors. Commercially deployed systems during the period could compress 4,096 x 4,096…

Computer Vision and Pattern Recognition · Computer Science 2018-05-21 Aupendu Kar , Sri Phani Krishna Karri , Nirmalya Ghosh , Ramanathan Sethuraman , Debdoot Sheet

In this paper, we propose to enhance learned image compression systems with a richer probability model for the latent variables. Previous works model the latents with a Gaussian or a Laplace distribution. Inspired by binary arithmetic…

Image and Video Processing · Electrical Eng. & Systems 2020-02-24 Théo Ladune , Pierrick Philippe , Wassim Hamidouche , Lu Zhang , Olivier Deforges