English
Related papers

Related papers: Lossy Image Compression with Quantized Hierarchica…

200 papers

When training end-to-end learned models for lossy compression, one has to balance the rate and distortion losses. This is typically done by manually setting a tradeoff parameter $\beta$, an approach called $\beta$-VAE. Using this approach…

Machine Learning · Computer Science 2020-05-11 Ties van Rozendaal , Guillaume Sautière , Taco S. Cohen

In the realm of image processing and computer vision (CV), machine learning (ML) architectures are widely applied. Convolutional neural networks (CNNs) solve a wide range of image processing issues and can solve image compression problem.…

Image and Video Processing · Electrical Eng. & Systems 2022-01-25 Sonain Jamil , Md. Jalil Piran , MuhibUrRahman

Density estimation, compression and data generation are crucial tasks in artificial intelligence. Variational Auto-Encoders (VAEs) constitute a single framework to achieve these goals. Here, we present a novel class of generative models,…

Machine Learning · Statistics 2021-07-07 Ioannis Gatopoulos , Jakub M. Tomczak

Variational Autoencoders (VAEs), as a form of deep generative model, have been widely used in recent years, and shown great great peformance in a number of different domains, including image generation and anomaly detection, etc.. This…

Machine Learning · Computer Science 2024-08-28 Liang Cheng , Peiyuan Guan , Amir Taherkordi , Lei Liu , Dapeng Lan

Variational Autoencoders (VAEs) have seen widespread use in learned image compression. They are used to learn expressive latent representations on which downstream compression methods can operate with high efficiency. Recently proposed…

Information Theory · Computer Science 2021-04-20 Gergely Flamich , Marton Havasi , José Miguel Hernández-Lobato

Representation learning seeks to expose certain aspects of observed data in a learned representation that's amenable to downstream tasks like classification. For instance, a good representation for 2D images might be one that describes only…

Machine Learning · Computer Science 2017-03-07 Xi Chen , Diederik P. Kingma , Tim Salimans , Yan Duan , Prafulla Dhariwal , John Schulman , Ilya Sutskever , Pieter Abbeel

Modern computer vision requires processing large amounts of data, both while training the model and/or during inference, once the model is deployed. Scenarios where images are captured and processed in physically separated locations are…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Sudeep Katakol , Basem Elbarashy , Luis Herranz , Joost van de Weijer , Antonio M. Lopez

This study presents a new lossy image compression method that utilizes the multi-scale features of natural images. Our model consists of two networks: multi-scale lossy autoencoder and parallel multi-scale lossless coder. The multi-scale…

Machine Learning · Statistics 2018-05-17 Ken Nakanishi , Shin-ichi Maeda , Takeru Miyato , Daisuke Okanohara

We describe an end-to-end trainable model for image compression based on variational autoencoders. The model incorporates a hyperprior to effectively capture spatial dependencies in the latent representation. This hyperprior relates to side…

Image and Video Processing · Electrical Eng. & Systems 2018-05-02 Johannes Ballé , David Minnen , Saurabh Singh , Sung Jin Hwang , Nick Johnston

Paradoxically, a Variational Autoencoder (VAE) could be pushed in two opposite directions, utilizing powerful decoder model for generating realistic images but collapsing the learned representation, or increasing regularization coefficient…

Machine Learning · Computer Science 2022-03-30 Trung Ngo , Najwa Laabid , Ville Hautamäki , Merja Heinäniemi

As a widely recognized approach to deep generative modeling, Variational Auto-Encoders (VAEs) still face challenges with the quality of generated images, often presenting noticeable blurriness. This issue stems from the unrealistic…

Machine Learning · Computer Science 2023-05-22 Georgios Batzolis , Jan Stanczuk , Carola-Bibiane Schönlieb

Variable rate is a requirement for flexible and adaptable image and video compression. However, deep image compression methods are optimized for a single fixed rate-distortion tradeoff. While this can be addressed by training multiple…

Image and Video Processing · Electrical Eng. & Systems 2020-07-23 Fei Yang , Luis Herranz , Joost van de Weijer , José A. Iglesias Guitián , Antonio López , Mikhail Mozerov

Recent advances in deep generative modeling have enabled efficient modeling of high dimensional data distributions and opened up a new horizon for solving data compression problems. Specifically, autoencoder based learned image or video…

Machine Learning · Computer Science 2020-04-10 Adam Golinski , Reza Pourreza , Yang Yang , Guillaume Sautiere , Taco S Cohen

We extensively study how to combine Generative Adversarial Networks and learned compression to obtain a state-of-the-art generative lossy compression system. In particular, we investigate normalization layers, generator and discriminator…

Image and Video Processing · Electrical Eng. & Systems 2020-10-26 Fabian Mentzer , George Toderici , Michael Tschannen , Eirikur Agustsson

In this paper we present a a deep generative model for lossy video compression. We employ a model that consists of a 3D autoencoder with a discrete latent space and an autoregressive prior used for entropy coding. Both autoencoder and prior…

Image and Video Processing · Electrical Eng. & Systems 2020-05-11 Amirhossein Habibian , Ties van Rozendaal , Jakub M. Tomczak , Taco S. Cohen

Variational auto-encoders (VAEs) provide an attractive solution to image generation problem. However, they tend to produce blurred and over-smoothed images due to their dependence on pixel-wise reconstruction loss. This paper introduces a…

Computer Vision and Pattern Recognition · Computer Science 2018-04-30 Salman H. Khan , Munawar Hayat , Nick Barnes

Rate-distortion optimization through neural networks has accomplished competitive results in compression efficiency and image quality. This learning-based approach seeks to minimize the compromise between compression rate and reconstructed…

Computer Vision and Pattern Recognition · Computer Science 2024-06-11 Raül Pérez-Gonzalo , Andreas Espersen , Antonio Agudo

We develop a simple and elegant method for lossless compression using latent variable models, which we call 'bits back with asymmetric numeral systems' (BB-ANS). The method involves interleaving encode and decode steps, and achieves an…

Machine Learning · Computer Science 2021-04-23 James Townsend

Variational autoencoders (VAEs) are widely used deep generative models capable of learning unsupervised latent representations of data. Such representations are often difficult to interpret or control. We consider the problem of…

Machine Learning · Computer Science 2018-12-18 Jack Klys , Jake Snell , Richard Zemel

In end-to-end optimized learned image compression, it is standard practice to use a convolutional variational autoencoder with generalized divisive normalization (GDN) to transform images into a latent space. Recently, Operational Neural…

Image and Video Processing · Electrical Eng. & Systems 2021-05-31 M. Akın Yılmaz , Onur Keleş , Hilal Güven , A. Murat Tekalp , Junaid Malik , Serkan Kıranyaz