English
Related papers

Related papers: HiLLoC: Lossless Image Compression with Hierarchic…

200 papers

We propose a novel algorithm for quantizing continuous latent representations in trained models. Our approach applies to deep probabilistic models, such as variational autoencoders (VAEs), and enables both data and model compression. Unlike…

Image and Video Processing · Electrical Eng. & Systems 2020-09-09 Yibo Yang , Robert Bamler , Stephan Mandt

Large language models (LLMs) have revolutionized numerous applications, yet their deployment remains challenged by memory constraints on local devices. While scaling laws have enhanced LLM capabilities, the primary bottleneck has shifted…

Computation and Language · Computer Science 2025-02-18 Xinghao Wang , Pengyu Wang , Bo Wang , Dong Zhang , Yunhua Zhou , Xipeng Qiu

We present a hierarchical VAE that, for the first time, generates samples quickly while outperforming the PixelCNN in log-likelihood on all natural image benchmarks. We begin by observing that, in theory, VAEs can actually represent…

Machine Learning · Computer Science 2021-03-18 Rewon Child

Raw images preserve linear sensor measurements and high bit-depth information crucial for advanced vision tasks and photography applications, yet their storage remains challenging due to large file sizes, varying bit depths, and…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Chunhang Zheng , Tongda Xu , Mingli Xie , Yan Wang , Dou Li

We describe an end-to-end trainable model for image compression based on variational autoencoders. The model incorporates a hyperprior to effectively capture spatial dependencies in the latent representation. This hyperprior relates to side…

Image and Video Processing · Electrical Eng. & Systems 2018-05-02 Johannes Ballé , David Minnen , Saurabh Singh , Sung Jin Hwang , Nick Johnston

Deep learning-based lossless compression methods offer substantial advantages in compressing medical volumetric images. Nevertheless, many learning-based algorithms encounter a trade-off between practicality and compression performance.…

Image and Video Processing · Electrical Eng. & Systems 2023-11-29 Qianhao Chen , Jietao Chen

The bits-back argument suggests that latent variable models can be turned into lossless compression schemes. Translating the bits-back argument into efficient and practical lossless compression schemes for general latent variable models,…

Machine Learning · Computer Science 2019-10-03 Friso H. Kingma , Pieter Abbeel , Jonathan Ho

Current learned image compression models typically exhibit high complexity, which demands significant computational resources. To overcome these challenges, we propose an innovative approach that employs hierarchical feature extraction…

Image and Video Processing · Electrical Eng. & Systems 2025-05-01 Ayman A. Ameen , Thomas Richter , André Kaup

Lossless image compression is an important technique for image storage and transmission when information loss is not allowed. With the fast development of deep learning techniques, deep neural networks have been used in this field to…

Image and Video Processing · Electrical Eng. & Systems 2021-08-25 Honglei Zhang , Francesco Cricri , Hamed R. Tavakoli , Nannan Zou , Emre Aksu , Miska M. Hannuksela

The growing volume of high-resolution Whole Slide Images in digital histopathology poses significant storage, transmission, and computational efficiency challenges. Standard compression methods, such as JPEG, reduce file sizes but often…

Image and Video Processing · Electrical Eng. & Systems 2025-03-17 Srikar Yellapragada , Alexandros Graikos , Kostas Triaridis , Zilinghan Li , Tarak Nath Nandi , Ravi K Madduri , Prateek Prasanna , Joel Saltz , Dimitris Samaras

Image compression is one of the essential methods of image processing. Its most prominent advantage is the significant reduction of image size allowing for more efficient storage and transfer. However, lossy compression is associated with…

Image and Video Processing · Electrical Eng. & Systems 2021-05-25 Patryk Najgebauer , Rafal Scherer , Leszek Rutkowski

We present a new latent model of natural images that can be learned on large-scale datasets. The learning process provides a latent embedding for every image in the training dataset, as well as a deep convolutional network that maps the…

Computer Vision and Pattern Recognition · Computer Science 2018-11-06 ShahRukh Athar , Evgeny Burnaev , Victor Lempitsky

Image compression at extremely low bitrates (below 0.1 bits per pixel (bpp)) is a significant challenge due to substantial information loss. In this work, we propose a novel two-stage extreme image compression framework that exploits the…

Image and Video Processing · Electrical Eng. & Systems 2024-09-05 Zhiyuan Li , Yanhui Zhou , Hao Wei , Chenyang Ge , Jingwen Jiang

Neural-network-based approaches recently emerged in the field of data compression and have already led to significant progress in image compression, especially in achieving a higher compression ratio. In the lossless image compression…

Image and Video Processing · Electrical Eng. & Systems 2022-10-10 Yuan Lan , Liang Qin , Zhaoyi Sun , Yang Xiang , Jie Sun

Lossless image compression is an important task in the field of multimedia communication. Traditional image codecs typically support lossless mode, such as WebP, JPEG2000, FLIF. Recently, deep learning based approaches have started to show…

Image and Video Processing · Electrical Eng. & Systems 2020-02-06 Zhengxue Cheng , Heming Sun , Masaru Takeuchi , Jiro Katto

Normalizing flows, autoregressive models, variational autoencoders (VAEs), and deep energy-based models are among competing likelihood-based frameworks for deep generative learning. Among them, VAEs have the advantage of fast and tractable…

Machine Learning · Statistics 2021-01-11 Arash Vahdat , Jan Kautz

This paper introduces an end-to-end learned image compression system, termed ANFIC, based on Augmented Normalizing Flows (ANF). ANF is a new type of flow model, which stacks multiple variational autoencoders (VAE) for greater model…

Image and Video Processing · Electrical Eng. & Systems 2021-10-26 Yung-Han Ho , Chih-Chun Chan , Wen-Hsiao Peng , Hsueh-Ming Hang , Marek Domanski

Recent work has shown that Variational Autoencoders (VAEs) can be used to upper-bound the information rate-distortion (R-D) function of images, i.e., the fundamental limit of lossy image compression. In this paper, we report an improved…

Image and Video Processing · Electrical Eng. & Systems 2023-09-07 Zhihao Duan , Jack Ma , Jiangpeng He , Fengqing Zhu

A large fraction of Internet traffic is now driven by requests from mobile devices with relatively small screens and often stringent bandwidth requirements. Due to these factors, it has become the norm for modern graphics-heavy websites to…

Computer Vision and Pattern Recognition · Computer Science 2016-03-03 George Toderici , Sean M. O'Malley , Sung Jin Hwang , Damien Vincent , David Minnen , Shumeet Baluja , Michele Covell , Rahul Sukthankar

In recent years, there has been rapid development in learned image compression techniques that prioritize ratedistortion-perceptual compression, preserving fine details even at lower bit-rates. However, current learning-based image…

Computer Vision and Pattern Recognition · Computer Science 2023-05-19 Peirong Ning , Wei Jiang , Ronggang Wang