English
Related papers

Related papers: The Gap Between Principle and Practice of Lossy Im…

200 papers

The Shannon lower bound is one of the few lower bounds on the rate-distortion function that holds for a large class of sources. In this paper, it is demonstrated that its gap to the rate-distortion function vanishes as the allowed…

Information Theory · Computer Science 2016-11-17 Tobias Koch

This paper investigates a lossy source coding problem in which two decoders can access their side-information respectively. The correlated sources are a product of two component correlated sources, and we exclusively investigate the case…

Information Theory · Computer Science 2013-05-29 Shun Watanabe

We describe an image compression method, consisting of a nonlinear analysis transformation, a uniform quantizer, and a nonlinear synthesis transformation. The transforms are constructed in three successive stages of convolutional linear…

Computer Vision and Pattern Recognition · Computer Science 2020-07-28 Johannes Ballé , Valero Laparra , Eero P. Simoncelli

In lossy compression, Wang et al. [1] recently introduced the rate-distortion-perception-classification function, which supports multi-task learning by jointly optimizing perceptual quality, classification accuracy, and reconstruction…

Information Theory · Computer Science 2025-04-23 Nam Nguyen , Thuan Nguyen , Thinh Nguyen , Bella Bose

Direct evaluation of the rate-distortion function has rarely been achieved when it is strictly greater than its Shannon lower bound. In this paper, we consider the rate-distortion function for the distortion measure defined by an…

Information Theory · Computer Science 2013-02-27 Kazuho Watanabe

In the field of video processing, advancements in video compression at various temporal and spatial resolutions which are needed in our research to quantify estimation of video quality whereabouts within spatial and temporal domain itself.…

Information Theory · Computer Science 2023-06-29 Amitesh Kumar Singam

In lossy compression, Blau and Michaeli [5] introduced the information rate-distortion-perception (RDP) function, extending traditional rate-distortion theory by incorporating perceptual quality. More recently, this framework was expanded…

Information Theory · Computer Science 2025-04-15 Nam Nguyen , Thinh Nguyen , Bella Bose

Classical rate-distortion theory requires knowledge of an elusive source distribution. Instead, we analyze rate-distortion properties of individual objects using the recently developed algorithmic rate-distortion theory. The latter is based…

Information Theory · Computer Science 2007-07-16 Steven de Rooij , Paul Vitanyi

Consider a discrete memoryless multiple source with $m$ components of which $k \leq m$ possibly different sources are sampled at each time instant and jointly compressed in order to reconstruct all the $m$ sources under a given distortion…

Information Theory · Computer Science 2016-07-15 Vinay Praneeth Boda , Prakash Narayan

Neural image compression methods have seen increasingly strong performance in recent years. However, they suffer orders of magnitude higher computational complexity compared to traditional codecs, which hinders their real-world deployment.…

Image and Video Processing · Electrical Eng. & Systems 2023-11-13 Yibo Yang , Stephan Mandt

Sparse coding is a proven principle for learning compact representations of images. However, sparse coding by itself often leads to very redundant dictionaries. With images, this often takes the form of similar edge detectors which are…

Computer Vision and Pattern Recognition · Computer Science 2015-03-19 James Bergstra , Aaron Courville , Yoshua Bengio

Human observers can learn to recognize new categories of images from a handful of examples, yet doing so with artificial ones remains an open challenge. We hypothesize that data-efficient recognition is enabled by representations which make…

Computer Vision and Pattern Recognition · Computer Science 2020-07-02 Olivier J. Hénaff , Aravind Srinivas , Jeffrey De Fauw , Ali Razavi , Carl Doersch , S. M. Ali Eslami , Aaron van den Oord

Many computer vision tasks share substantial overlapping information, yet conventional codecs tend to ignore this, leading to redundant and inefficient representations. The Gray-Wyner network, a classical concept from information theory,…

Machine Learning · Computer Science 2026-05-11 Anderson de Andrade , Alon Harell , Ivan V. Bajić

Pursuing realistic results according to human visual perception is the central concern in the image transformation tasks. Perceptual learning approaches like perceptual loss are empirically powerful for such tasks but they usually rely on…

Computer Vision and Pattern Recognition · Computer Science 2020-06-25 Kangfu Mei , Yao Lu , Qiaosi Yi , Haoyu Wu , Juncheng Li , Rui Huang

Adaptive sparse coding methods learn a possibly overcomplete set of basis functions, such that natural image patches can be reconstructed by linearly combining a small subset of these bases. The applicability of these methods to visual…

Computer Vision and Pattern Recognition · Computer Science 2010-10-19 Koray Kavukcuoglu , Marc'Aurelio Ranzato , Yann LeCun

It is well known that separation between lossy source coding and channel coding is asymptotically optimal under classical additive distortion measures. Recently, coding under a new class of quality considerations, often referred to as…

Information Theory · Computer Science 2025-07-02 Chao Tian , Jun Chen , Krishna Narayanan

Image compression using neural networks have reached or exceeded non-neural methods (such as JPEG, WebP, BPG). While these networks are state of the art in ratedistortion performance, computational feasibility of these models remains a…

Image and Video Processing · Electrical Eng. & Systems 2019-12-19 Nick Johnston , Elad Eban , Ariel Gordon , Johannes Ballé

Loss functions are at the heart of deep learning, shaping how models learn and perform across diverse tasks. They are used to quantify the difference between predicted outputs and ground truth labels, guiding the optimization process to…

Machine Learning · Computer Science 2025-09-11 Omar Elharrouss , Yasir Mahmood , Yassine Bechqito , Mohamed Adel Serhani , Elarbi Badidi , Jamal Riffi , Hamid Tairi

Deep learning based image compression has recently witnessed exciting progress and in some cases even managed to surpass transform coding based approaches that have been established and refined over many decades. However, state-of-the-art…

Computer Vision and Pattern Recognition · Computer Science 2020-08-25 Leonhard Helminger , Abdelaziz Djelouah , Markus Gross , Christopher Schroers

This paper investigates the problem of variable-length lossy source coding allowing a positive excess distortion probability and an overflow probability of codeword lengths. Novel one-shot achievability and converse bounds of the optimal…

Information Theory · Computer Science 2018-12-17 Shota Saito , Hideki Yagi , Toshiyasu Matsushima