English
Related papers

Related papers: A Rate-Distortion-Classification Approach for Loss…

200 papers

Learned image compression methods generally optimize a rate-distortion loss, trading off improvements in visual distortion for added bitrate. Increasingly, however, compressed imagery is used as an input to deep learning networks for…

Image and Video Processing · Electrical Eng. & Systems 2022-02-02 Maxime Kawawa-Beaudan , Ryan Roggenkemper , Avideh Zakhor

Learned image compression (LIC) using deep learning architectures has seen significant advancements, yet standard rate-distortion (R-D) optimization often encounters imbalanced updates due to diverse gradients of the rate and distortion…

Image and Video Processing · Electrical Eng. & Systems 2025-03-19 Yichi Zhang , Zhihao Duan , Yuning Huang , Fengqing Zhu

Linear block transform coding remains a fundamental component of image and video compression. Although the Discrete Cosine Transform (DCT) is widely employed in all current compression standards, its sub-optimality has sparked ongoing…

Image and Video Processing · Electrical Eng. & Systems 2024-11-28 Alessandro Gnutti , Chia-Hao Kao , Wen-Hsiao Peng , Riccardo Leonardi

In the theory of lossy compression, the rate-distortion (R-D) function $R(D)$ describes how much a data source can be compressed (in bit-rate) at any given level of fidelity (distortion). Obtaining $R(D)$ for a given data source establishes…

Information Theory · Computer Science 2023-10-31 Yibo Yang , Stephan Eckstein , Marcel Nutz , Stephan Mandt

We present a novel systematic theoretical framework to analyze the rate-distortion (R-D) limits of learned image compression. While recent neural codecs have achieved remarkable empirical results, their distance from the…

Information Theory · Computer Science 2026-01-15 Changshuo Wang , Zijian Liang , Kai Niu , Ping Zhang

Recent studies have demonstrated that gradient matching-based dataset synthesis, or dataset condensation (DC), methods can achieve state-of-the-art performance when applied to data-efficient learning tasks. However, in this study, we prove…

Computer Vision and Pattern Recognition · Computer Science 2022-06-17 Saehyung Lee , Sanghyuk Chun , Sangwon Jung , Sangdoo Yun , Sungroh Yoon

This paper introduces the notion of soft bits to address the rate-distortion optimization for learning-based image compression. Recent methods for such compression train an autoencoder end-to-end with an objective to strike a balance…

Image and Video Processing · Electrical Eng. & Systems 2019-05-02 David Alexandre , Chih-Peng Chang , Wen-Hsiao Peng , Hsueh-Ming Hang

To cluster, classify and represent are three fundamental objectives of learning from high-dimensional data with intrinsic structure. To this end, this paper introduces three interpretable approaches, i.e., segmentation (clustering) via the…

Computer Vision and Pattern Recognition · Computer Science 2023-06-21 Kai-Liang Lu , Avraham Chapman

As being one of the main representation formats of 3D real world and well-suited for virtual reality and augmented reality applications, point clouds have gained a lot of popularity. In order to reduce the huge amount of data, a…

Multimedia · Computer Science 2022-11-22 Pan Gao , Shengzhou Luo , Manoranjan Paul

Lossy compression algorithms are typically designed and analyzed through the lens of Shannon's rate-distortion theory, where the goal is to achieve the lowest possible distortion (e.g., low MSE or high SSIM) at any given bit rate. However,…

Machine Learning · Computer Science 2019-07-31 Yochai Blau , Tomer Michaeli

We describe an image compression method, consisting of a nonlinear analysis transformation, a uniform quantizer, and a nonlinear synthesis transformation. The transforms are constructed in three successive stages of convolutional linear…

Computer Vision and Pattern Recognition · Computer Science 2020-07-28 Johannes Ballé , Valero Laparra , Eero P. Simoncelli

A fundamental question in designing lossy data compression schemes is how well one can do in comparison with the rate-distortion function, which describes the known theoretical limits of lossy compression. Motivated by the empirical success…

Information Theory · Computer Science 2024-03-05 Eric Lei , Hamed Hassani , Shirin Saeedi Bidokhti

Many information systems employ lossy compression as a crucial intermediate stage among other processing components. While the important distortion is defined by the system's input and output signals, the compression usually ignores the…

Information Theory · Computer Science 2018-05-14 Yehuda Dar , Michael Elad , Alfred M. Bruckstein

With the rapid advancements in digital imaging systems and networking, low-cost hand-held image capture devices equipped with network connectivity are becoming ubiquitous. This ease of digital image capture and sharing is also accompanied…

Multimedia · Computer Science 2019-06-20 Vinay Verma , Nikita Agarwal , Nitin Khanna

In the context of lossy compression, Blau & Michaeli (2019) adopt a mathematical notion of perceptual quality and define the information rate-distortion-perception function, generalizing the classical rate-distortion tradeoff. We consider…

Information Theory · Computer Science 2021-12-23 George Zhang , Jingjing Qian , Jun Chen , Ashish Khisti

Traditional image/video compression aims to reduce the transmission/storage cost with signal fidelity as high as possible. However, with the increasing demand for machine analysis and semantic monitoring in recent years, semantic fidelity…

Image and Video Processing · Electrical Eng. & Systems 2022-09-07 Jiguo Li , Chuanmin Jia , Xinfeng Zhang , Siwei Ma , Wen Gao

By optimizing the rate-distortion-realism trade-off, generative compression approaches produce detailed, realistic images, even at low bit rates, instead of the blurry reconstructions produced by rate-distortion optimized models. However,…

Computer Vision and Pattern Recognition · Computer Science 2023-03-31 Eirikur Agustsson , David Minnen , George Toderici , Fabian Mentzer

Contemporary lossy image and video coding standards rely on transform coding, the process through which pixels are mapped to an alternative representation to facilitate efficient data compression. Despite impressive performance of…

Image and Video Processing · Electrical Eng. & Systems 2023-02-21 Lyndon R. Duong , Bohan Li , Cheng Chen , Jingning Han

A new Lossy Causal Temporal Convolutional Neural Network Autoencoder for anomaly detection is proposed in this work. Our framework uses a rate-distortion loss and an entropy bottleneck to learn a compressed latent representation for the…

Machine Learning · Computer Science 2022-12-06 Christopher P. Ley , Jorge F. Silva

We present a new supervised image classification method applicable to a broad class of image deformation models. The method makes use of the previously described Radon Cumulative Distribution Transform (R-CDT) for image data, whose…

Computer Vision and Pattern Recognition · Computer Science 2022-03-04 Mohammad Shifat-E-Rabbi , Xuwang Yin , Abu Hasnat Mohammad Rubaiyat , Shiying Li , Soheil Kolouri , Akram Aldroubi , Jonathan M. Nichols , Gustavo K. Rohde