English
Related papers

Related papers: Advancing The Rate-Distortion-Computation Frontier…

200 papers

Most neural compression models are trained on large datasets of images or videos in order to generalize to unseen data. Such generalization typically requires large and expressive architectures with a high decoding complexity. Here we…

Image and Video Processing · Electrical Eng. & Systems 2023-12-06 Hyunjik Kim , Matthias Bauer , Lucas Theis , Jonathan Richard Schwarz , Emilien Dupont

End-to-end image/video codecs are getting competitive compared to traditional compression techniques that have been developed through decades of manual engineering efforts. These trainable codecs have many advantages over traditional…

Image and Video Processing · Electrical Eng. & Systems 2023-08-03 Muhammet Balcilar , Bharath Bhushan Damodaran , Karam Naser , Franck Galpin , Pierre Hellier

In this paper, we consider the mismatched rate-distortion problem, in which the encoding is done using a codebook, and the encoder chooses the minimum-distortion codeword according to a mismatched distortion function that differs from the…

Information Theory · Computer Science 2022-12-20 Millen Kanabar , Jonathan Scarlett

Rate-Distortion Optimized Quantization (RDOQ) has played an important role in the coding performance of recent video compression standards such as H.264/AVC, H.265/HEVC, VP9 and AV1. This scheme yields significant reductions in bit-rate at…

Machine Learning · Computer Science 2020-12-14 Dana Kianfar , Auke Wiggers , Amir Said , Reza Pourreza , Taco Cohen

Modern image compression methods are typically optimized for the rate--distortion--perception trade-off, whereas their robustness to bit-level corruption is rarely examined. We show that diffusion-based compressors built on the Reverse…

Computer Vision and Pattern Recognition · Computer Science 2026-04-09 Amit Vaisman , Gal Pomerants , Raz Lapid

Neural image compression (NIC) has outperformed traditional image codecs in rate-distortion (R-D) performance. However, it usually requires a dedicated encoder-decoder pair for each point on R-D curve, which greatly hinders its practical…

Image and Video Processing · Electrical Eng. & Systems 2022-09-21 Chenjian Gao , Tongda Xu , Dailan He , Hongwei Qin , Yan Wang

This paper aims to delve into the rate-distortion-complexity trade-offs of modern neural video coding. Recent years have witnessed much research effort being focused on exploring the full potential of neural video coding. Conditional…

Image and Video Processing · Electrical Eng. & Systems 2024-10-08 Yi-Hsin Chen , Kuan-Wei Ho , Martin Benjak , Jörn Ostermann , Wen-Hsiao Peng

Perceptual optimization is widely recognized as essential for neural compression, yet balancing the rate-distortion-perception tradeoff remains challenging. This difficulty is especially pronounced in video compression, where frame-wise…

Image and Video Processing · Electrical Eng. & Systems 2025-10-14 Zongyu Guo , Zhaoyang Jia , Jiahao Li , Xiaoyi Zhang , Bin Li , Yan Lu

In recent years, there has been a sharp increase in transmission of images to remote servers specifically for the purpose of computer vision. In many applications, such as surveillance, images are mostly transmitted for automated analysis,…

Computer Vision and Pattern Recognition · Computer Science 2022-09-26 Alon Harell , Anderson De Andrade , Ivan V. Bajic

The latest advancements in neural image compression show great potential in surpassing the rate-distortion performance of conventional standard codecs. Nevertheless, there exists an indelible domain gap between the datasets utilized for…

Image and Video Processing · Electrical Eng. & Systems 2023-08-16 Yue Lv , Jinxi Xiang , Jun Zhang , Wenming Yang , Xiao Han , Wei Yang

The rate-distortion function (RDF) has long been an information-theoretic benchmark for data compression. As its natural extension, the indirect rate-distortion function (iRDF) corresponds to the scenario where the encoder can only access…

Information Theory · Computer Science 2025-03-11 Zichao Yu , Qiang Sun , Wenyi Zhang

In this paper, we study the computation of the rate-distortion-perception function (RDPF) for discrete memoryless sources subject to a single-letter average distortion constraint and a perception constraint that belongs to the family of…

Information Theory · Computer Science 2023-05-09 Giuseppe Serra , Photios A. Stavrou , Marios Kountouris

Learned image compression (LIC) using deep learning architectures has seen significant advancements, yet standard rate-distortion (R-D) optimization often encounters imbalanced updates due to diverse gradients of the rate and distortion…

Image and Video Processing · Electrical Eng. & Systems 2025-03-19 Yichi Zhang , Zhihao Duan , Yuning Huang , Fengqing Zhu

The High Efficiency Video Coding (HEVC/H.265) standard doubles the compression efficiency of the widely used H.264/AVC standard. For practical applications, rate control (RC) algorithms for HEVC need to be developed. Based on the R-Q,…

Multimedia · Computer Science 2019-11-05 Minhao Tang , Jiangtao Wen , Yuxing Han

In this paper, a complexity study is conducted for Versatile Video Codec (VVC) intra partitioning to accelerate the exhaustive search involved in Rate-Distortion Optimization (RDO) process. To address this problem, two main machine learning…

Machine Learning · Computer Science 2025-11-26 M. E. A. Kherchouche , F. Galpin , T. Dumas , F. Schnitzler , D. Menard , L. Zhang

Common state-of-the-art video codecs are optimized to deliver a low bitrate by providing a certain quality for the final human observer, which is achieved by rate-distortion optimization (RDO). But, with the steady improvement of neural…

Image and Video Processing · Electrical Eng. & Systems 2022-03-14 Kristian Fischer , Fabian Brand , Christian Herglotz , André Kaup

Three-dimensional (3D) point clouds are becoming more and more popular for representing 3D objects and scenes. Due to limited network bandwidth, efficient compression of 3D point clouds is crucial. To tackle this challenge, the Moving…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Zehan Wang , Yuxuan Wei , Hui Yuan , Wei Zhang , Peng Li

The proliferation of high resolution videos posts great storage and bandwidth pressure on cloud video services, driving the development of next-generation video codecs. Despite great progress made in neural video coding, existing approaches…

Computer Vision and Pattern Recognition · Computer Science 2024-07-11 Yueyu Hu , Chenhao Zhang , Onur G. Guleryuz , Debargha Mukherjee , Yao Wang

The rate-distortion (RD) theory is one of the key concepts in information theory, providing theoretical limits for compression performance and guiding the source coding design, with both theoretical and practical significance. The…

Information Theory · Computer Science 2025-07-28 Shitong Wu , Sicheng Xu , Lingyi Chen , Huihui Wu , Wenyi Zhang

In learning-based approaches to image compression, codecs are developed by optimizing a computational model to minimize a rate-distortion objective. Currently, the most effective learned image codecs take the form of an entropy-constrained…

Image and Video Processing · Electrical Eng. & Systems 2020-07-20 David Minnen , Saurabh Singh