English
Related papers

Related papers: Rethinking Lossy Compression: The Rate-Distortion-…

200 papers

We present a novel systematic theoretical framework to analyze the rate-distortion (R-D) limits of learned image compression. While recent neural codecs have achieved remarkable empirical results, their distance from the…

Information Theory · Computer Science 2026-01-15 Changshuo Wang , Zijian Liang , Kai Niu , Ping Zhang

We survey a new paradigm in signal processing known as "compressive sensing". Contrary to old practices of data acquisition and reconstruction based on the Shannon-Nyquist sampling principle, the new theory shows that it is possible to…

History and Overview · Mathematics 2009-03-13 Olga Holtz

Consider a control problem with a communication channel connecting the observer of a linear stochastic system to the controller. The goal of the controller is to minimize a quadratic cost function in the state variables and control signal,…

Information Theory · Computer Science 2018-11-27 Victoria Kostina , Babak Hassibi

A fundamental question in designing lossy data compression schemes is how well one can do in comparison with the rate-distortion function, which describes the known theoretical limits of lossy compression. Motivated by the empirical success…

Information Theory · Computer Science 2024-03-05 Eric Lei , Hamed Hassani , Shirin Saeedi Bidokhti

Recent advances in Rate-Distortion-Perception (RDP) theory highlight the importance of balancing compression level, reconstruction quality, and perceptual fidelity. While previous work has explored numerical approaches to approximate the…

Information Theory · Computer Science 2025-08-20 Chunhui Chen , Linyi Chen , Xueyan Niu , Hao Wu

We consider lossy compression of a binary symmetric source by means of a low-density generator-matrix code. We derive two lower bounds on the rate distortion function which are valid for any low-density generator-matrix code with a given…

Information Theory · Computer Science 2008-04-11 Shrinivas Kudekar , Ruediger Urbanke

The emerging Learned Compression (LC) replaces the traditional codec modules with Deep Neural Networks (DNN), which are trained end-to-end for rate-distortion performance. This approach is considered as the future of image/video…

Image and Video Processing · Electrical Eng. & Systems 2024-07-08 Farhad Pakdaman , Moncef Gabbouj

Recently, the field of Image Coding for Machines (ICM) has garnered heightened interest and significant advances thanks to the rapid progress of learning-based techniques for image compression and analysis. Previous studies often require…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Jinming Liu , Ruoyu Feng , Yunpeng Qi , Qiuyu Chen , Zhibo Chen , Wenjun Zeng , Xin Jin

Error-bounded lossy compression is one of the most effective techniques for scientific data reduction. However, the traditional trial-and-error approach used to configure lossy compressors for finding the optimal trade-off between…

Databases · Computer Science 2022-05-09 Sian Jin , Sheng Di , Jiannan Tian , Suren Byna , Dingwen Tao , Franck Cappello

We study task-oriented lossy compression through the lens of rate-distortion-classification (RDC) representations. The source is Bernoulli, the distortion measure is Hamming, and the binary classification variable is coupled to the source…

Information Theory · Computer Science 2026-05-19 Nam Nguyen , Thinh Nguyen , Bella Bose

The rate-distortion curve captures the fundamental tradeoff between compression length and resolution in lossy data compression. However, it conceals the underlying dynamics of optimal source encodings or test channels. We argue that these…

Information Theory · Computer Science 2023-07-03 Shlomi Agmon

We propose an image restoration algorithm that can control the perceptual quality and/or the mean square error (MSE) of any pre-trained model, trading one over the other at test time. Our algorithm is few-shot: Given about a dozen images…

Artificial Intelligence · Computer Science 2024-08-13 Theo Adrai , Guy Ohayon , Tomer Michaeli , Michael Elad

Camera sensors have been widely used in intelligent robotic systems. Developing camera sensors with high sensing efficiency has always been important to reduce the power, memory, and other related resources. Inspired by recent success on…

Image and Video Processing · Electrical Eng. & Systems 2023-10-11 Bowen Zhang , Zhijin Qin , Geoffrey Ye Li

A communication setup is considered where a transmitter wishes to convey a message to a receiver and simultaneously estimates the state of that receiver through a common waveform. The state is estimated at the transmitter by means of…

Information Theory · Computer Science 2022-06-03 Mehrasa Ahmadipour , Mari Kobayashi , Miche`le Wigger , Giuseppe Caire

With the advancement of Artificial Intelligence (AI) technology, next-generation wireless communication network is facing unprecedented challenge. Semantic communication has become a novel solution to address such challenges, with enhancing…

Signal Processing · Electrical Eng. & Systems 2024-05-17 Zihe Zhao , Chunyue Wang

In this paper, we contend that a natural objective of representation learning is to compress and transform the distribution of the data, say sets of tokens, towards a low-dimensional Gaussian mixture supported on incoherent subspaces. The…

Machine Learning · Computer Science 2024-09-09 Yaodong Yu , Sam Buchanan , Druv Pai , Tianzhe Chu , Ziyang Wu , Shengbang Tong , Hao Bai , Yuexiang Zhai , Benjamin D. Haeffele , Yi Ma

Fundamental rate-distortion-perception (RDP) trade-offs arise in applications requiring maintained perceptual quality of reconstructed data, such as neural image compression. When compressed data is transmitted over public communication…

Information Theory · Computer Science 2026-04-23 Gustaf Åhlgren , Onur Günlü

A distributed lossy compression network with $L$ encoders and a decoder is considered. Each encoder observes a source and sends a compressed version to the decoder. The decoder produces a joint reconstruction of target signals with the mean…

Information Theory · Computer Science 2022-06-06 Siyao Zhou , Sadaf Salehkalaibar , Jingjing Qian , Jun Chen , Wuxian Shi , Yiqun Ge , Wen Tong

Contemporary lossy image and video coding standards rely on transform coding, the process through which pixels are mapped to an alternative representation to facilitate efficient data compression. Despite impressive performance of…

Image and Video Processing · Electrical Eng. & Systems 2023-02-21 Lyndon R. Duong , Bohan Li , Cheng Chen , Jingning Han

The distortion-perception (DP) tradeoff reveals a fundamental conflict between distortion metrics (e.g., MSE and PSNR) and perceptual quality. Recent research has increasingly concentrated on evaluating denoising algorithms within the DP…

Computer Vision and Pattern Recognition · Computer Science 2025-04-04 Yuhan Wang , Suzhi Bi , Ying-Jun Angela Zhang , Xiaojun Yuan
‹ Prev 1 4 5 6 7 8 10 Next ›