English
Related papers

Related papers: A Rate-Distortion Analysis for Composite Sources U…

200 papers

Rate-distortion theory-based outlier detection builds upon the rationale that a good data compression will encode outliers with unique symbols. Based on this rationale, we propose Cluster Purging, which is an extension of clustering-based…

Machine Learning · Computer Science 2023-02-23 Maximilian B. Toller , Bernhard C. Geiger , Roman Kern

We propose computationally efficient encoders and decoders for lossy compression using a Sparse Regression Code. The codebook is defined by a design matrix and codewords are structured linear combinations of columns of this matrix. The…

Information Theory · Computer Science 2014-05-20 Ramji Venkataramanan , Tuhin Sarkar , Sekhar Tatikonda

Locally decodable channel codes form a special class of error-correcting codes with the property that the decoder is able to reconstruct any bit of the input message from querying only a few bits of a noisy codeword. It is well known that…

Information Theory · Computer Science 2013-08-28 Ali Makhdoumi , Shao-Lun Huang , Muriel Medard , Yury Polyanskiy

We consider transmission of discrete memoryless sources (DMSes) across discrete memoryless channels (DMCs) using variable-length lossy source-channel codes with feedback. The reliability function (optimum error exponent) is shown to be…

Information Theory · Computer Science 2019-04-09 Lan V. Truong , Vincent Y. F. Tan

We consider a problem of coding for computing, where the decoder wishes to estimate a function of its local message and the source message at the encoder within a given distortion. We show that the rate-distortion function can be…

Information Theory · Computer Science 2022-05-18 Deheng Yuan , Tao Guo , Bo Bai , Wei Han

Dataset Condensation (DC) aims to obtain a condensed dataset that allows models trained on the condensed dataset to achieve performance comparable to those trained on the full dataset. Recent DC approaches increasingly focus on encoding…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Bowen Yuan , Yuxia Fu , Zijian Wang , Yadan Luo , Zi Huang

This paper adapts a Multiple-Model Coding (MMC) approach for sampled electrical signal waveforms to satisfy reconstructed signal quality constraints. The baseline MMC approach consists of two stages processing vectors of Voltage and Current…

Signal Processing · Electrical Eng. & Systems 2025-11-14 Corentin Presvôts , Michel Kieffer , Thibault Prevost

Fundamental rate-distortion-perception (RDP) trade-offs arise in applications requiring maintained perceptual quality of reconstructed data, such as neural image compression. When compressed data is transmitted over public communication…

Information Theory · Computer Science 2026-04-23 Gustaf Åhlgren , Onur Günlü

Motivated by the lossy compression of an active-vision video stream, we consider the problem of finding the rate-distortion function of an arbitrarily varying source (AVS) composed of a finite number of subsources with known distributions.…

Information Theory · Computer Science 2016-09-08 Hari Palaiyanur , Cheng Chang , Anant Sahai

It is well known that separation between lossy source coding and channel coding is asymptotically optimal under classical additive distortion measures. Recently, coding under a new class of quality considerations, often referred to as…

Information Theory · Computer Science 2025-07-02 Chao Tian , Jun Chen , Krishna Narayanan

Consider a lossy compression system with $\ell$ distributed encoders and a centralized decoder. Each encoder compresses its observed source and forwards the compressed data to the decoder for joint reconstruction of the target signals under…

Information Theory · Computer Science 2018-07-19 Yizhong Wang , Li Xie , Xuan Zhang , Jun Chen

Rate distortion theory is concerned with optimally encoding a given signal class $\mathcal{S}$ using a budget of $R$ bits, as $R\to\infty$. We say that $\mathcal{S}$ can be compressed at rate $s$ if we can achieve an error of…

Functional Analysis · Mathematics 2020-08-04 Philipp Grohs , Andreas Klotz , Felix Voigtlaender

A subspace-based approach for rate-adaptive distributed source coding (DSC) based on discrete Fourier transform (DFT) codes is developed. Punctured DFT codes can be used to implement rate-adaptive source coding, however they perform poorly…

Information Theory · Computer Science 2013-07-01 Mojtaba Vaezi , Fabrice Labeau

We consider a Shannon cipher system for memoryless sources, in which distortion is allowed at the legitimate decoder. The source is compressed using a rate distortion code secured by a shared key, which satisfies a constraint on the…

Information Theory · Computer Science 2016-11-17 Nir Weinberger , Neri Merhav

End-to-end image transmission has recently become a crucial trend in intelligent wireless communications, driven by the increasing demand for high bandwidth efficiency. However, existing methods primarily optimize the trade-off between…

Image and Video Processing · Electrical Eng. & Systems 2024-08-27 Kailin Tan , Jincheng Dai , Zhenyu Liu , Sixian Wang , Xiaoqi Qin , Wenjun Xu , Kai Niu , Ping Zhang

In this paper, we consider the information-theoretic characterization of the set of achievable rates and distortions in a broad class of multiterminal communication scenarios with general continuous-valued sources and channels. A framework…

Information Theory · Computer Science 2022-02-24 Farhad Shirani , S. Sandeep Pradhan

In lossy compression, Blau and Michaeli [5] introduced the information rate-distortion-perception (RDP) function, extending traditional rate-distortion theory by incorporating perceptual quality. More recently, this framework was expanded…

Information Theory · Computer Science 2025-04-15 Nam Nguyen , Thinh Nguyen , Bella Bose

Recent years have seen a tremendous growth in both the capability and popularity of automatic machine analysis of images and video. As a result, a growing need for efficient compression methods optimized for machine vision, rather than…

Image and Video Processing · Electrical Eng. & Systems 2025-03-05 Alon Harell , Yalda Foroutan , Nilesh Ahuja , Parual Datta , Bhavya Kanzariya , V. Srinivasa Somayazulu , Omesh Tickoo , Anderson de Andrade , Ivan V. Bajic

Recently, the field of Image Coding for Machines (ICM) has garnered heightened interest and significant advances thanks to the rapid progress of learning-based techniques for image compression and analysis. Previous studies often require…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Jinming Liu , Ruoyu Feng , Yunpeng Qi , Qiuyu Chen , Zhibo Chen , Wenjun Zeng , Xin Jin

We investigate the upper and lower bounds on the quantization distortions for independent and identically distributed sources in the finite block-length regime. Based on the convex optimization framework of the rate-distortion theory, we…

Information Theory · Computer Science 2013-06-21 Chen Gong , Xiaodong Wang
‹ Prev 1 4 5 6 7 8 10 Next ›