English
Related papers

Related papers: A Rate-Distortion Exponent Approach to Multiple De…

200 papers

In this work, we show new and improved error-correcting properties of folded Reed-Solomon codes and multiplicity codes. Both of these families of codes are based on polynomials over finite fields, and both have been the sources of recent…

Information Theory · Computer Science 2018-05-07 Swastik Kopparty , Noga Ron-Zewi , Shubhangi Saraf , Mary Wootters

Rate distortion theory was developed for optimizing lossy compression of data, but it also has a lot of applications in statistics. In this paper we will see how rate distortion theory can be used to analyze a complicated data set involving…

Applications · Statistics 2023-03-22 Peter Harremoës

This work studies the deviations of the error exponent of the constant composition code ensemble around its expectation, known as the error exponent of the typical random code (TRC). In particular, it is shown that the probability of…

Information Theory · Computer Science 2019-12-23 Ran Tamir , Neri Merhav , Nir Weinberger , Albert Guillen i Fabregas

Diffusion probabilistic models (DPMs), while effective in generating high-quality samples, often suffer from high computational costs due to their iterative sampling process. To address this, we propose an enhanced ODE-based sampling method…

Machine Learning · Computer Science 2025-04-03 Jinyoung Choi , Junoh Kang , Bohyung Han

In this paper we investigate the use of Richardson extrapolation to estimate the convergence rates for numerical solutions to advection problems involving discontinuities. We use modified equation analysis to describe the expectation of the…

Numerical Analysis · Mathematics 2013-02-05 J. W. Banks , T. D. Aslam

Reed-Solomon (RS) codes over GF$(2^m)$ have traditionally been the most popular non-binary codes in almost all practical applications. The distance properties of RS codes result in excellent performance under hard-decision bounded-distance…

Information Theory · Computer Science 2008-10-06 Andrew Thangaraj , Safitha J Raj

Classical rate-distortion theory requires knowledge of an elusive source distribution. Instead, we analyze rate-distortion properties of individual objects using the recently developed algorithmic rate-distortion theory. The latter is based…

Information Theory · Computer Science 2007-07-16 Steven de Rooij , Paul Vitanyi

The main decoding algorithms for Reed-Solomon codes are based on a bivariate interpolation step, which is expensive in time complexity. Lot of interpolation methods were proposed in order to decrease the complexity of this procedure, but…

Information Theory · Computer Science 2014-07-14 Morgan Barbier

In this paper, we propose a novel function named Rate Distortion-in-Distortion (RDD) function as an extension of the classical rate-distortion (RD) function, where the expected distortion constraint is replaced by a Gromov-type distortion.…

Information Theory · Computer Science 2025-07-25 Lingyi Chen , Haoran Tang , Shitong Wu , Jiakun Liu , Huihui Wu , Wenyi Zhang , Hao Wu

Regenerating codes provide an efficient way to recover data at failed nodes in distributed storage systems. It has been shown that regenerating codes can be designed to minimize the per-node storage (called MSR) or minimize the…

Information Theory · Computer Science 2013-01-14 Yunghsiang S. Han , Hong-Ta Pai , Rong Zheng , Pramod K. Varshney

Rate splitting (RS) is a potentially powerful and flexible technique for multi-antenna downlink transmission. In this paper, we address several technical challenges towards its practical implementation for beyond 5G systems. To this end, we…

Information Theory · Computer Science 2020-02-19 Zheng Li , Chencheng Ye , Ying Cui , Sheng Yang , Shlomo Shamai

Reed-Muller codes are among the most important classes of locally correctable codes. Currently local decoding of Reed-Muller codes is based on decoding on lines or quadratic curves to recover one single coordinate. To recover multiple…

Information Theory · Computer Science 2019-05-13 Ronald Cramer , Chaoping Xing , Chen Yuan

In lossy compression, Blau and Michaeli [5] introduced the information rate-distortion-perception (RDP) function, extending traditional rate-distortion theory by incorporating perceptual quality. More recently, this framework was expanded…

Information Theory · Computer Science 2025-04-15 Nam Nguyen , Thinh Nguyen , Bella Bose

This paper shows that, with high probability, randomly punctured Reed-Solomon codes over fields of polynomial size achieve the list decoding capacity. More specifically, we prove that for any $\epsilon>0$ and $R\in (0,1)$, with high…

Information Theory · Computer Science 2025-09-03 Zeyu Guo , Zihan Zhang

We derive a simple general parametric representation of the rate-distortion function of a memoryless source, where both the rate and the distortion are given by integrals whose integrands include the minimum mean square error (MMSE) of the…

Information Theory · Computer Science 2010-04-30 Neri Merhav

It is well known that independent (separate) encoding of K correlated sources may incur some rate loss compared to joint encoding, even if the decoding is done jointly. This loss is particularly evident in the multiple descriptions problem,…

Information Theory · Computer Science 2022-05-23 Jan Østergaard , Uri Erez , Ram Zamir

We present herein a scheme by which to accurately evaluate the error exponents of a lossy data compression problem, which characterize average probabilities over a code ensemble of compression failure and success above or below a critical…

Statistical Mechanics · Physics 2007-05-23 Tadaaki Hosaka , Yoshiyuki Kabashima

In this paper, the rate-distortion theory of the Gray-Wyner lossy source coding system is investigated. For the case of jointly Gaussian distributed sources, we establish an expression for the rate-distortion function under the constraint…

Information Theory · Computer Science 2023-03-29 Guojun Chen , Yinfei Xu , Ling Liu , Tiecheng Song , Jing Hu

Identification is a communication paradigm that promises exponential advantages over transmission for applications that do not actually require all messages to be reliably transmitted. Notably, the identification capacity theorems prove…

In this paper, we propose Image Downscaling Assessment by Rate-Distortion (IDA-RD), a novel measure to quantitatively evaluate image downscaling algorithms. In contrast to image-based methods that measure the quality of downscaled images,…

Computer Vision and Pattern Recognition · Computer Science 2024-03-25 Yuanbang Liang , Bhavesh Garg , Paul L Rosin , Yipeng Qin