English
Related papers

Related papers: Rate-Distortion Theory for Mixed States

200 papers

A communication setup is considered where a transmitter wishes to simultaneously sense its channel state and convey a message to a receiver. The state is estimated at the transmitter by means of generalized feedback, i.e. a strictly causal…

Information Theory · Computer Science 2018-05-16 Mari Kobayashi , Giuseppe Caire , Gerhard Kramer

Generalization to novel visual conditions remains a central challenge for both human and machine vision, yet standard robustness metrics offer limited insight into how systems trade accuracy for robustness. We introduce a…

Machine Learning · Computer Science 2026-03-03 Leyla Roksan Caglar , Pedro A. M. Mediano , Baihan Lin

A fundamental question in designing lossy data compression schemes is how well one can do in comparison with the rate-distortion function, which describes the known theoretical limits of lossy compression. Motivated by the empirical success…

Information Theory · Computer Science 2024-03-05 Eric Lei , Hamed Hassani , Shirin Saeedi Bidokhti

An information-spectrum approach is applied to solve the multiterminal source coding problem for correlated general sources, where sources may be nonstationary and/or nonergodic, and the distortion measure is arbitrary and may be…

Information Theory · Computer Science 2007-07-13 Shengtian Yang , Peiliang Qiu

Even though rate-distortion optimization is a crucial part of traditional image and video compression, not many approaches exist which transfer this concept to end-to-end-trained image compression. Most frameworks contain static compression…

Image and Video Processing · Electrical Eng. & Systems 2022-01-06 Fabian Brand , Kristian Fischer , Alexander Kopte , André Kaup

In this thesis, I reflect on quantum instruments that measure the state of pure finite dimensional quantum systems. As the Heisenberg principle dictates, there exists a joint restriction to the information gain and distortion by measurement…

Quantum Physics · Physics 2007-05-23 Thijs van der Valk

In this work, we investigate an instance of the Heegard-Berger problem with two sources and arbitrarily correlated side information sequences at two decoders, in which the reconstruction sets at the decoders are degraded. Specifically, two…

Information Theory · Computer Science 2015-08-27 Meryem Benammar , Abdellatif Zaidi

Quantum information theory is a multidisciplinary field whose objective is to understand what happens when information is stored in the state of a quantum system. Quantum mechanics provides us with a new resource, called quantum…

Quantum Physics · Physics 2011-05-25 Nicolas Dutil

We consider the problem of the optimal compression rate in the case of the source producing mixed signal states within the {\it visible} scheme (where Alice, who is to compress the signal, can know the identities of the produced states). We…

Quantum Physics · Physics 2009-10-31 Michal Horodecki

The rate-distortion-perception (RDP) tradeoff characterizes the fundamental limits of lossy compression by jointly considering bitrate, reconstruction fidelity, and perceptual quality. While recent neural compression methods have improved…

Information Theory · Computer Science 2026-05-25 Yuhan Wang , Suzhi Bi , Ying-Jun Angela Zhang

Dithering is a technique that can improve human perception of low-resolution data by reducing quantization artifacts. In this work we formalize and analytically justify two metrics for quantization artifact prominence, using them to design…

Signal Processing · Electrical Eng. & Systems 2024-02-27 Morriel Kasher , Michael Tinston , Predrag Spasojevic

Sequential rate-distortion (SRD) theory provides a framework for studying the fundamental trade-off between data-rate and data-quality in real-time communication systems. In this paper, we consider the SRD problem for multi-dimensional…

Optimization and Control · Mathematics 2018-01-16 Takashi Tanaka , Kwang-Ki K. Kim , Pablo A. Parrilo , Sanjoy K. Mitter

Consider the two-way rate-distortion problem in which a helper sends a common limited-rate message to both users based on side information at its disposal. We characterize the region of achievable rates and distortions where a Markov form…

Information Theory · Computer Science 2009-04-06 Haim Permuter , Yossi Steinberg , Tsachy Weissman

One popular approach to soft-decision decoding of Reed-Solomon (RS) codes is based on using multiple trials of a simple RS decoding algorithm in combination with erasing or flipping a set of symbols or bits in each trial. This paper…

Information Theory · Computer Science 2015-03-17 Phong S. Nguyen , Henry D. Pfister , Krishna R. Narayanan

Post-training Neural Network (NN) model compression is an attractive approach for deploying large, memory-consuming models on devices with limited memory resources. In this study, we investigate the rate-distortion tradeoff for NN model…

Machine Learning · Computer Science 2024-12-03 Joseph Kampeas , Yury Nahshan , Hanoch Kremer , Gil Lederman , Shira Zaloshinski , Zheng Li , Emir Haleva

The rate-distortion (RD) theory is one of the key concepts in information theory, providing theoretical limits for compression performance and guiding the source coding design, with both theoretical and practical significance. The…

Information Theory · Computer Science 2025-07-28 Shitong Wu , Sicheng Xu , Lingyi Chen , Huihui Wu , Wenyi Zhang

The quantum dichotomies problem asks at what rate one pair of quantum states can be approximately mapped into another pair of quantum states. In the many copy limit and for vanishing error, the optimal rate is known to be given by the ratio…

Quantum Physics · Physics 2025-04-03 Mario Berta , Yongsheng Yao

Finite abstractions are discrete approximations of dynamical systems, such that the set of abstraction trajectories contains all system trajectories. There is a consensus that abstractions suffer from the curse of dimensionality: for the…

Systems and Control · Electrical Eng. & Systems 2025-12-09 Giannis Delimpaltadakis , Gabriel Gleizer

The resource theory of coherence studies the operational value of superpositions in quantum technologies. A key question in this theory concerns the efficiency of manipulation and interconversion of this resource. Here we solve this…

Quantum Physics · Physics 2019-03-13 Thomas Theurer , Alexander Streltsov , Martin B. Plenio

It is well known that independent (separate) encoding of K correlated sources may incur some rate loss compared to joint encoding, even if the decoding is done jointly. This loss is particularly evident in the multiple descriptions problem,…

Information Theory · Computer Science 2022-05-23 Jan Østergaard , Uri Erez , Ram Zamir