English
Related papers

Related papers: Lossy Quantum Source Coding with a Global Error Cr…

200 papers

We consider lossy source compression of a binary symmetric source using polar codes and the low-complexity successive encoding algorithm. It was recently shown by Arikan that polar codes achieve the capacity of arbitrary symmetric…

Information Theory · Computer Science 2009-03-03 Satish Babu Korada , Rudiger Urbanke

Joint source-channel coding is a compelling paradigm when low-latency and low-complexity communication is required. This work proposes a theoretical framework that integrates classification and anomaly detection within the conventional…

Signal Processing · Electrical Eng. & Systems 2025-09-18 Andriy Enttsel , Weichen Wang , Mauro Mangia , Riccardo Rovatti , Deniz Gündüz

Advancing over up-to-date information theoretic results that assume symmetric correlation models, in this work we consider the problem of lossy binary source coding with side information, where the correlation is expressed by a generic…

Information Theory · Computer Science 2016-11-17 Andrei Sechelea , Samuel Cheng , Adrian Munteanu , Nikos Deligiannis

The problem of side-information scalable (SI-scalable) source coding is considered in this work, where the encoder constructs a progressive description, such that the receiver with high quality side information will be able to truncate the…

Information Theory · Computer Science 2007-08-01 Chao Tian , Suhas N. Diggavi

A lossy source code $\mathcal{C}$ with rate $R$ for a discrete memoryless source $S$ is called subset-universal if for every $0<R'< R$, almost every subset of $2^{nR'}$ of its codewords achieves average distortion close to the source's…

Information Theory · Computer Science 2015-03-13 Or Ordentlich , Ofer Shayevitz

We begin by presenting a simple lossy compressor operating at near-zero rate: The encoder merely describes the indices of the few maximal source components, while the decoder's reconstruction is a natural estimate of the source components…

Information Theory · Computer Science 2016-03-09 Albert No , Tsachy Weissman

The error exponent of fixed-length lossy source coding was established by Marton. Ahlswede showed that this exponent can be discontinuous at a rate $R$, depending on the probability distribution $P$ of the given information source and the…

Information Theory · Computer Science 2023-04-25 Yutaka Jitsumatsu

The problem of joint universal source coding and modeling, addressed by Rissanen in the context of lossless codes, is generalized to fixed-rate lossy coding of continuous-alphabet memoryless sources. We show that, for bounded distortion…

Information Theory · Computer Science 2016-11-15 Maxim Raginsky

The design of communication systems dedicated to machine learning tasks is one key aspect of goal-oriented communications. In this framework, this article investigates the interplay between data reconstruction and learning from the same…

Information Theory · Computer Science 2024-04-30 Jiahui Wei , Elsa Dupraz , Philippe Mary

We determine the rate region of the vector Gaussian one-helper source-coding problem under a covariance matrix distortion constraint. The rate region is achieved by a simple scheme that separates the lossy vector quantization from the…

Information Theory · Computer Science 2011-12-30 Md. Saifur Rahman , Aaron B. Wagner

Low-depth random circuit codes possess many desirable properties for quantum error correction but have so far only been analyzed in the code capacity setting where it is assumed that encoding gates and syndrome measurements are noiseless.…

Quantum Physics · Physics 2023-12-01 Jon Nelson , Gregory Bentsen , Steven T. Flammia , Michael J. Gullans

This paper investigates the problem of source-channel coding for secure transmission with arbitrarily correlated side informations at both receivers. This scenario consists of an encoder (referred to as Alice) that wishes to compress a…

Information Theory · Computer Science 2013-11-11 Joffrey Villard , Pablo Piantanida , Shlomo Shamai

A new Lossy Causal Temporal Convolutional Neural Network Autoencoder for anomaly detection is proposed in this work. Our framework uses a rate-distortion loss and an entropy bottleneck to learn a compressed latent representation for the…

Machine Learning · Computer Science 2022-12-06 Christopher P. Ley , Jorge F. Silva

We propose a new construction for low-density source codes with multiple parameters that can be tuned to optimize the performance of the code. In addition, we introduce a set of analysis techniques for deriving upper bounds for the expected…

Information Theory · Computer Science 2007-07-13 Emin Martinian , Martin J. Wainwright

Focal loss has recently gained significant popularity, particularly in tasks like object detection where it helps to address class imbalance by focusing more on hard-to-classify examples. This work proposes the focal loss as a distortion…

Information Theory · Computer Science 2025-04-29 Alex Dytso , Martina Cardone

In this paper, we investigate the problem of recovering source information from an incomplete set of network coded data. We first study the theoretical performance of such systems under maximum a posteriori (MAP) decoding and derive the…

Information Theory · Computer Science 2015-03-16 Eirina Bourtsoulatze , Nikolaos Thomos , Pascal Frossard

In successive refinement of information, the decoder refines its representation of the source progressively as it receives more encoded bits. The rate-distortion region of successive refinement describes the minimum rates required to attain…

Information Theory · Computer Science 2018-11-22 Victoria Kostina , Ertem Tuncel

We consider the Cascade and Triangular rate-distortion problems where the same side information is available at the source node and User 1, and the side information available at User 2 is a degraded version of the side information at the…

Information Theory · Computer Science 2010-10-20 Yeow Khiang Chia , Haim Permuter , Tsachy Weissman

Quantum random variable, distortion operator are introduced based on canonical operators. As the lower bound of rate distortion, the entanglement information rate distortion is achieved by Gaussian map for Gaussian source. General Gaussian…

Quantum Physics · Physics 2007-05-23 Xiao-yu Chen

The information spectrum approach gives general formulae for optimal rates of various information theoretic protocols, under minimal assumptions on the nature of the sources, channels and entanglement resources involved. This paper…

Quantum Physics · Physics 2007-05-23 Garry Bowen , Nilanjana Datta