English
Related papers

Related papers: Shannon Bounds for Quadratic Rate-Distortion Probl…

200 papers

We present a new technique to obtain outer-bounds on the capacity region of networks with ultra low-rate feedback. We establish a connection between the achievable rates in the forward channel and the minimum distortion that can be attained…

Information Theory · Computer Science 2021-05-11 Alireza Vahid

Complex systems can be effectively modeled via graphs that encode networked interactions, where relations between entities or nodes are often quantified by signed edge weights, e.g., promotion/inhibition in gene regulatory networks, or…

Optimization and Control · Mathematics 2024-04-05 Anqi Dong , Can Chen , Tryphon T. Georgiou

Gallager-type error-correcting codes that nearly saturate Shannon's bound are constructed using insight gained from mapping the problem onto that of an Ising spin system. The performance of the suggested codes is evaluated for different…

Disordered Systems and Neural Networks · Physics 2009-10-31 Ido Kanter , David Saad

In this work, we establish a full single-letter characterization of the rate-distortion region of an instance of the Gray-Wyner model with side information at the decoders. Specifically, in this model an encoder observes a pair of…

Information Theory · Computer Science 2018-02-14 Meryem Benammar , Abdellatif Zaidi

In the first paper of this two part communication, we solved in a unified framework a variety of two terminal source coding problems with noncooperative encoders, thereby consolidating works of Shannon, Slepian-Wolf, Wyner,…

Information Theory · Computer Science 2007-07-13 Soumya Jana

We introduce a new approach to spectral sparsification that approximates the quadratic form of the pseudoinverse of a graph Laplacian restricted to a subspace. We show that sparsifiers with a near-linear number of edges in the dimension of…

Data Structures and Algorithms · Computer Science 2018-10-09 Huan Li , Aaron Schild

Consider the two-way rate-distortion problem in which a helper sends a common limited-rate message to both users based on side information at its disposal. We characterize the region of achievable rates and distortions where a Markov form…

Information Theory · Computer Science 2009-04-06 Haim Permuter , Yossi Steinberg , Tsachy Weissman

The binary adder is a two-user multiple access channel whose inputs are binary and whose output is the real sum of the inputs. While the Shannon capacity region of this channel is well known, little is known regarding its zero-error…

Information Theory · Computer Science 2014-12-31 Or Ordentlich , Ofer Shayevitz

We investigate the Wyner-Ziv coding in which the statistics of the principal source is known but the statistics of the channel generating the side-information is unknown except that it is in a certain class. The class consists of channels…

Information Theory · Computer Science 2013-05-06 Shun Watanabe , Shigeaki Kuzuoka

We investigate an encoding scheme for lossy compression of a binary symmetric source based on simple spatially coupled Low-Density Generator-Matrix codes. The degree of the check nodes is regular and the one of code-bits is Poisson…

Information Theory · Computer Science 2015-06-12 Vahid Aref , Nicolas Macris , Marc Vuffray

This paper presents enhanced reductions of the bounded-weight and exact-weight Syndrome Decoding Problem (SDP) to a system of quadratic equations. Over $\mathbb{F}_2$, we improve on a previous work and study the degree of regularity of the…

Cryptography and Security · Computer Science 2025-01-29 Alessio Caminata , Ryann Cartor , Alessio Meneghetti , Rocco Mora , Alex Pellegrini

This paper begins with a discussion of integration over probability types (p-types). After doing that, the paper re-visits 3 mainstay problems of classical (non-quantum) Shannon Information Theory (SIT): source coding without distortion,…

Information Theory · Computer Science 2012-08-15 Robert R. Tucci

We consider the joint source-channel coding problem of sending a Gaussian source on a K-user Gaussian broadcast channel with bandwidth mismatch. A new outer bound to the achievable distortion region is derived using the technique of…

Information Theory · Computer Science 2010-11-22 Chao Tian , Suhas Diggavi , Shlomo Shamai

We study side-channel attacks for the Shannon cipher system. To pose side channel-attacks to the Shannon cipher system, we regard them as a signal estimation via encoded data from two distributed sensors. This can be formulated as the one…

Information Theory · Computer Science 2019-01-21 Yasutada Oohama , Bagus Santoso

We introduce a new quantum decoder based on a variant of the pretty good measurement, but defined via an alternative matrix quotient. We use this decoder to show new lower bounds on the error exponent both in the one-shot and asymptotic…

Quantum Physics · Physics 2025-07-29 Salman Beigi , Marco Tomamichel

We establish a new extremal inequality, which is further leveraged to give a complete characterization of the rate region of the vector Gaussian CEO problem with the trace distortion constraint. The proof of this extremal inequality hinges…

Information Theory · Computer Science 2014-02-21 Yinfei Xu , Qiao Wang

An analog source is to be transmitted across a Gaussian channel in more than one channel use per source symbol. This paper derives a lower bound on the asymptotic mean squared error for a strategy that consists of repeatedly quantizing the…

Information Theory · Computer Science 2016-11-17 Marius Kleiner , Bixio Rimoldi

The entropy region is a fundamental object in information theory. An outer bound for the entropy region is defined by a minimal set of Shannon-type inequalities called elemental inequalities also referred to as the Shannon region. This…

Information Theory · Computer Science 2020-05-22 Hitika Tiwari , Satyajit Thakor

High order numerical methods for networks of hyperbolic conservation laws have recently gained increasing popularity. Here, the crucial part is to treat the boundaries of the single (one-dimensional) computational domains in such a way that…

Numerical Analysis · Mathematics 2018-02-22 Alexander Naumann , Oliver Kolb , Matteo Semplice

In this thesis we present several results in coding theory, concerning error-correcting codes and the Shannon capacity. 1. We give a general symmetry reduction of matrices occuring in semidefinite programs in coding theory. 2. We apply the…

Combinatorics · Mathematics 2020-05-07 Sven Polak