English
Related papers

Related papers: Shannon capacity, Chess, DNA and Umbrellas

200 papers

Complementarity relations between various characterizations of a probability distribution are at the core of information theory. In particular, lower and upper bounds for the entropic function are of great importance. In applied topics, we…

Quantum Physics · Physics 2022-09-07 Alexey E. Rastegin

Information complexity is the interactive analogue of Shannon's classical information theory. In recent years this field has emerged as a powerful tool for proving strong communication lower bounds, and for addressing some of the major open…

Computational Complexity · Computer Science 2015-04-28 Omri Weinstein

For the discrete-time AWGN channel with a power constraint, we give an alternative derivation of Shannon's sphere-packing upper bound on the optimal block error exponent and prove for the first time an analogous lower bound on the optimal…

Information Theory · Computer Science 2023-07-26 Sergey Tridenski , Anelia Somekh-Baruch

We give trade-offs between classical communication, quantum communication, and entanglement for processing information in the Shannon-theoretic setting. We first prove a unit-resource capacity theorem that applies to the scenario where only…

Quantum Physics · Physics 2010-08-23 Min-Hsiu Hsieh , Mark M. Wilde

This paper describes how the maximum potential number of edges of an encapsulated graph varies as the graph is transformed, that is, as nodes are created and modified. The equations governing these changes of maximum potential number of…

Software Engineering · Computer Science 2009-01-15 Edmund Kirwan

Existing information-theoretic frameworks based on maximum entropy network ensembles are not able to explain the emergence of heterogeneity in complex networks. Here, we fill this gap of knowledge by developing a classical framework for…

Physics and Society · Physics 2020-07-08 Filippo Radicchi , Dmitri Krioukov , Harrison Hartle , Ginestra Bianconi

The information-theoretic representation of quantum systems, which complements the familiar energy description of the density-functional and wave-function-based theories, is here discussed. According to it, the internal disorder of the…

Quantum Physics · Physics 2013-05-27 J. S. Dehesa , D. Manzano , P. S. Sánchez-Moreno , R. J. Yáñez

In this paper, we consider contention resolution algorithms that are augmented with predictions about the network. We begin by studying the natural setup in which the algorithm is provided a distribution defined over the possible network…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-05-27 Seth Gilbert , Calvin Newport , Nitin Vaidya , Alex Weaver

We continue the study of the quantum channel version of Shannon's zero-error capacity problem. We generalize the celebrated Haemers bound to noncommutative graphs (obtained from quantum channels). We prove basic properties of this bound,…

Quantum Physics · Physics 2020-02-10 Sander Gribling , Yinan Li

Let D be an arbitrary subset of the natural numbers. For every n, let M(n;D) be the maximum of the cardinality of a set of Hamiltonian paths in the complete graph K_n such that the union of any two paths from the family contains a not…

Combinatorics · Mathematics 2011-06-21 János Körner , Silvia Messuti , Gábor Simonyi

A method of representing probabilistic aspects of quantum systems is introduced by means of a density function on the space of pure quantum states. In particular, a maximum entropy argument allows us to obtain a natural density function…

Quantum Physics · Physics 2015-06-26 D. C. Brody , L. P. Hughston

We identify five selected open problems in the theory of quantum information, which are rather simple to formulate, were well-studied in the literature, but are technically not easy. As these problems enjoy diverse mathematical connections,…

Quantum Physics · Physics 2020-12-22 Paweł Horodecki , Łukasz Rudnicki , Karol Życzkowski

Convex optimization problems arise naturally in quantum information theory, often in terms of minimizing a convex function over a convex subset of the space of hermitian matrices. In most cases, finding exact solutions to these problems is…

Quantum Physics · Physics 2014-11-26 Mark W. Girard , Gilad Gour , Shmuel Friedland

We study a setting where a receiver must design a questionnaire to recover a sequence of symbols known to strategic sender, whose utility may not be incentive compatible. We allow the receiver the possibility of selecting the alternatives…

Information Theory · Computer Science 2022-09-16 Anuj S. Vora , Ankur A. Kulkarni

Even if a probability distribution is properly normalizable, its associated Shannon (or von Neumann) entropy can easily be infinite. We carefully analyze conditions under which this phenomenon can occur. Roughly speaking, this happens when…

Statistical Mechanics · Physics 2013-04-04 Valentina Baccetti , Matt Visser

Can we learn more from data than existed in the generating process itself? Can new and useful information be constructed from merely applying deterministic transformations to existing data? Can the learnable content in data be evaluated…

Machine Learning · Computer Science 2026-03-17 Marc Finzi , Shikai Qiu , Yiding Jiang , Pavel Izmailov , J. Zico Kolter , Andrew Gordon Wilson

As conventional communication systems based on classic information theory have closely approached the limits of Shannon channel capacity, semantic communication has been recognized as a key enabling technology for the further improvement of…

Information Theory · Computer Science 2023-06-06 Jiancheng Tang , Qianqian Yang , Zhaoyang Zhang

Counting independent sets in graphs and hypergraphs under a variety of restrictions is a classical question with a long history. It is the subject of the celebrated container method which found numerous spectacular applications over the…

Combinatorics · Mathematics 2025-09-17 Matija Bucić , Maria Chudnovsky , Julien Codsi

It is known that the high-dimensional quantum state space is notoriously complicated in contrast with the beautiful Bloch ball of the qubit. We examined the mechanism behind this fact in the frame work of general probabilistic theory (GPT),…

Quantum Physics · Physics 2022-03-17 Keiji Matsumoto , Gen Kimura

In the first chapter of Shannon's "A Mathematical Theory of Communication," it is shown that the maximum entropy rate of an input process of a constrained system is limited by the combinatorial capacity of the system. Shannon considers…

Information Theory · Computer Science 2009-11-20 Georg Böcherer , Valdemar Cardoso da Rocha Junior , Cecilio Pimentel