English
Related papers

Related papers: Dualities Between Entropy Functions and Network Co…

200 papers

Network coding is studied when an adversary controls a subset of nodes in the network of limited quantity but unknown location. This problem is shown to be more difficult than when the adversary controls a given number of edges in the…

Information Theory · Computer Science 2011-12-15 Oliver Kosut , Lang Tong , David Tse

An important issue in neural network research is how to choose the number of nodes and layers such as to solve a classification problem. We provide new intuitions based on earlier results by An et al. (2015) by deriving an upper bound on…

Machine Learning · Statistics 2018-02-13 Marjolein Troost , Katja Seeliger , Marcel van Gerven

Automating the solutions of multiple network information theory problems, stretching from fundamental concerns such as determining all information inequalities and the limitations of linear codes, to applied ones such as designing coded…

Information Theory · Computer Science 2017-07-10 Jayant Apte , John MacLaren Walsh

We abstract the essential aspects of network-error detecting and correcting codes to arrive at the definitions of matroidal error detecting networks and matroidal error correcting networks. An acyclic network (with arbitrary sink demands)…

Information Theory · Computer Science 2013-07-09 K. Prasad , B. Sundar Rajan

We examine the issue of separation and code design for networks that operate over finite fields. We demonstrate that source-channel (or source-network) separation holds for several canonical network examples like the noisy multiple access…

Information Theory · Computer Science 2007-07-13 Siddharth Ray , Michelle Effros , Muriel Medard , Ralf Koetter , Tracey Ho , David Karger , Jinane Abounadi

We introduce the (private) entropy of a directed graph (in a new network coding sense) as well as a number of related concepts. We show that the entropy of a directed graph is identical to its guessing number and can be bounded from below…

Combinatorics · Mathematics 2007-11-28 Soren Riis

In this work we study zero vs. epsilon-error capacity in network coding instances. For multicast network coding it is well known that all rates that can be delivered with arbitrarily small error probability can also be delivered with zero…

Information Theory · Computer Science 2015-03-19 Michael Langberg , Michelle Effros

Parameter-space and function-space provide two different duality frames in which to study neural networks. We demonstrate that symmetries of network densities may be determined via dual computations of network correlation functions, even…

Machine Learning · Computer Science 2021-06-03 Anindita Maiti , Keegan Stoner , James Halverson

Characterising the capacity region for a network can be extremely difficult, especially when the sources are dependent. Most existing computable outer bounds are relaxations of the Linear Programming bound. One main challenge to extend…

Information Theory · Computer Science 2016-02-15 Satyajit Thakor , Terence Chan , Alex Grant

We establish a duality result between linear index coding and Locally Repairable Codes (LRCs). Specifically, we show that a natural extension of LRCs we call Generalized Locally Repairable Codes (GLCRs) are exactly dual to linear index…

Information Theory · Computer Science 2014-02-18 Karthikeyan Shanmugam , Alexandros G. Dimakis

We consider the communication capacity of wireline networks for a two-unicast traffic pattern. The network has two sources and two destinations with each source communicating a message to its own destination, subject to the capacity…

Information Theory · Computer Science 2015-06-04 Sudeep Kamath , Venkat Anantharam , David Tse , Chih-Chun Wang

For many common height functions, it is notoriously hard to compute the essential minimum. Nevertheless there are two classical methods, one giving lower bounds and the other giving upper bounds. In this paper, we show that the two methods…

Number Theory · Mathematics 2026-03-24 José Burgos Gil , Ricardo Menares , Binggang Qu , Martín Sombra

Explicit characterization of the capacity region of communication networks is a long standing problem. While it is known that network coding can outperform routing and replication, the set of feasible rates is not known in general.…

Information Theory · Computer Science 2016-04-13 Satyajit Thakor , Alex Grant , Terence Chan

The two-user computation broadcast problem is introduced as the setting where User $1$ wants message $W_1$ and has side-information $W_1'$, User $2$ wants message $W_2$ and has side-information $W_2'$, and $(W_1, W_1', W_2, W_2')$ may have…

Information Theory · Computer Science 2019-03-19 Hua Sun , Syed A. Jafar

We consider the robust version of a multi-commodity network flow problem. The robustness is defined with respect to the deletion, or failure, of edges. While the flow problem itself is a polynomially-sized linear program, its robust version…

Optimization and Control · Mathematics 2025-04-25 Artyom Klyuchikov , Roland Hildebrand , Sergei Protasov , Alexander Rogozin , Alexei Chernov

The network communication scenario where one or more receivers request all the information transmitted by different sources is considered. We introduce distributed polynomial-time network codes in the presence of malicious nodes. Our codes…

Networking and Internet Architecture · Computer Science 2010-01-18 Hongyi Yao , Theodoros K. Dikaliotis , Sidharth Jaggi , Tracey Ho

Entropy comparison inequalities are obtained for the differential entropy $h(X+Y)$ of the sum of two independent random vectors $X,Y$, when one is replaced by a Gaussian. For identically distributed random vectors $X,Y$, these are closely…

Information Theory · Computer Science 2024-07-24 Lampros Gavalakis , Ioannis Kontoyiannis , Mokshay Madiman

We consider a class of optimization problems that involve determining the maximum value that a function in a particular class can attain subject to a collection of difference constraints. We show that a particular linear programming…

Data Structures and Algorithms · Computer Science 2022-11-16 Sungjin Im , Benjamin Moseley , Hung Q. Ngo , Kirk Pruhs , Alireza Samadian

An Ingletonian polymatroid satisfies, in addition to the polymatroid axioms, the inequalities of Ingleton (Combin. Math. Appln., 1971). These inequalities are required for a polymatroid to be representable. It is has been an open question…

Information Theory · Computer Science 2009-09-21 Terence Chan , Alex Grant , Doris Kern

In this paper we investigate formal verification problems for Neural Network computations. Of central importance will be various robustness and minimization problems such as: Given symbolic specifications of allowed inputs and outputs in…

Artificial Intelligence · Computer Science 2024-03-21 Adrian Wurm