English
Related papers

Related papers: A Unified Approach for Network Information Theory

200 papers

We consider the problem of error control in a coded, multicast network, focusing on the scenario where the errors can occur only on a proper subset of the network edges. We model this problem via an adversarial noise, presenting a formal…

Information Theory · Computer Science 2022-05-31 Allison Beemer , Altan Berdan Kilic , Alberto Ravagnani

We wish to minimize the resources used for network coding while achieving the desired throughput in a multicast scenario. We employ evolutionary approaches, based on a genetic algorithm, that avoid the computational complexity that makes…

Networking and Internet Architecture · Computer Science 2016-11-15 Minkyu Kim , Muriel Medard , Varun Aggarwal , Una-May O'Reilly , Wonsik Kim , Chang Wook Ahn , Michelle Effros

This paper proposes a unifying variational approach for proving and extending some fundamental information theoretic inequalities. Fundamental information theory results such as maximization of differential entropy, minimization of Fisher…

Information Theory · Computer Science 2016-02-05 Sangwoo Park , Erchin Serpedin , Khalid Qaraqe

Partial Information Decomposition (PID) seeks to disentangle how information about a target variable is distributed across multiple sources, separating redundant, unique, and synergistic contributions. Despite extensive theoretical…

Information Theory · Computer Science 2025-12-19 Philip Hendrik Matthias , Abdullah Makkeh , Michael Wibral , Aaron J. Gutknecht

This article presents a theoretical investigation of generalized encoded forms of networks in a uniform multidimensional space. First, we study encoded networks with (finite) arbitrary node dimensions (or aspects), such as time instants or…

Discrete Mathematics · Computer Science 2023-04-25 Felipe S. Abrahão , Klaus Wehmuth , Hector Zenil , Artur Ziviani

In the setting where information cannot be verified, we propose a simple yet powerful information theoretical framework---the Mutual Information Paradigm---for information elicitation mechanisms. Our framework pays every agent a measure of…

Computer Science and Game Theory · Computer Science 2018-01-19 Yuqing Kong , Grant Schoenebeck

We prove a direct sum theorem for bounded round entanglement-assisted quantum communication complexity. To do so, we use the fully quantum definition for information cost and complexity that we recently introduced, and use both the fact…

Quantum Physics · Physics 2021-01-01 Dave Touchette

Information theory provides tools to predict the performance of a learning algorithm on a given dataset. For instance, the accuracy of learning an unknown parameter can be upper bounded by reducing the learning task to hypothesis testing…

Quantum Physics · Physics 2026-04-21 Evan Peters

We focus on a particular form of network coding, reverse carpooling, in a wireless network where the potentially coded transmitted messages are to be decoded immediately upon reception. The network is fixed and known, and the system…

Networking and Internet Architecture · Computer Science 2010-01-20 Ali ParandehGheibi , Asuman Ozdaglar , Michelle Effros , Muriel Medard

This paper settles the sample complexity of single-parameter revenue maximization by showing matching upper and lower bounds, up to a poly-logarithmic factor, for all families of value distributions that have been considered in the…

Computer Science and Game Theory · Computer Science 2019-04-11 Chenghao Guo , Zhiyi Huang , Xinzhi Zhang

Random coding arguments are the backbone of most channel capacity achievability proofs. In this paper, we show that in their standard form, such arguments are insufficient for proving some network capacity theorems: structured coding…

Information Theory · Computer Science 2008-02-05 Bobak Nazer , Michael Gastpar

In this paper, we investigate the problem of recovering source information from an incomplete set of network coded data. We first study the theoretical performance of such systems under maximum a posteriori (MAP) decoding and derive the…

Information Theory · Computer Science 2015-03-16 Eirina Bourtsoulatze , Nikolaos Thomos , Pascal Frossard

The Uniform Information Density (UID) hypothesis proposes that effective communication is achieved by maintaining a stable flow of information. In this work, we revisit this principle in the context of Large Language Model (LLM) reasoning,…

Artificial Intelligence · Computer Science 2026-04-20 Minju Gwak , Guijin Son , Jaehyung Kim

Random Linear Network Coding (RLNC) has emerged as a powerful tool for robust high-throughput multicast. Projection analysis - a recently introduced technique - shows that the distributed packetized RLNC protocol achieves (order) optimal…

Information Theory · Computer Science 2011-02-17 Bernhard Haeupler , Muriel Médard

We propose a unified framework to address a family of classical mixed-integer optimization problems with logically constrained decision variables, including network design, facility location, unit commitment, sparse portfolio selection,…

Optimization and Control · Mathematics 2021-10-19 Dimitris Bertsimas , Ryan Cory-Wright , Jean Pauphilet

Content-Centric Networking (CCN) naturally supports multi-path communication, as it allows the simultaneous use of multiple interfaces (e.g. LTE and WiFi). When multiple sources and multiple clients are considered, the optimal set of…

Networking and Internet Architecture · Computer Science 2016-11-18 Jonnahtan Saltarin , Eirina Bourtsoulatze , Nikolaos Thomos , Torsten Braun

The challenge of information extraction (IE) lies in the diversity of label schemas and the heterogeneity of structures. Traditional methods require task-specific model design and rely heavily on expensive supervision, making them difficult…

Computation and Language · Computer Science 2023-01-10 Jie Lou , Yaojie Lu , Dai Dai , Wei Jia , Hongyu Lin , Xianpei Han , Le Sun , Hua Wu

We introduce a unified framework for the study of multilevel mixed integer linear optimization problems and multistage stochastic mixed integer linear optimization problems with recourse. The framework highlights the common mathematical…

Optimization and Control · Mathematics 2021-04-20 Suresh Bolusani , Stefano Coniglio , Ted. K. Ralphs , Sahar Tahernejad

In this paper we close the gap between end-to-end diversity coding and intra-session network coding for unicast connections resilient against single link failures. In particular, we show that coding operations are sufficient to perform at…

Information Theory · Computer Science 2014-09-15 Peter Babarczi , Janos Tapolcai , Lajos Ronyai , Muriel Medard

Network topology plays a key role in many phenomena, from the spreading of diseases to that of financial crises. Whenever the whole structure of a network is unknown, one must resort to reconstruction methods that identify the least biased…

Data Analysis, Statistics and Probability · Physics 2015-06-09 Rossana Mastrandrea , Tiziano Squartini , Giorgio Fagiolo , Diego Garlaschelli