English
Related papers

Related papers: Network Information Flow with Correlated Sources

200 papers

Multicast remains a fundamental mechanism for scalable content distribution, yet existing approaches face critical limitations. Traditional multicast trees suffer from path redundancy and inefficient utilization of network resources, while…

Networking and Internet Architecture · Computer Science 2025-10-27 Tomas Lestayo Martinez , Manuel Fernandez Veiega Veiga

The problem of maximizing the information flow through a sensor network tasked with an inference objective at the fusion center is considered. The sensor nodes take observations, compress and send them to the fusion center through a network…

Optimization and Control · Mathematics 2019-10-28 Aditya Deshmukh , Jing Liu , Venugopal V. Veeravalli , Gunjan Verma

Matrix completion is a fundamental problem that comes up in a variety of applications like the Netflix problem, collaborative filtering, computer vision, and crowdsourcing. The goal of the problem is to recover a k-by-n unknown matrix from…

Information Theory · Computer Science 2014-02-19 Changho Suh

A cornerstone of our understanding of both biological and artificial neural networks is that they store information in the strengths of synaptic connections among the neurons. However, in contrast to the well-established theory for…

Neurons and Cognition · Quantitative Biology 2026-04-29 Xinhao Fan , Shreesh P Mysore

Information flow (or information transfer as may be called) the widely applicable general physics notion can be rigorously derived from first principles, rather than axiomatically proposed as an ansatz. Its logical association with…

Chaotic Dynamics · Physics 2015-03-31 X. San Liang

We consider a worst-case asymmetric distributed source coding problem where an information sink communicates with $N$ correlated information sources to gather their data. A data-vector $\bar{x} = (x_1, ..., x_N) \sim {\mathcal P}$ is…

Information Theory · Computer Science 2013-01-03 Samar Agnihotri , Rajesh Venkatachalapathy

The fundamental limit of Semantic Communications (joint source-channel coding) is established when the transmission needs to be kept covert from an external warden. We derive information-theoretic achievability and matching converse results…

Information Theory · Computer Science 2024-06-21 Abdelaziz Bounhar , Mireille Sarkiss , Michèle Wigger

In the information exchange problem, k packets that are initially maintained by k nodes need to be disseminated to the whole network as quickly as possible. We consider this problem in single-hop multi- channel networks of n nodes, and…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-11-18 Li Ning , Dongxiao Yu , Yong Zhang , Yuexuan Wang , Francis C. M. Lau , Shenzhong Feng

In a previous report we have evaluated analytically the mutual information between the firing rates of N independent units and a set of multi-dimensional continuous+discrete stimuli, for a finite population size and in the limit of large…

Disordered Systems and Neural Networks · Physics 2007-05-23 Valeria Del Prete , Alessandro Treves

In this paper we introduce Neural Network Coding(NNC), a data-driven approach to joint source and network coding. In NNC, the encoders at each source and intermediate node, as well as the decoder at each destination node, are neural…

Information Theory · Computer Science 2021-01-12 Litian Liu , Amit Solomon , Salman Salamatian , Muriel Medard

In this paper, we propose {\em distributed network compression via memory}. We consider two spatially separated sources with correlated unknown source parameters. We wish to study the universal compression of a sequence of length $n$ from…

Information Theory · Computer Science 2012-10-09 Ahmad Beirami , Faramarz Fekri

We present a programming methodology and runtime performance case study comparing the declarative data flow coordination language S-Net with Intel's Concurrent Collections (CnC). As a coordination language S-Net achieves a near-complete…

Programming Languages · Computer Science 2014-04-04 Pavel Zaichenkov , Bert Gijsbers , Clemens Grelck , Olga Tveretina , Alex Shafarenko

This paper investigates the effect of network topology on the fair allocation of network resources among a set of agents, an all-important issue for the efficiency of transportation networks all around us. We analyse a generic mechanism…

Physics and Society · Physics 2015-05-30 Rui Carvalho , Lubos Buzna , Wolfram Just , Dirk Helbing , David K. Arrowsmith

We study the problem of communicating over a single-source single-terminal network in the presence of an adversary that may jam a single link of the network. If any one of the edges can be jammed, the capacity of such networks is well…

Information Theory · Computer Science 2014-10-09 Wentao Huang , Tracey Ho , Michael Langberg , Joerg Kliewer

In this paper, a generalization of the traditional point-to-point to communication setup, which is named as "reliable communications with asymmetric codebooks", is proposed. Under the assumption of independent identically distributed…

Information Theory · Computer Science 2008-09-12 Yucel Altug , M. Kivanc Mihcak , Onur Ozyesil , Vishal Monga

For reliable transmission across a noisy communication channel, classical results from information theory show that it is asymptotically optimal to separate out the source and channel coding processes. However, this decomposition can fall…

Machine Learning · Computer Science 2019-05-15 Kristy Choi , Kedar Tatwawadi , Aditya Grover , Tsachy Weissman , Stefano Ermon

With the advent of massive data outputs at a regular rate, admittedly, signal processing technology plays an increasingly key role. Nowadays, signals are not merely restricted to physical sources, they have been extended to digital sources…

Information Theory · Computer Science 2018-01-22 Yi Janet Lu

Information diffusion models typically assume a discrete timeline in which an information token spreads in the network. Since users in real-world networks vary significantly in their intensity and periods of activity, our objective in this…

Social and Information Networks · Computer Science 2017-09-14 Daniel J. DiTursi , Gregorios A. Katsios , Petko Bogdanov

Network flow is a powerful mathematical framework to systematically explore the relationship between structure and function in biological, social, and technological networks. We introduce a new pipelining model of flow through networks…

Neural and Evolutionary Computing · Computer Science 2019-11-04 Lavanya Marla , Lav R. Varshney , Devavrat Shah , Nirmal A. Prakash , Michael E. Gale

In this paper, we study a security problem on a simple wiretap network, consisting of a source node S, a destination node D, and an intermediate node R. The intermediate node connects the source and the destination nodes via a set of…

Information Theory · Computer Science 2016-01-18 Fan Cheng , Vincent Y. F. Tan