English
Related papers

Related papers: Information-Theoretic Bounds for Multiround Functi…

200 papers

We consider a multi-agent network where each node has a stochastic (local) cost function that depends on the decision variable of that node and a random variable, and further the decision variables of neighboring nodes are pairwise…

Optimization and Control · Mathematics 2021-12-24 Navjot Singh , Xuanyu Cao , Suhas Diggavi , Tamer Basar

In index coding, a server broadcasts multiple messages to their respective receivers, each with some side information that can be utilized to reduce the amount of communication from the server. Distributed index coding is an extension of…

Information Theory · Computer Science 2020-04-07 Yucheng Liu , Parastoo Sadeghi , Fatemeh Arbabjolfaei , Young-Han Kim

In decentralized optimization, nodes cooperate to minimize an overall objective function that is the sum (or average) of per-node private objective functions. Algorithms interleave local computations with communication among all or a subset…

Optimization and Control · Mathematics 2018-01-16 Angelia Nedić , Alex Olshevsky , Michael G. Rabbat

In this second part of our multi-part papers, the information flow in degraded interference networks is studied. A full characterization of the sum-rate capacity for the degraded networks with any possible configuration is established. It…

Information Theory · Computer Science 2013-02-18 Reza K. Farsani

The problem of computing a linear combination of sources over a multiple access channel is studied. Inner and outer bounds on the optimal tradeoff between the communication rates are established when encoding is restricted to random…

Information Theory · Computer Science 2018-10-30 Pinar Sen , Sung Hoon Lim , Young-Han Kim

Resource-constrained systems are prevalent in communications. Such a system is composed of many components but only some of them can be allocated with resources such as time slots. According to the amount of information about the system,…

Information Theory · Computer Science 2014-04-02 Albert Y. S. Lam , Yanhui Geng , Victor O. K. Li

This work considers the problem of transmitting multiple compressible sources over a network at minimum cost. The aim is to find the optimal rates at which the sources should be compressed and the network flows using which they should be…

Information Theory · Computer Science 2009-08-13 Aditya Ramamoorthy

We address the problem of finding optimal strategies for computing Boolean symmetric functions. We consider a collocated network, where each node's transmissions can be heard by every other node. Each node has a Boolean measurement and we…

Information Theory · Computer Science 2009-11-18 Hemant Kowshik , P. R. Kumar

In the All-Reduce problem, each one of the K nodes holds an input and wishes to compute the sum of all K inputs through a communication network where each pair of nodes is connected by a parallel link with arbitrary bandwidth. The…

Information Theory · Computer Science 2026-02-27 Yufeng Zhou , Hua Sun

We consider the problem of information aggregation in sensor networks, where one is interested in computing a function of the sensor measurements. We allow for block processing and study in-network function computation in directed graphs…

Information Theory · Computer Science 2015-03-19 Hemant Kowshik , P. R. Kumar

We consider collocated wireless sensor networks, where each node has a Boolean measurement and the goal is to compute a given Boolean function of these measurements. We first consider the worst case setting and study optimal block…

Information Theory · Computer Science 2011-05-09 Hemant Kowshik , P. R. Kumar

This work addresses the problem of distributed computation of linearly separable functions, where a master node with access to $K$ datasets, employs $N$ servers to compute $L$ user-requested functions, each defined over the datasets.…

Information Theory · Computer Science 2025-09-30 K. K. Krishnan Namboodiri , Elizabath Peter , Derya Malak , Petros Elia

We consider a coded distributed computing problem in a ring-based communication network, where $N$ computing nodes are arranged in a ring topology and each node can only communicate with its neighbors within a constant distance $d$. To…

Information Theory · Computer Science 2026-03-06 Zhenhao Huang , Minquan Cheng , Kai Wan , Qifu Tyler Sun , Youlong Wu

We consider optimal distributed computation of a given function of distributed data. The input (data) nodes and the sink node that receives the function form a connected network that is described by an undirected weighted network graph. The…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-07-15 Pooja Vyavahare , Nutan Limaye , D. Manjunath

We are interested in how to best communicate a (usually real valued) source to a number of destinations (sinks) over a network with capacity constraints in a collective fidelity metric over all the sinks, a problem which we call joint…

Information Theory · Computer Science 2007-07-13 Nima Sarshar , Xiaolin Wu

This work establishes the fundamental limits of the classical problem of multi-user distributed computing of linearly separable functions. In particular, we consider a distributed computing setting involving $L$ users, each requesting a…

Information Theory · Computer Science 2026-01-16 K. K. Krishnan Namboodiri , Elizabath Peter , Derya Malak , Petros Elia

The problem of network function computation over a directed acyclic network is investigated in this paper. In such a network, a sink node desires to compute with zero error a {\em target function}, of which the inputs are generated at…

Information Theory · Computer Science 2017-10-09 Xuan Guang , Raymond W. Yeung , Shenghao Yang , Congduan Li

In this article, we focus on the communication costs of three symmetric matrix computations: i) multiplying a matrix with its transpose, known as a symmetric rank-k update (SYRK) ii) adding the result of the multiplication of a matrix with…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-09-18 Hussam Al Daas , Grey Ballard , Laura Grigori , Suraj Kumar , Kathryn Rouse , Mathieu Verite

In this paper, we investigated semantic communication for multi-task processing using an information-theoretic approach. We introduced the concept of a "semantic source", allowing multiple semantic interpretations from a single observation.…

Signal Processing · Electrical Eng. & Systems 2024-10-10 Ahmad Halimi Razlighi , Carsten Bockelmann , Armin Dekorsy

Inspired by mobile satellite communication systems and the important and prevalent applications of computational tasks, we consider a distributed source coding model for compressing vector-linear functions, which consists of multiple…

Information Theory · Computer Science 2025-08-06 Xuan Guang , Xiufang Sun , Ruze Zhang