English
Related papers

Related papers: Minimizing Message Size in Stochastic Communicatio…

200 papers

Large data sets often require performing distributed statistical estimation, with a full data set split across multiple machines and limited communication between machines. To study such scenarios, we define and study some refinements of…

Information Theory · Computer Science 2014-06-24 John C. Duchi , Michael I. Jordan , Martin J. Wainwright , Yuchen Zhang

We consider a standard distributed optimisation setting where $N$ machines, each holding a $d$-dimensional function $f_i$, aim to jointly minimise the sum of the functions $\sum_{i = 1}^N f_i (x)$. This problem arises naturally in…

Machine Learning · Computer Science 2021-12-08 Dan Alistarh , Janne H. Korhonen

The application of distributed model predictive controllers (DMPC) for multi-agent systems (MASs) necessitates communication between agents, yet the consequence of communication data rates is typically overlooked. This work focuses on…

Systems and Control · Electrical Eng. & Systems 2023-08-08 Yujia Yang , Ye Wang , Chris Manzie , Ye Pu

We consider the communication complexity of a number of distributed optimization problems. We start with the problem of solving a linear system. Suppose there is a coordinator together with $s$ servers $P_1, \ldots, P_s$, the $i$-th of…

Data Structures and Algorithms · Computer Science 2019-11-01 Santosh S. Vempala , Ruosong Wang , David P. Woodruff

Biological systems can share and collectively process information to yield emergent effects, despite inherent noise in communication. While man-made systems often employ intricate structural solutions to overcome noise, the structure of…

Multiagent Systems · Computer Science 2017-12-25 Lucas Boczkowski , Ofer Feinerman , Amos Korman , Emanuele Natale

Population protocols are networks of finite-state agents, interacting randomly, and updating their states using simple rules. Despite their extreme simplicity, these systems have been shown to cooperatively perform complex computational…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-04-18 Dan Alistarh , Rati Gelashvili

Contention resolution addresses the problem of coordinating access to a shared channel. Time proceeds in slots, and a packet transmission can be made in any slot. A packet is successfully sent if no other packet is also transmitted during…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-07-28 Michael A. Bender , Jeremy T. Fineman , Seth Gilbert , John Kuszmaul , Maxwell Young

We consider the problem of resolving contention in communication networks with selfish users. In a \textit{contention game} each of $n \geq 2$ identical players has a single information packet that she wants to transmit using one of $k \geq…

Computer Science and Game Theory · Computer Science 2020-03-24 George Christodoulou , Themistoklis Melissourgos , Paul G. Spirakis

This paper investigates the dissemination of multiple pieces of information in large networks where users contact each other in a random uncoordinated manner, and users upload one piece per unit time. The underlying motivation is the design…

Networking and Internet Architecture · Computer Science 2007-07-13 Sujay Sanghavi , Bruce Hajek , Laurent Massoulie

This paper considers secure communication in a multiuser multiple-input single-output (MISO) downlink system with simultaneous wireless information and power transfer. We study the design of resource allocation algorithms minimizing the…

Information Theory · Computer Science 2013-06-05 Derrick Wing Kwan Ng , Robert Schober

The Bayesian persuasion paradigm of strategic communication models interaction between a privately-informed agent, called the sender, and an ignorant but rational agent, called the receiver. The goal is typically to design a (near-)optimal…

Computer Science and Game Theory · Computer Science 2021-06-21 Ronen Gradwohl , Niklas Hahn , Martin Hoefer , Rann Smorodinsky

We propose a protocol (called RBO) for broadcasting long streams of single-packet messages over radio channel for tiny, battery powered, receivers. The messages are labeled by the keys from some linearly ordered set. The sender repeatedly…

Data Structures and Algorithms · Computer Science 2011-08-26 Marcin Kik

In distributed optimization and machine learning, multiple nodes coordinate to solve large problems. To do this, the nodes need to compress important algorithm information to bits so that it can be communicated over a digital channel. The…

Optimization and Control · Mathematics 2020-12-02 Sindri Magnússon , Hossein Shokri-Ghadikolaei , Na Li

We study the problem of privately emulating shared memory in message-passing networks. The system includes clients that store and retrieve replicated information on N servers, out of which e are malicious. When a client access a malicious…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-06-12 Shlomi Dolev , Thomas Petig , Elad Michael Schiller

We revisit the classic problem of spreading a piece of information in a group of $n$ fully connected processors. By suitably adding a small dose of randomness to the protocol of Gasienic and Pelc (1996), we derive for the first time…

Data Structures and Algorithms · Computer Science 2015-01-06 Benjamin Doerr , Carola Doerr , Shay Moran , Shlomo Moran

The standard population protocol model assumes that when two agents interact, each observes the entire state of the other agent. We initiate the study of $\textit{message complexity}$ for population protocols, where the state of an agent is…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-12-16 Talley Amir , James Aspnes , David Doty , Mahsa Eftekhari , Eric Severson

This paper studies communication scenarios where the transmitter and the receiver have different objectives due to privacy concerns, in the context of a variation of the strategic information transfer (SIT) model of Sobel and Crawford. We…

Information Theory · Computer Science 2015-10-14 Emrah Akyol , Cedric Langbort , Tamer Basar

We consider a broadcast communication system over parallel sub-channels where the transmitter sends three messages: a common message to two users, and two confidential messages to each user which need to be kept secret from the other user.…

Information Theory · Computer Science 2016-11-15 Ahmed Benfarah , Stefano Tomasin , Nicola Laurenti

We consider the following communication task in the multi-party setting, which involves a joint random variable $XYZMN$ with the property that $M$ is independent of $YZN$ conditioned on $X$ and $N$ is independent of $XZM$ conditioned on…

Information Theory · Computer Science 2020-03-24 Anurag Anshu , Penghui Yao

We consider the following distributed consensus problem: Each node in a complete communication network of size $n$ initially holds an \emph{opinion}, which is chosen arbitrarily from a finite set $\Sigma$. The system must converge toward a…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-08-28 Luca Becchetti , Andrea Clementi , Emanuele Natale , Francesco Pasquale , Luca Trevisan