English
Related papers

Related papers: Interactive Communication for Data Exchange

200 papers

We study the tradeoff between the statistical error and communication cost of distributed statistical estimation problems in high dimensions. In the distributed sparse Gaussian mean estimation problem, each of the $m$ machines receives $n$…

Machine Learning · Computer Science 2016-05-11 Mark Braverman , Ankit Garg , Tengyu Ma , Huy L. Nguyen , David P. Woodruff

We consider the problem of communication efficient distributed optimization where multiple nodes exchange important algorithm information in every iteration to solve large problems. In particular, we focus on the stochastic variance-reduced…

Machine Learning · Computer Science 2020-03-16 Hossein S. Ghadikolaei , Sindri Magnusson

In the last few years, there has been a great interest in extending the information-theoretic scenario for the non-asymptotic or one-shot case, i.e., where the channel is used only once. We provide the one-shot rate region for the…

Information Theory · Computer Science 2013-02-26 Naresh Sharma , Naqueeb Ahmad Warsi

Data shuffling is one of the fundamental building blocks for distributed learning algorithms, that increases the statistical gain for each step of the learning process. In each iteration, different shuffled data points are assigned by a…

Information Theory · Computer Science 2016-09-19 Mohamed Attia , Ravi Tandon

Given a correlation generated by a (possibly quantum) communication network, we study the amount of shared randomness required to generate it. We develop a novel upper bound for approximating distributions generated by arbitrary networks…

Quantum Physics · Physics 2026-03-16 Yukari Uchibori , Alice Zheng , Anurag Anshu , Jamie Sikora

The paper deals with the distributed minimum sharing problem: a set of decision-makers compute the minimum of some local quantities of interest in a distributed and decentralized way by exchanging information through a communication…

Systems and Control · Electrical Eng. & Systems 2021-06-28 Michelangelo Bin , Thomas Parisini

The Gap-Hamming-Distance problem arose in the context of proving space lower bounds for a number of key problems in the data stream model. In this problem, Alice and Bob have to decide whether the Hamming distance between their $n$-bit…

Computational Complexity · Computer Science 2009-02-17 Joshua Brody , Amit Chakrabarti

We are concerned with the problem of maximizing the worst-case lifetime of a data-gathering wireless sensor network consisting of a set of sensor nodes directly communicating with a base-station.We propose to solve this problem by modeling…

Information Theory · Computer Science 2007-11-03 Samar Agnihotri , Pavan Nuggehalli

Best arm identification (or, pure exploration) in multi-armed bandits is a fundamental problem in machine learning. In this paper we study the distributed version of this problem where we have multiple agents, and they want to learn the…

Machine Learning · Computer Science 2019-09-02 Chao Tao , Qin Zhang , Yuan Zhou

Quantum key distribution performs the trick of growing a secret key in two distant places connected by a quantum channel. The main reason is that the legitimate users can bound the information gathered by the eavesdropper. In practical…

Quantum Physics · Physics 2013-06-03 David Elkouss , Jesus Martinez-Mateo , Vicente Martin

We study the round and communication complexities of various cryptographic protocols. We give tight lower bounds on the round and communication complexities of any fully black-box reduction of a statistically hiding commitment scheme from…

Cryptography and Security · Computer Science 2021-05-05 Iftach Haitner , Jonathan J. Hoch , Omer Reingold , Gil Segev

Information theoretic secrecy is combined with cryptographic secrecy to create a secret-key exchange protocol for wireless networks. A network of transmitters, which already have cryptographically secured channels between them, cooperate to…

Cryptography and Security · Computer Science 2016-11-15 Toni Draganov Stojanovski , Ninoslav Marina

For the multiterminal secret key agreement problem, new single-letter lower bounds are obtained on the public discussion rate required to achieve any given secret key rate below the secrecy capacity. The results apply to general source…

Information Theory · Computer Science 2017-01-20 Chung Chan , Manuj Mukherjee , Navin Kashyap , Qiaoqiao Zhou

A collaborative distributed binary decision problem is considered. Two statisticians are required to declare the correct probability measure of two jointly distributed memoryless process, denoted by $X^n=(X_1,\dots,X_n)$ and…

Information Theory · Computer Science 2016-04-11 Gil Katz , Pablo Piantanida , Merouane Debbah

We consider distributed online learning protocols that control the exchange of information between local learners in a round-based learning scenario. The learning performance of such a protocol is intuitively optimal if approximately the…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-12-02 Michael Kamp , Mario Boley , Michael Mock , Daniel Keren , Assaf Schuster , Izchak Sharfman

In this work, we study two-party interactive coding for adversarial noise, when both parties have limited memory. We show how to convert any adaptive protocol $\Pi$ into a protocol $\Pi'$ that is robust to an $\epsilon$-fraction of…

Information Theory · Computer Science 2024-08-14 Dorsa Fathollahi , Bernhard Haeupler , Nicolas Resch , Mary Wootters

In this paper we study the inherent trade-off between time and communication complexity for the distributed consensus problem. In our model, communication complexity is measured as the maximum data throughput (in bits per second) sent…

Systems and Control · Computer Science 2014-10-07 Federico Rossi , Marco Pavone

We derive information-theoretic converses (i.e., lower bounds) for the minimum time required by any algorithm for distributed function computation over a network of point-to-point channels with finite capacity, where each node of the…

Information Theory · Computer Science 2017-01-04 Aolin Xu , Maxim Raginsky

We prove a near optimal round-communication tradeoff for the two-party quantum communication complexity of disjointness. For protocols with $r$ rounds, we prove a lower bound of $\tilde{\Omega}(n/r + r)$ on the communication required for…

Computational Complexity · Computer Science 2015-05-13 Mark Braverman , Ankit Garg , Young Kun Ko , Jieming Mao , Dave Touchette

We consider the problem of resource allocation and control of multihop networks in which multiple source-destination pairs communicate confidential messages, to be kept confidential from the intermediate nodes. We pose the problem as that…

Information Theory · Computer Science 2015-09-15 Yunus Sarikaya , C. Emre Koksal , Ozgur Ercetin