English
Related papers

Related papers: Communication Complexity of Estimating Correlation…

200 papers

Large data sets often require performing distributed statistical estimation, with a full data set split across multiple machines and limited communication between machines. To study such scenarios, we define and study some refinements of…

Information Theory · Computer Science 2014-06-24 John C. Duchi , Michael I. Jordan , Martin J. Wainwright , Yuchen Zhang

We study the tradeoff between the statistical error and communication cost of distributed statistical estimation problems in high dimensions. In the distributed sparse Gaussian mean estimation problem, each of the $m$ machines receives $n$…

Machine Learning · Computer Science 2016-05-11 Mark Braverman , Ankit Garg , Tengyu Ma , Huy L. Nguyen , David P. Woodruff

Two parties observing correlated random variables seek to run an interactive communication protocol. How many bits must they exchange to simulate the protocol, namely to produce a view with a joint distribution within a fixed statistical…

Information Theory · Computer Science 2016-02-01 Himanshu Tyagi , Shaileshh Venkatakrishnan , Pramod Viswanath , Shun Watanabe

We consider parameter estimation in distributed networks, where each sensor in the network observes an independent sample from an underlying distribution and has $k$ bits to communicate its sample to a centralized processor which computes…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-07-23 Yanjun Han , Ayfer Özgür , Tsachy Weissman

We study the robust communication complexity of maximum matching. Edges of an arbitrary $n$-vertex graph $G$ are randomly partitioned between Alice and Bob independently and uniformly. Alice has to send a single message to Bob such that Bob…

Data Structures and Algorithms · Computer Science 2023-05-03 Amir Azarmehr , Soheil Behnezhad

Communication complexity, which quantifies the minimum communication required for distributed computation, offers a natural setting for investigating the capabilities and limitations of quantum mechanics in information processing. We…

Quantum Physics · Physics 2026-02-12 Nikolai Miklin , Prabhav Jain , Mariami Gachechiladze

We investigate the randomized and quantum communication complexity of the Hamming Distance problem, which is to determine if the Hamming distance between two n-bit strings is no less than a threshold d. We prove a quantum lower bound of…

Quantum Physics · Physics 2011-11-04 Wei Huang , Yaoyun Shi , Shengyu Zhang , Yufan Zhu

We consider the problem of learning high-dimensional, nonparametric and structured (e.g. Gaussian) distributions in distributed networks, where each node in the network observes an independent sample from the underlying distribution and can…

Information Theory · Computer Science 2019-06-04 Leighton Pate Barnes , Yanjun Han , Ayfer Ozgur

Two parties observe independent copies of a $d$-dimensional vector and a scalar. They seek to test if their data is correlated or not, namely they seek to test if the norm $\|\rho\|_2$ of the correlation vector $\rho$ between their…

Information Theory · Computer Science 2020-05-22 K. R. Sahasranand , Himanshu Tyagi

We consider the communication complexity of some fundamental convex optimization problems in the point-to-point (coordinator) and blackboard communication models. We strengthen known bounds for approximately solving linear regression,…

Data Structures and Algorithms · Computer Science 2024-03-29 Mehrdad Ghadiri , Yin Tat Lee , Swati Padmanabhan , William Swartworth , David Woodruff , Guanghao Ye

We introduce the \emph{local information cost} (LIC), which quantifies the amount of information that nodes in a network need to learn when solving a graph problem. We show that the local information cost presents a natural lower bound on…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-01-23 Peter Robinson

In this paper we explore fundamental problems in randomized communication complexity such as computing Set Intersection on sets of size $k$ and Equality Testing between vectors of length $k$. Sa\u{g}lam and Tardos and Brody et al. showed…

Information Theory · Computer Science 2020-05-21 Dawei Huang , Seth Pettie , Yixiang Zhang , Zhijun Zhang

We study the effect that the amount of correlation in a bipartite distribution has on the communication complexity of a problem under that distribution. We introduce a new family of complexity measures that interpolates between the two…

Computational Complexity · Computer Science 2015-08-25 Ralph C. Bottesch , Dmitry Gavinsky , Hartmut Klauck

We study the role of interactivity in distributed statistical inference under information constraints, e.g., communication constraints and local differential privacy. We focus on the tasks of goodness-of-fit testing and estimation of…

Data Structures and Algorithms · Computer Science 2021-10-26 Jayadev Acharya , Clément L. Canonne , Yuhan Liu , Ziteng Sun , Himanshu Tyagi

In this paper, we study the problem of relaying a single bit of information across a series of binary symmetric channels, and the associated trade-off between the number of hops $m$, the transmission time $n$, and the error probability. We…

Information Theory · Computer Science 2022-12-09 Yan Hao Ling , Jonathan Scarlett

We study a model of communication complexity that encompasses many well-studied problems, including classical and quantum communication complexity, the complexity of simulating distributions arising from bipartite measurements of shared…

Quantum Physics · Physics 2011-07-08 Julien Degorre , Marc Kaplan , Sophie Laplante , Jérémie Roland

We show that almost all known lower bound methods for communication complexity are also lower bounds for the information complexity. In particular, we define a relaxed version of the partition bound of Jain and Klauck and prove that it…

Computational Complexity · Computer Science 2013-01-21 Iordanis Kerenidis , Sophie Laplante , Virginie Lerays , Jérémie Roland , David Xiao

We prove an $\Omega(n^{1-1/k} \log k \ /2^k)$ lower bound on the $k$-party number-in-hand communication complexity of collision-finding. This implies a $2^{n^{1-o(1)}}$ lower bound on the size of tree-like cutting-planes proofs of the bit…

Computational Complexity · Computer Science 2024-11-13 Paul Beame , Michael Whitmeyer

In this paper we study the two player randomized communication complexity of the sparse set disjointness and the exists-equal problems and give matching lower and upper bounds (up to constant factors) for any number of rounds for both of…

Computational Complexity · Computer Science 2013-04-05 Mert Saglam , Gabor Tardos

In this work, we study the experts problem in the distributed setting where an expert's cost needs to be aggregated across multiple servers. Our study considers various communication models such as the message-passing model and the…

Machine Learning · Computer Science 2025-01-07 Zhihao Jia , Qi Pang , Trung Tran , David Woodruff , Zhihao Zhang , Wenting Zheng