English
Related papers

Related papers: XOR Lemmas for Communication via Marginal Informat…

200 papers

We study the tradeoff between the statistical error and communication cost of distributed statistical estimation problems in high dimensions. In the distributed sparse Gaussian mean estimation problem, each of the $m$ machines receives $n$…

Machine Learning · Computer Science 2016-05-11 Mark Braverman , Ankit Garg , Tengyu Ma , Huy L. Nguyen , David P. Woodruff

We focus on the well-studied problem of distributed overlay network construction. We consider a synchronous gossip-based communication model where in each round a node can send a message of small size to another node whose identifier it…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-11-30 Fabien Dufoulon , Michael Moorman , William K. Moses , Gopal Pandurangan

We study cost-effective communication strategies that can be used to improve the performance of distributed learning systems in resource-constrained environments. For distributed learning in sequential decision making, we propose a new…

Machine Learning · Computer Science 2020-04-15 Udari Madhushani , Naomi Ehrich Leonard

We revisit the hardness of approximating the diameter of a network. In the CONGEST model of distributed computing, $ \tilde \Omega (n) $ rounds are necessary to compute the diameter [Frischknecht et al. SODA'12], where $ \tilde \Omega…

Data Structures and Algorithms · Computer Science 2018-03-02 Karl Bringmann , Sebastian Krinninger

We study the problem of PAC learning $\gamma$-margin halfspaces with Random Classification Noise. We establish an information-computation tradeoff suggesting an inherent gap between the sample complexity of the problem and the sample…

Machine Learning · Computer Science 2023-06-29 Ilias Diakonikolas , Jelena Diakonikolas , Daniel M. Kane , Puqian Wang , Nikos Zarifis

Three decades of research in communication complexity have led to the invention of a number of techniques to lower bound randomized communication complexity. The majority of these techniques involve properties of large submatrices…

Computational Complexity · Computer Science 2012-05-07 Amit Chakrabarti , Ranganath Kondapally , Zhenghui Wang

Although unification can be used to implement a weak form of $\beta$-reduction, several linguistic phenomena are better handled by using some form of $\lambda$-calculus. In this paper we present a higher order feature description calculus…

cmp-lg · Computer Science 2008-02-03 Luis Damas , Nelma Moreira

The purpose of this paper is twofold. First, we provide an optimal $\Omega(\sqrt{n})$ bits lower bound for any two-way protocol for the Vector in Subspace Communication Problem which is of bounded total rank. This result complements Raz's…

Probability · Mathematics 2017-02-01 Uri Grupel

We consider the class of functions whose value depends only on the intersection of the input X_1,X_2, ..., X_t; that is, for each F in this class there is an f_F: 2^{[n]} \to {0,1}, such that F(X_1,X_2, ..., X_t) = f_F(X_1 \cap X_2 \cap ...…

Quantum Physics · Physics 2007-05-23 Rahul Jain , Jaikumar Radhakrishnan , Pranab Sen

We develop lower bounds on communication in the memory hierarchy or between processors for nested bilinear algorithms, such as Strassen's algorithm for matrix multiplication. We build on a previous framework that establishes communication…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-09-29 Caleb Ju , Yifan Zhang , Edgar Solomonik

Communication in poor network environment is always a difficult problem, since troubles such as bit errors and packet loss may often occur. It is generally believed that it is impossible to transmit data both accurately and efficiently in…

Networking and Internet Architecture · Computer Science 2022-10-20 Ye Tianyi

Information divergence functions play a critical role in statistics and information theory. In this paper we show that a non-parametric f-divergence measure can be used to provide improved bounds on the minimum binary classification…

Information Theory · Computer Science 2015-02-11 Visar Berisha , Alan Wisler , Alfred O. Hero , Andreas Spanias

There is a fundamental limit on the capacity of fibre optical communication system (Shannon Limit). This limit can be potentially overcome via using Nonlinear Frequency Division Multiplexing. Dealing with noises in these systems is one of…

Information Theory · Computer Science 2017-11-28 Wen Qi Zhang , Tao Gui , Qun Zhang , Chao Lu , Tanya M. Monro , Terence H. Chan , Alan Pak Tao Lau , Shahraam Afshar

We prove that any semi-streaming algorithm for $(1-\epsilon)$-approximation of maximum bipartite matching requires \[ \Omega(\frac{\log{(1/\epsilon)}}{{\log{(1/\beta)}}}) \] passes, where $\beta \in (0,1)$ is the largest parameter so that…

Data Structures and Algorithms · Computer Science 2023-10-12 Sepehr Assadi , Janani Sundaresan

We consider the problem of testing whether a Boolean function has Fourier degree $\leq k$ or it is $\epsilon$-far from any Boolean function with Fourier degree $\leq k$. We improve the known lower bound of $\Omega(k)$ \cite{BBM11,CGM10}, to…

Computational Complexity · Computer Science 2013-08-27 Pooya Hatami

Communication complexity is a fundamental aspect of information science, concerned with the amount of communication required to solve a problem distributed among multiple parties. The standard quantification of one-way communication…

Quantum Physics · Physics 2024-12-25 Satyaki Manna , Anubhav Chaturvedi , Debashis Saha

Quantum mechanics allows operations to be in indefinite causal order. Recently there have been active discussions on enhanced communication strategies through exotic causal structures. In light of this, through the process matrix formalism,…

Quantum Physics · Physics 2021-04-21 Kaumudibikash Goswami , Fabio Costa

We introduce a simple model illustrating the role of context in communication and the challenge posed by uncertainty of knowledge of context. We consider a variant of distributional communication complexity where Alice gets some information…

Computational Complexity · Computer Science 2015-07-21 Badih Ghazi , Ilan Komargodski , Pravesh Kothari , Madhu Sudan

This paper focuses on compact deterministic self-stabilizing solutions for the leader election problem. When the protocol is required to be \emph{silent} (i.e., when communication content remains fixed from some point in time during any…

Distributed, Parallel, and Cluster Computing · Computer Science 2014-01-21 Lélia Blin , Sébastien Tixeuil

Communication is a major factor determining the performance of algorithms on current computing systems; it is therefore valuable to provide tight lower bounds on the communication complexity of computations. This paper presents a lower…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-11-28 Gianfranco Bilardi , Michele Scquizzato , Francesco Silvestri