English
Related papers

Related papers: Rectangle Size Bounds and Threshold Covers in Comm…

200 papers

The communication complexity of many fundamental problems reduces greatly when the communicating parties share randomness that is independent of the inputs to the communication task. Natural communication processes (say between humans)…

Computational Complexity · Computer Science 2024-01-24 Clément L. Canonne , Venkatesan Guruswami , Raghu Meka , Madhu Sudan

We prove new bounds on the quantum communication complexity of the disjointness and equality problems. For the case of exact and non-deterministic protocols we show that these complexities are all equal to n+1, the previous best lower bound…

Quantum Physics · Physics 2017-01-03 Peter Hoyer , Ronald de Wolf

We study the fundamental limits to communication-efficient distributed methods for convex learning and optimization, under different assumptions on the information available to individual machines, and the types of functions considered. We…

Machine Learning · Computer Science 2015-10-29 Yossi Arjevani , Ohad Shamir

We study the message complexity of leader election in synchronous networks of diameter two. Our main contribution is a refined analysis of the randomized algorithm proposed by Chatterjee et al. [DC, 2020]. In their work, the authors…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-04-21 Abhijit Sadhukhan , Adri Bhattacharya , Anisur Rahaman Molla

In the study of extensions of polytopes of combinatorial optimization problems, a notorious open question is that for the size of the smallest extended formulation of the Minimum Spanning Tree problem on a complete graph with $n$ nodes. The…

Discrete Mathematics · Computer Science 2017-02-07 Kaveh Khoshkhah , Dirk Oliver Theis

Decentralized optimization methods enable on-device training of machine learning models without a central coordinator. In many scenarios communication between devices is energy demanding and time consuming and forms the bottleneck of the…

Optimization and Control · Mathematics 2020-11-04 Dmitry Kovalev , Anastasia Koloskova , Martin Jaggi , Peter Richtarik , Sebastian U. Stich

In this thesis, I study the minimax oracle complexity of distributed stochastic optimization. First, I present the "graph oracle model", an extension of the classic oracle complexity framework that can be applied to study distributed…

Optimization and Control · Mathematics 2021-09-03 Blake Woodworth

We show that disjointness requires randomized communication Omega(n^{1/(k+1)}/2^{2^k}) in the general k-party number-on-the-forehead model of complexity. The previous best lower bound for k >= 3 was log(n)/(k-1). Our results give a…

Computational Complexity · Computer Science 2009-06-09 Troy Lee , Adi Shraibman

We consider the communication complexity of a number of distributed optimization problems. We start with the problem of solving a linear system. Suppose there is a coordinator together with $s$ servers $P_1, \ldots, P_s$, the $i$-th of…

Data Structures and Algorithms · Computer Science 2019-11-01 Santosh S. Vempala , Ruosong Wang , David P. Woodruff

Communication complexity is a fundamental aspect of information science, concerned with the amount of communication required to solve a problem distributed among multiple parties. The standard quantification of one-way communication…

Quantum Physics · Physics 2024-12-25 Satyaki Manna , Anubhav Chaturvedi , Debashis Saha

Given a correlation generated by a (possibly quantum) communication network, we study the amount of shared randomness required to generate it. We develop a novel upper bound for approximating distributions generated by arbitrary networks…

Quantum Physics · Physics 2026-03-16 Yukari Uchibori , Alice Zheng , Anurag Anshu , Jamie Sikora

In this work we start the investigation of tight complexity bounds for connectivity problems parameterized by cutwidth assuming the Strong Exponential-Time Hypothesis (SETH). Van Geffen et al. posed this question for odd cycle transversal…

Data Structures and Algorithms · Computer Science 2022-12-26 Narek Bojikian , Vera Chekan , Falko Hegerfeld , Stefan Kratsch

We investigate distributed online convex optimization with compressed communication, where $n$ learners connected by a network collaboratively minimize a sequence of global loss functions using only local information and compressed data…

Machine Learning · Computer Science 2026-01-12 Sifan Yang , Wenhao Yang , Wei Jiang , Lijun Zhang

We prove a \emph{query complexity} lower bound on rank-one principal component analysis (PCA). We consider an oracle model where, given a symmetric matrix $M \in \mathbb{R}^{d \times d}$, an algorithm is allowed to make $T$ \emph{exact}…

Machine Learning · Computer Science 2017-04-18 Max Simchowitz , Ahmed El Alaoui , Benjamin Recht

We study distributed optimization algorithms for minimizing the average of convex functions. The applications include empirical risk minimization problems in statistical machine learning where the datasets are large and have to be stored on…

Optimization and Control · Mathematics 2016-01-07 Jason D. Lee , Qihang Lin , Tengyu Ma , Tianbao Yang

Sketching is widely used in randomized linear algebra for low-rank matrix approximation, column subset selection, and many other problems, and it has gained significant traction in machine learning applications. However, sketching large…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-03-24 Hussam Al Daas , Grey Ballard , Laura Grigori , Md Taufique Hussain , Suraj Kumar , Mohammad Marufur Rahman , Kathryn Rouse

We explore multi-round quantum memoryless communication protocols. These are restricted version of multi-round quantum communication protocols. The "memoryless" term means that players forget history from previous rounds, and their behavior…

Computational Complexity · Computer Science 2017-10-05 Farid Ablayev , Andris Ambainis , Kamil Khadiev , AliyaKhadieva

We present an information-theoretic approach to lower bound the oracle complexity of nonsmooth black box convex optimization, unifying previous lower bounding techniques by identifying a combinatorial problem, namely string guessing, as a…

Optimization and Control · Mathematics 2023-07-10 Gábor Braun , Cristóbal Guzmán , Sebastian Pokutta

We present an algorithm based on posterior sampling (aka Thompson sampling) that achieves near-optimal worst-case regret bounds when the underlying Markov Decision Process (MDP) is communicating with a finite, though unknown, diameter. Our…

Machine Learning · Computer Science 2020-04-01 Shipra Agrawal , Randy Jia

We consider the LOCAL model of distributed computing, where in a single round of communication each node can send to each of its neighbors a message of an arbitrary size. It is know that, classically, the round complexity of 3-coloring an…

Quantum Physics · Physics 2022-12-07 François Le Gall , Ansis Rosmanis