English
Related papers

Related papers: Lower bounds for distributed markov chain problems

200 papers

Standard algorithms for finding the shortest path in a graph require that the cost of a path be additive in edge costs, and typically assume that costs are deterministic. We consider the problem of uncertain edge costs, with potential…

Artificial Intelligence · Computer Science 2013-02-21 Michael P. Wellman , Matthew Ford , Kenneth Larson

We investigate the randomized and quantum communication complexity of the Hamming Distance problem, which is to determine if the Hamming distance between two n-bit strings is no less than a threshold d. We prove a quantum lower bound of…

Quantum Physics · Physics 2011-11-04 Wei Huang , Yaoyun Shi , Shengyu Zhang , Yufan Zhu

Fast distributed algorithms that output a feasible solution for constraint satisfaction problems, such as maximal independent sets, have been heavily studied. There has been much less research on distributed sampling problems, where one…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-03-07 Sriram V. Pemmaraju , Joshua Z. Sobel

We resolve the min-max complexity of distributed stochastic convex optimization (up to a log factor) in the intermittent communication setting, where $M$ machines work in parallel over the course of $R$ rounds of communication to optimize…

Machine Learning · Computer Science 2021-08-06 Blake Woodworth , Brian Bullins , Ohad Shamir , Nathan Srebro

Empirically, the PAC-Bayesian analysis is known to produce tight risk bounds for practical machine learning algorithms. However, in its naive form, it can only deal with stochastic predictors while such predictors are rarely used and…

Machine Learning · Statistics 2019-11-22 Kohei Miyaguchi

We explore a simple mathematical model of network computation, based on Markov chains. Similar models apply to a broad range of computational phenomena, arising in networks of computers, as well as in genetic, and neural nets, in social…

Information Retrieval · Computer Science 2009-04-18 Dusko Pavlovic

We resolve the fundamental problem of online decoding with general $n^{th}$ order ergodic Markov chain models. Specifically, we provide deterministic and randomized algorithms whose performance is close to that of the optimal offline…

Machine Learning · Computer Science 2019-05-31 Vikas K. Garg , Tamar Pichkhadze

Consider the classical problem of information dissemination: one (or more) nodes in a network have some information that they want to distribute to the remainder of the network. In this paper, we study the cost of information dissemination…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-12-03 Suman Sourav , Peter Robinson , Seth Gilbert

The dynamic shortest paths problem on planar graphs asks us to preprocess a planar graph $G$ such that we may support insertions and deletions of edges in $G$ as well as distance queries between any two nodes $u,v$ subject to the constraint…

Data Structures and Algorithms · Computer Science 2016-05-13 Amir Abboud , Søren Dahlgaard

Performing random walks in networks is a fundamental primitive that has found applications in many areas of computer science, including distributed computing. In this paper, we focus on the problem of sampling random walks efficiently in a…

Distributed, Parallel, and Cluster Computing · Computer Science 2013-02-20 Atish Das Sarma , Danupon Nanongkai , Gopal Pandurangan , Prasad Tetali

We address the problem of distributed convex unconstrained optimization over networks characterized by asynchronous and possibly lossy communications. We analyze the case where the global cost function is the sum of locally coupled local…

Optimization and Control · Mathematics 2020-10-06 Marco Todescato , Nicoletta Bof , Guido Cavraro , Ruggero Carli , Luca Schenato

We consider the communication complexity of a number of distributed optimization problems. We start with the problem of solving a linear system. Suppose there is a coordinator together with $s$ servers $P_1, \ldots, P_s$, the $i$-th of…

Data Structures and Algorithms · Computer Science 2019-11-01 Santosh S. Vempala , Ruosong Wang , David P. Woodruff

We characterize the communication complexity of the following distributed estimation problem. Alice and Bob observe infinitely many iid copies of $\rho$-correlated unit-variance (Gaussian or $\pm1$ binary) random variables, with unknown…

Information Theory · Computer Science 2019-04-19 Uri Hadar , Jingbo Liu , Yury Polyanskiy , Ofer Shayevitz

We consider locally checkable labeling LCL problems in the LOCAL model of distributed computing. Since 2016, there has been a substantial body of work examining the possible complexities of LCL problems. For example, it has been established…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-11-14 Yi-Jun Chang

In this paper, we propose a distributed algorithm for the minimum dominating set problem. For some especial networks, we prove theoretically that the achieved answer by our proposed algorithm is a constant approximation factor of the exact…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-01-05 Sharareh Alipour , Ehsan Futuhi , Shayan Karimi

We provide a general framework for computing upper bounds on mixing times of finite Markov chains when its minimal ideal is left zero. Our analysis is based on combining results by Brown and Diaconis with our previous work on stationary…

Probability · Mathematics 2023-01-04 John Rhodes , Anne Schilling

In this paper, we study the communication and (sub)gradient computation costs in distributed optimization and give a sharp complexity analysis for the proposed distributed accelerated gradient methods. We present two algorithms based on the…

Optimization and Control · Mathematics 2020-08-19 Huan Li , Cong Fang , Wotao Yin , Zhouchen Lin

We study the tradeoff between the statistical error and communication cost of distributed statistical estimation problems in high dimensions. In the distributed sparse Gaussian mean estimation problem, each of the $m$ machines receives $n$…

Machine Learning · Computer Science 2016-05-11 Mark Braverman , Ankit Garg , Tengyu Ma , Huy L. Nguyen , David P. Woodruff

Population protocols are a fundamental model in distributed computing, where many nodes with bounded memory and computational power have random pairwise interactions over time. This model has been studied in a rich body of literature aiming…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-01-05 Simina Branzei , Yuval Peres

We consider the distributed version of the Multiple Knapsack Problem (MKP), where $m$ items are to be distributed amongst $n$ processors, each with a knapsack. We propose different distributed approximation algorithms with a tradeoff…

Data Structures and Algorithms · Computer Science 2017-02-06 Ananth Murthy , Chandan Yeshwanth , Shrisha Rao