English
Related papers

Related papers: On the Computation Rate of All-Reduce

200 papers

This paper aims to implement and evaluate the performance of quantum computing on solving combinatorial optimization problems arising from the operations of the power grid. To this end, we construct a novel mixed integer conic programming…

Systems and Control · Electrical Eng. & Systems 2022-08-17 Phuong Ngo , Christan Thomas , Hieu Nguyen , Abdullah Eroglu , Konstantinos Oikonomou

Consider a receiver in a multi-user network that wishes to decode several messages. Simultaneous joint typicality decoding is one of the most powerful techniques for determining the fundamental limits at which reliable decoding is possible.…

Information Theory · Computer Science 2019-01-11 Sung Hoon Lim , Chen Feng , Adriano Pastore , Bobak Nazer , Michael Gastpar

Cutwidth is one of the classic layout parameters for graphs. It measures how well one can order the vertices of a graph in a linear manner, so that the maximum number of edges between any prefix and its complement suffix is minimized. As…

Data Structures and Algorithms · Computer Science 2017-02-16 Archontia C. Giannopoulou , Michał Pilipczuk , Jean-Florent Raymond , Dimitrios M. Thilikos , Marcin Wrochna

Finding gradients is a crucial step in training machine learning models. For quantum neural networks, computing gradients using the parameter-shift rule requires calculating the cost function twice for each adjustable parameter in the…

Quantum Physics · Physics 2025-01-31 Guang Ping He

Distributed computing frameworks such as MapReduce and Spark are often used to process large-scale data computing jobs. In wireless scenarios, exchanging data among distributed nodes would seriously suffer from the communication bottleneck…

Information Theory · Computer Science 2023-10-25 Youlong Wu , Zhenhao Huang , Kai Yuan , Shuai Ma , Yue Bi

We investigate robust linear consensus over networks under capacity-constrained communication. The capacity of each edge is encoded as an upper bound on the number of state variables that can be communicated instantaneously. When the edge…

Systems and Control · Electrical Eng. & Systems 2021-05-25 Yasin Yazicioglu , Alberto Speranzon

We approach index coding as a special case of rate-distortion with multiple receivers, each with some side information about the source. Specifically, using techniques developed for the rate-distortion problem, we provide two upper bounds…

Information Theory · Computer Science 2015-07-28 Sinem Unal , Aaron B. Wagner

We optimize multiway equijoins on relational tables using degree information. We give a new bound that uses degree information to more tightly bound the maximum output size of a query. On real data, our bound on the number of triangles in a…

Databases · Computer Science 2015-12-23 Manas Joglekar , Christopher Re

We address the problem of efficiently gathering correlated data from a wired or a wireless sensor network, with the aim of designing algorithms with provable optimality guarantees, and understanding how close we can get to the known…

Networking and Internet Architecture · Computer Science 2009-08-03 Jian Li , Amol Deshpande , Samir Khuller

Distributed abstract programs are a novel class of distributed optimization problems where (i) the number of variables is much smaller than the number of constraints and (ii) each constraint is associated to a network node. Abstract…

Distributed, Parallel, and Cluster Computing · Computer Science 2009-11-02 Giuseppe Notarstefano , Francesco Bullo

The problem of network function computation over a directed acyclic network is investigated in this paper. In such a network, a sink node desires to compute with zero error a {\em target function}, of which the inputs are generated at…

Information Theory · Computer Science 2017-10-09 Xuan Guang , Raymond W. Yeung , Shenghao Yang , Congduan Li

A unit cube in $k$ dimensional space (or \emph{$k$-cube} in short) is defined as the Cartesian product $R_1\times R_2\times...\times R_k$ where $R_i$(for $1\leq i\leq k$) is a closed interval of the form $[a_i,a_i+1]$ on the real line. A…

Discrete Mathematics · Computer Science 2008-03-26 L. Sunil Chandran , Mathew C. Francis , Naveen Sivadasan

We study common randomness generation problems where $n$ players aim to generate same sequences of random coin flips where some subsets of the players share an independent common coin which can be tossed multiple times, and there is a…

Information Theory · Computer Science 2023-12-08 Yanjun Han , Kedar Tatwawadi , Gowtham R. Kurri , Zhengqing Zhou , Vinod M. Prabhakaran , Tsachy Weissman

The capacity of line networks with buffer size constraints is an open, but practically important problem. In this paper, the upper bound on the achievable rate of a class of codes, called batched codes, is studied for line networks. Batched…

Information Theory · Computer Science 2022-05-06 Shenghao Yang , Jie Wang

Network Calculus (NC) is a versatile analytical methodology to efficiently compute performance bounds in networked systems. The arrival and service curve abstractions allow to model diverse and heterogeneous distributed systems. The…

Networking and Internet Architecture · Computer Science 2024-03-28 Anja Hamscher , Vlad-Cristian Constantin , Jens B. Schmitt

We consider the problem of distributed lossy linear function computation in a tree network. We examine two cases: (i) data aggregation (only one sink node computes) and (ii) consensus (all nodes compute the same function). By quantifying…

Information Theory · Computer Science 2017-01-16 Yaoqing Yang , Pulkit Grover , Soummya Kar

Round-based models are very common message-passing models; combinatorial topology applied to distributed computing provides sweeping results like general lower bounds. We combine both to study the computability of k-set agreement. Among all…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-06-15 Adam Shimi , Armando Castañeda

In standard number-in-hand multi-party communication complexity, performance is measured as the total number of bits transmitted globally in the network. In this paper, we study a variation called local communication complexity in which…

Data Structures and Algorithms · Computer Science 2021-11-24 Bala Kalyanasundaram , Calvin Newport

In this paper we propose and prove that cyclic quorum sets can efficiently manage all-pairs computations and data replication. The quorums are O(N/sqrt(P)) in size, up to 50% smaller than the dual N/sqrt(P) array implementations, and…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-08-19 Cory J. Kleinheksel , Arun K. Somani

By considering quantum computation as a communication process, we relate its efficiency to a communication capacity. This formalism allows us to rederive lower bounds on the complexity of search algorithms. It also enables us to link the…

Quantum Physics · Physics 2009-11-06 S. Bose , L. Rallan , V. Vedral