English
Related papers

Related papers: On the Computation Rate of All-Reduce

200 papers

We propose an algorithm to maximize the instantaneous sum data rate transmitted by a base station in the downlink of a multiuser multiple-input, multiple-output system. The transmitter and the receivers may each be equipped with multiple…

Information Theory · Computer Science 2008-01-03 Adam J. Tenenbaum , Raviraj S. Adve

We investigate the achievable rate of data transmission from sources to sinks through a multiple-relay network. We study achievable rates for omniscient coding, in which all nodes are considered in the coding design at each node. We find…

Information Theory · Computer Science 2010-04-15 Lawrence Ong , Mehul Motani

We introduce several notions of reduction in distributed computing, and investigate reduction properties of two fundamental agreement tasks, namely Consensus and Atomic Commitment. We first propose the notion of reduction "a la Karp'', an…

Distributed, Parallel, and Cluster Computing · Computer Science 2007-05-23 Bernadette Charron-Bost

Coded computing is a distributed paradigm that uses coding theory to introduce \textit{redundancy} and overcome bottlenecks in large-scale systems. In the same vein, randomized numerical linear algebra employs probabilistic methods to…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-19 Neophytos Charalambides , Arya Mazumdar

We study the maximum $k$-set coverage problem in the following distributed setting. A collection of sets $S_1,\ldots,S_m$ over a universe $[n]$ is partitioned across $p$ machines and the goal is to find $k$ sets whose union covers the most…

Data Structures and Algorithms · Computer Science 2018-08-24 Sepehr Assadi , Sanjeev Khanna

Motivated by applications in machine learning and statistics, we study distributed optimization problems over a network of processors, where the goal is to optimize a global objective composed of a sum of local functions. In these problems,…

Optimization and Control · Mathematics 2019-05-14 Thinh T. Doan , Carolyn L. Beck , R. Srikant

The All-Pairs Min-Cut problem (aka All-Pairs Max-Flow) asks to compute a minimum $s$-$t$ cut (or just its value) for all pairs of vertices $s,t$. We study this problem in directed graphs with unit edge/vertex capacities (corresponding to…

This paper discusses the problem of maximizing the total data transmission utility of the computer network. The total utility is defined as the sum of the individual (corresponding to each node in the network) utilities that are concave…

Optimization and Control · Mathematics 2022-01-31 Dmitry Pasechnyuk

The problem of maximum rate achievable with analog network coding for a unicast communication over a layered relay network with directed links is considered. A relay node performing analog network coding scales and forwards the signals…

Information Theory · Computer Science 2012-04-24 Samar Agnihotri , Sidharth Jaggi , Minghua Chen

A major concern in cloud/edge storage systems is serving a large number of users simultaneously. The service rate region is introduced recently as an important performance metric for coded distributed systems, which is defined as the set of…

Information Theory · Computer Science 2020-10-27 Fatemeh Kazemi , Sascha Kurz , Emina Soljanin , Alex Sprintson

Coded computation is a framework which provides redundancy in distributed computing systems to speed up largescale tasks. Although most existing works assume an error-free scenarios in a master-worker setup, the link failures are common in…

Information Theory · Computer Science 2019-01-14 Dong-Jun Han , Jy-yong Sohn , Jaekyun Moon

Reduction operations are extensively employed in many computational problems. A reduction consists of, given a finite set of numeric elements, combining into a single value all elements in that set, using for this a combiner function. A…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-10-23 Walid Jradi , Hugo do Nascimento , Wellington Martins

The theme of this paper is how to find all instances of a given "sample" graph in a larger "data graph," using a single round of map-reduce. For the simplest sample graph, the triangle, we improve upon the best known such algorithm. We then…

Distributed, Parallel, and Cluster Computing · Computer Science 2012-11-22 Foto N. Afrati , Dimitris Fotakis , Jeffrey D. Ullman

In social network analysis, the size of the k-core, i.e., the maximal induced subgraph of the network with minimum degree at least k, is frequently adopted as a typical metric to evaluate the cohesiveness of a community. We address the…

Optimization and Control · Mathematics 2023-05-03 Martina Cerulli , Domenico Serra , Carmine Sorgente , Claudia Archetti , Ivana Ljubic

We present a strongly polynomial-time algorithm to generate bandwidth optimal allgather/reduce-scatter on any network topology, with or without switches. Our algorithm constructs pipeline schedules achieving provably the best possible…

Networking and Internet Architecture · Computer Science 2023-06-02 Liangyu Zhao , Arvind Krishnamurthy

The problem of designing policies for in-network function computation with minimum energy consumption subject to a latency constraint is considered. The scaling behavior of the energy consumption under the latency constraint is analyzed for…

Networking and Internet Architecture · Computer Science 2016-11-17 Paul Balister , Béla Bollobás , Animashree Anandkumar , Alan Willsky

Due to the large size of wireless networks, it is often impractical for nodes to track changes in the complete network state. As a result, nodes have to make distributed decisions about their transmission and reception parameters based on…

Information Theory · Computer Science 2014-07-15 Vaneet Aggarwal , Youjian Liu , Ashutosh Sabharwal

In this paper, we study the problem of delay minimization in NFV-based networks. In such systems, the ultimate goal of any request is to compute a sequence of functions in the network, where each function can be computed at only a specific…

Information Theory · Computer Science 2018-09-12 Behrooz Tahmasebi , Mohammad Ali Maddah-Ali , Saeedeh Parsaeefard , Babak Hossein Khalaj

We consider in-network computation of an arbitrary function over an arbitrary communication network. A network with capacity constraints on the links is given. Some nodes in the network generate data, e.g., like sensor nodes in a sensor…

Networking and Internet Architecture · Computer Science 2010-10-01 Virag Shah , Bikash Kumar Dey , D. Manjunath

The Bandwidth Problem seeks for a simultaneous permutation of the rows and columns of the adjacency matrix of a graph such that all nonzero entries are as close as possible to the main diagonal. This work focuses on investigating novel…

Optimization and Control · Mathematics 2021-07-07 Franz Rendl , Renata Sotirov , Christian Truden