English
Related papers

Related papers: On the Computation Rate of All-Reduce

200 papers

Deep neural networks have been applied in many applications exhibiting extraordinary abilities in the field of computer vision. However, complex network architectures challenge efficient real-time deployment and require significant…

Computer Vision and Pattern Recognition · Computer Science 2021-06-16 Tailin Liang , John Glossner , Lei Wang , Shaobo Shi , Xiaotong Zhang

The allreduce collective operation accounts for a significant fraction of the runtime of workloads running on distributed systems. One factor determining its performance is the distance between communicating nodes, especially on networks…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-03-06 Daniele De Sensi , Tommaso Bonato , David Saam , Torsten Hoefler

According to Kolmogorov complexity, every finite binary string is compressible to a shortest code -- its information content -- from which it is effectively recoverable. We investigate the extent to which this holds for infinite binary…

Information Theory · Computer Science 2019-01-23 George Barmpalias , Andrew Lewis-Pye

Computationally intensive decoding procedures--including search, reranking, and self-critique--can improve the quality of language model (LM) outputs in problems spanning code generation, numerical reasoning, and dialog. Existing work…

Machine Learning · Computer Science 2024-10-08 Mehul Damani , Idan Shenfeld , Andi Peng , Andreea Bobu , Jacob Andreas

Improving throughput for cell-edge users through coordinated resource allocation has been a long-standing driver of research in wireless cellular networks. While a variety of wireless resource management problems focus on sum utility,…

Information Theory · Computer Science 2024-03-26 Ahmad Ali Khan , Raviraj Adve

The biggest cost of computing with large matrices in any modern computer is related to memory latency and bandwidth. The average latency of modern RAM reads is 150 times greater than a clock step of the processor. Throughput is a little…

Data Structures and Algorithms · Computer Science 2013-03-04 Crysttian Arantes Paixão , Flávio Codeço Coelho

Biclustering, also called co-clustering, block clustering, or two-way clustering, involves the simultaneous clustering of both the rows and columns of a data matrix into distinct groups, such that the rows and columns within a group display…

Optimization and Control · Mathematics 2024-12-06 Antonio M. Sudoso

Deep Neural Networks have achieved remarkable success relying on the developing availability of GPUs and large-scale datasets with increasing network depth and width. However, due to the expensive computation and intensive memory,…

Machine Learning · Computer Science 2020-09-07 E Zhenqian , Gao Weiguo

This paper focuses on managing the cost of deliberation before action. In many problems, the overall quality of the solution reflects costs incurred and resources consumed in deliberation as well as the cost and benefit of execution, when…

Artificial Intelligence · Computer Science 2013-04-05 David Einav , Michael R. Fehling

We consider a distributed stochastic optimization problem in networks with finite number of nodes. Each node adjusts its action to optimize the global utility of the network, which is defined as the sum of local utilities of all nodes.…

Information Theory · Computer Science 2018-07-31 Wenjie Li , Mohamad Assaad

The existence of considerable amount of redundancy in the Internet traffic at the packet level has stimulated the deployment of packet-level redundancy elimination techniques within the network by enabling network nodes to memorize data…

Networking and Internet Architecture · Computer Science 2014-11-25 Ahmad Beirami , Mohsen Sardari , Faramarz Fekri

We consider the coordinated downlink beamforming problem in a cellular network with the base stations (BSs) equipped with multiple antennas, and with each user equipped with a single antenna. The BSs cooperate in sharing their local…

Information Theory · Computer Science 2011-11-29 Mingyi Hong , Alfredo Garcia , J. Joaquin Escudero Garzas , Ana Garcia-Armada

Random linear network code has to sacrifice part of bandwidth to transfer the coding vectors, thus a head of size k log|T| is appended to each packet. We present a distributed random network coding approach based on the Chinese remainder…

Information Theory · Computer Science 2012-08-21 Zhifang Zhang

Closeness is a widely-studied centrality measure. Since it requires all pairwise distances, computing closeness for all nodes is infeasible for large real-world networks. However, for many applications, it is only necessary to find the k…

Data Structures and Algorithms · Computer Science 2017-10-04 Patrick Bisenius , Elisabetta Bergamini , Eugenio Angriman , Henning Meyerhenke

Diffusion on complex networks is often modeled as a stochastic process. Yet, recent work on strategic diffusion emphasizes the decision power of agents and treats diffusion as a strategic problem. Here we study the computational aspects of…

Computational Complexity · Computer Science 2020-01-31 Marcin Waniek , Khaled Elbassioni , Flavio L. Pinheiro , Cesar A. Hidalgo , Aamena Alshamsi

The goal of decentralized optimization over a network is to optimize a global objective formed by a sum of local (possibly nonsmooth) convex functions using only local computation and communication. It arises in various application domains,…

Optimization and Control · Mathematics 2015-03-17 John Duchi , Alekh Agarwal , Martin Wainwright

The multi-user linearly-separable distributed computing problem is considered here, in which $N$ servers help to compute the real-valued functions requested by $K$ users, where each function can be written as a linear combination of up to…

Information Theory · Computer Science 2023-01-10 Ali Khalesi , Sajad Daei , Marios Kountouris , Petros Elia

Consider a multi-cell mobile edge computing network, in which each user wishes to compute the product of a user-generated data matrix with a network-stored matrix. This is done through task offloading by means of input uploading,…

Information Theory · Computer Science 2021-01-19 Kuikui Li , Meixia Tao , Jingjing Zhang , Osvaldo Simeone

In distributed optimization and machine learning, multiple nodes coordinate to solve large problems. To do this, the nodes need to compress important algorithm information to bits so that it can be communicated over a digital channel. The…

Optimization and Control · Mathematics 2020-12-02 Sindri Magnússon , Hossein Shokri-Ghadikolaei , Na Li

We present an achievable rate for general deterministic relay networks, with broadcasting at the transmitters and interference at the receivers. In particular we show that if the optimizing distribution for the information-theoretic cut-set…

Information Theory · Computer Science 2007-10-24 A. S. Avestimehr , S. N. Diggavi , D. N. C. Tse