English
Related papers

Related papers: Communication Lower Bounds and Optimal Algorithms …

200 papers

We present a new parallel model of computation suitable for spatial architectures, for which the energy used for communication heavily depends on the distance of the communicating processors. In our model, processors have locations on a…

Data Structures and Algorithms · Computer Science 2023-01-18 Lukas Gianinazzi , Tal Ben-Nun , Maciej Besta , Saleh Ashkboos , Yves Baumann , Piotr Luczynski , Torsten Hoefler

We present a method of exploiting symmetries of discrete-time optimal control problems to reduce the dimensionality of dynamic programming iterations. The results are derived for systems with continuous state variables, and can be applied…

Systems and Control · Computer Science 2018-08-30 John Maidens , Axel Barrau , Silvere Bonnabel , Murat Arcak

In the realm of Large Language Model (LLM) inference, the inherent structure of transformer models coupled with the multi-GPU tensor parallelism strategy leads to a sequential execution of computation and communication. This results in…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-09-18 Bin Xiao , Lei Su

This paper considers the problem of minimum cost communication of correlated sources over a network with multiple sinks, which consists of distributed source coding followed by routing. We introduce a new routing paradigm called dispersive…

Information Theory · Computer Science 2012-09-21 Kumar Viswanatha , Emrah Akyol , Kenneth Rose

We consider parameter estimation in distributed networks, where each sensor in the network observes an independent sample from an underlying distribution and has $k$ bits to communicate its sample to a centralized processor which computes…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-07-23 Yanjun Han , Ayfer Özgür , Tsachy Weissman

We study the fundamental limits to communication-efficient distributed methods for convex learning and optimization, under different assumptions on the information available to individual machines, and the types of functions considered. We…

Machine Learning · Computer Science 2015-10-29 Yossi Arjevani , Ohad Shamir

Topological design of terrestrial networks for communication via satellites is studied in the paper. Quantitative model of the network cost-analysis minimizing the total transmission and switching cost is described. Several algorithms…

Networking and Internet Architecture · Computer Science 2010-02-19 Boris S. Verkhovsky

Parallel computing has played an important role in speeding up convex optimization methods for big data analytics and large-scale machine learning (ML). However, the scalability of these optimization methods is inhibited by the cost of…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-12-19 Aditya Devarakonda , Kimon Fountoulakis , James Demmel , Michael W. Mahoney

We fully determine the communication complexity of approximating matrix rank, over any finite field $\mathbb{F}$. We study the most general version of this problem, where $0\leq r<R\leq n$ are given integers, Alice and Bob's inputs are…

Computational Complexity · Computer Science 2024-10-29 Alexander A. Sherstov , Andrey A. Storozhenko

In this paper we explore fundamental problems in randomized communication complexity such as computing Set Intersection on sets of size $k$ and Equality Testing between vectors of length $k$. Sa\u{g}lam and Tardos and Brody et al. showed…

Information Theory · Computer Science 2020-05-21 Dawei Huang , Seth Pettie , Yixiang Zhang , Zhijun Zhang

This thesis is concerned with the design of distributed algorithms for solving optimization problems. We consider networks where each node has exclusive access to a cost function, and design algorithms that make all nodes cooperate to find…

Optimization and Control · Mathematics 2013-12-03 João F. C. Mota

Primal and dual block coordinate descent methods are iterative methods for solving regularized and unregularized optimization problems. Distributed-memory parallel implementations of these methods have become popular in analyzing large…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-05-03 Aditya Devarakonda , Kimon Fountoulakis , James Demmel , Michael W. Mahoney

We propose fast and communication-efficient optimization algorithms for multi-robot rotation averaging and translation estimation problems that arise from collaborative simultaneous localization and mapping (SLAM), structure-from-motion…

Robotics · Computer Science 2023-08-17 Yulun Tian , Jonathan P. How

Collective communications, namely the patterns allgatherv, reduce_scatter, and allreduce in message-passing systems are optimised based on measurements at the installation time of the library. The algorithms used are set up in an…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-06-24 Andreas Jocksch , Noe Ohana , Emmanuel Lanti , Vasileios Karakasis , Laurent Villard

Reduction of communication and efficient partitioning are key issues for achieving scalability in hierarchical $N$-Body algorithms like FMM. In the present work, we propose four independent strategies to improve partitioning and reduce…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-02-20 Mustafa Abduljabbar , George Markomanolis , Huda Ibeid , Rio Yokota , David Keyes

One of the strongest techniques available for showing lower bounds on quantum communication complexity is the logarithm of the approximation rank of the communication matrix--the minimum rank of a matrix which is entrywise close to the…

Computational Complexity · Computer Science 2021-03-09 Troy Lee , Adi Shraibman

We consider the task of minimizing the sum of smooth and strongly convex functions stored in a decentralized manner across the nodes of a communication network whose links are allowed to change in time. We solve two fundamental problems for…

Optimization and Control · Mathematics 2021-06-09 Dmitry Kovalev , Elnur Gasanov , Peter Richtárik , Alexander Gasnikov

While many approaches have been proposed to analyze the problem of matrix multiplication parallel computing, few of them address the problem on heterogeneous processor platforms. It still remains an open question on heterogeneous processor…

Networking and Internet Architecture · Computer Science 2018-12-18 Yang Liu , Li Shi , Junwei Zhang , Thomas G. Robertazzi

A new class of parallel algorithms is introduced that can achieve a complexity of O(n^3/2) with respect to the interprocessor communication, in the exact computation of systems with pairwise mutual interactions of all elements. Hitherto,…

High Energy Physics - Lattice · Physics 2008-02-03 Th. Lippert , A. Seyfried , A. Bode , K. Schilling

In this paper, we revisit the communication vs. distributed computing trade-off, studied within the framework of MapReduce in [1]. An implicit assumption in the aforementioned work is that each server performs all possible computations on…

Information Theory · Computer Science 2017-05-26 Yahya H. Ezzeldin , Mohammed Karmoose , Christina Fragouli