English
Related papers

Related papers: Minimizing Communication for Eigenproblems and the…

200 papers

We study the problem of minimizing the sum of potentially non-differentiable convex cost functions with partially overlapping dependences in an asynchronous manner, where communication in the network is not coordinated. We study the…

Optimization and Control · Mathematics 2021-02-17 Yankai Lin , Iman Shames , Dragan Nesic

We present a new class of decentralized first-order methods for nonsmooth and stochastic optimization problems defined over multiagent networks. Considering that communication is a major bottleneck in decentralized optimization, our main…

Optimization and Control · Mathematics 2017-02-07 Guanghui Lan , Soomin Lee , Yi Zhou

Distributed learning and adaptation have received significant interest and found wide-ranging applications in machine learning and signal processing. While various approaches, such as shared-memory optimization, multi-task learning, and…

Signal Processing · Electrical Eng. & Systems 2024-12-03 Pourya Behmandpoor , Marc Moonen , Panagiotis Patrinos

We study first-order optimization algorithms under the constraint that the descent direction is quantized using a pre-specified budget of $R$-bits per dimension, where $R \in (0 ,\infty)$. We propose computationally efficient optimization…

Machine Learning · Computer Science 2022-08-17 Rajarshi Saha , Mert Pilanci , Andrea J. Goldsmith

We study the scalability of consensus-based distributed optimization algorithms by considering two questions: How many processors should we use for a given problem, and how often should they communicate when communication is not free?…

Distributed, Parallel, and Cluster Computing · Computer Science 2012-09-06 Konstantinos I. Tsianos , Sean Lawlor , Michael G. Rabbat

Graph partitioning schedules parallel calculations like sparse matrix-vector multiply (SpMV). We consider contiguous partitions, where the $m$ rows (or columns) of a sparse matrix with $N$ nonzeros are split into $K$ parts without…

Data Structures and Algorithms · Computer Science 2024-10-30 Willow Ahrens

This paper focuses on decentralized composite optimization over networks without a central coordinator. We propose a novel decentralized symmetric ADMM algorithm that incorporates multiple communication rounds within each iteration, derived…

Optimization and Control · Mathematics 2026-03-06 Jinrui Huang , Xueqin Wang , Dong Liu , Jingguo Lan , Runxiong Wu

In this paper, we revisit the communication vs. distributed computing trade-off, studied within the framework of MapReduce in [1]. An implicit assumption in the aforementioned work is that each server performs all possible computations on…

Information Theory · Computer Science 2017-05-26 Yahya H. Ezzeldin , Mohammed Karmoose , Christina Fragouli

We consider algorithmic problems in the setting in which the input data has been partitioned arbitrarily on many servers. The goal is to compute a function of all the data, and the bottleneck is the communication used by the algorithm. We…

Data Structures and Algorithms · Computer Science 2014-07-01 Ravindran Kannan , Santosh Vempala , David Woodruff

This paper develops algorithms for decentralized machine learning over a network, where data are distributed, computation is localized, and communication is restricted between neighbors. A line of recent research in this area focuses on…

Optimization and Control · Mathematics 2020-08-06 Yanli Liu , Yuejiao Sun , Wotao Yin

Recent years have witnessed a clear trend towards language models with an ever-increasing number of parameters, as well as the growing training overhead and memory usage. Distributed training, particularly through Sharded Data Parallelism…

Machine Learning · Computer Science 2024-11-26 Jinda Jia , Cong Xie , Hanlin Lu , Daoce Wang , Hao Feng , Chengming Zhang , Baixi Sun , Haibin Lin , Zhi Zhang , Xin Liu , Dingwen Tao

We consider the task of minimizing the sum of smooth and strongly convex functions stored in a decentralized manner across the nodes of a communication network whose links are allowed to change in time. We solve two fundamental problems for…

Optimization and Control · Mathematics 2021-06-09 Dmitry Kovalev , Elnur Gasanov , Peter Richtárik , Alexander Gasnikov

Primal and dual block coordinate descent methods are iterative methods for solving regularized and unregularized optimization problems. Distributed-memory parallel implementations of these methods have become popular in analyzing large…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-05-03 Aditya Devarakonda , Kimon Fountoulakis , James Demmel , Michael W. Mahoney

Federated Learning is a leading framework for training ML and AI models collaboratively across numerous user devices or databases. We study the trade-offs among estimation accuracy, privacy constraints, and communication cost for…

Machine Learning · Statistics 2026-05-19 Arnab Auddy , Xiangni Peng , Subhadeep Paul

All traditional methods of computing shortest paths depend upon edge-relaxation where the cost of reaching a vertex from a source vertex is possibly decreased if that edge is used. We introduce a method which maintains lower bounds as well…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-12-31 Vijay K. Garg

Contemporary accelerator designs exhibit a high degree of spatial localization, wherein two-dimensional physical distance determines communication costs between processing elements. This situation presents considerable algorithmic…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-08-09 Yves Baumann , Tal Ben-Nun , Maciej Besta , Lukas Gianinazzi , Torsten Hoefler , Piotr Luczynski

In this paper we study the data exchange problem where a set of users is interested in gaining access to a common file, but where each has only partial knowledge about it as side-information. Assuming that the file is broken into packets,…

Information Theory · Computer Science 2015-02-24 Nebojsa Milosavljevic , Sameer Pawar , Salim El Rouayheb , Michael Gastpar , Kannan Ramchandran

In this paper, we study the communication complexity for the problem of computing a conjunctive query on a large database in a parallel setting with $p$ servers. In contrast to previous work, where upper and lower bounds on the…

Databases · Computer Science 2016-04-08 Paul Beame , Paraschos Koutris , Dan Suciu

This thesis gives an overview of the state-of-the-art randomized linear algebra algorithms for singular value decomposition (SVD), including the presentation of existing pseudo-codes and theoretical error analysis. Our main focus is on…

Optimization and Control · Mathematics 2024-02-29 Xiaowen Li

We consider the task of minimizing the sum of convex functions stored in a decentralized manner across the nodes of a communication network. This problem is relatively well-studied in the scenario when the objective functions are smooth, or…

Optimization and Control · Mathematics 2024-05-29 Dmitry Kovalev , Ekaterina Borodich , Alexander Gasnikov , Dmitrii Feoktistov