English
Related papers

Related papers: Optimised allgatherv, reduce_scatter and allreduce…

200 papers

We consider distributed optimization by a collection of nodes, each having access to its own convex function, whose collective goal is to minimize the sum of the functions. The communications between nodes are described by a time-varying…

Optimization and Control · Mathematics 2014-03-18 Angelia Nedic , Alex Olshevsky

Large data sets often require performing distributed statistical estimation, with a full data set split across multiple machines and limited communication between machines. To study such scenarios, we define and study some refinements of…

Information Theory · Computer Science 2014-06-24 John C. Duchi , Michael I. Jordan , Martin J. Wainwright , Yuchen Zhang

Variational inequalities are a broad and flexible class of problems that includes minimization, saddle point, and fixed point problems as special cases. Therefore, variational inequalities are used in various applications ranging from…

Optimization and Control · Mathematics 2024-04-02 Aleksandr Beznosikov , Martin Takáč , Alexander Gasnikov

While backscatter communication emerges as a promising solution to reduce power consumption at IoT devices, the transmission range of backscatter communication is short. To this end, this work integrates unmanned ground vehicles (UGVs) into…

Information Theory · Computer Science 2019-02-27 Shuai Wang , Minghua Xia , Yik-Chung Wu

Modern machine learning tasks often involve massive datasets and models, necessitating distributed optimization algorithms with reduced communication overhead. Communication compression, where clients transmit compressed updates to a…

Optimization and Control · Mathematics 2025-04-01 Yuan Gao , Anton Rodomanov , Jeremy Rack , Sebastian U. Stich

We propose an efficient algorithm for solving group synchronization under high levels of corruption and noise, while we focus on rotation synchronization. We first describe our recent theoretically guaranteed message passing algorithm that…

Computer Vision and Pattern Recognition · Computer Science 2021-10-11 Yunpeng Shi , Gilad Lerman

Data movement is the dominating factor affecting performance and energy in modern computing systems. Consequently, many algorithms have been developed to minimize the number of I/O operations for common computing patterns. Matrix…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-01-26 Johannes de Fine Licht , Grzegorz Kwasniewski , Torsten Hoefler

In recent work, Ozgur, Leveque, and Tse (2007) obtained a complete scaling characterization of throughput scaling for random extended wireless networks (i.e., $n$ nodes are placed uniformly at random in a square region of area $n$). They…

Information Theory · Computer Science 2016-11-17 Urs Niesen , Piyush Gupta , Devavrat Shah

We study the distributed optimization of transmit strategies in a multiple-input, single-output (MISO) interference channel (IFC). Existing distributed algorithms rely on stricly synchronized update steps by the individual users. They…

Information Theory · Computer Science 2015-06-19 Stefan Wesemann , Gerhard Fettweis

MPI uses the concept of communicators to connect groups of processes. It provides nonblocking collective operations on communicators to overlap communication and computation. Flexible algorithms demand flexible communicators. E.g., a…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-03-02 Michael Axtmann , Armin Wiebigke , Peter Sanders

In this paper we present novel algorithmic solutions for several resource processing and data transfer multicriteria optimization problems. The results of most of the presented techniques are strategies which solve the considered problems…

Data Structures and Algorithms · Computer Science 2010-06-28 Mugurel Ionut Andreica , Nicolae Tapus

This paper presents a distributed optimization scheme over a network of agents in the presence of cost uncertainties and over switching communication topologies. Inspired by recent advances in distributed convex optimization, we propose a…

Optimization and Control · Mathematics 2016-11-15 Saghar Hosseini , Airlie Chapman , Mehran Mesbahi

We study distribution testing with communication and memory constraints in the following computational models: (1) The {\em one-pass streaming model} where the goal is to minimize the sample complexity of the protocol subject to a memory…

Machine Learning · Computer Science 2019-06-12 Ilias Diakonikolas , Themis Gouleakis , Daniel M. Kane , Sankeerth Rao

The training of large models demands substantial computational resources, typically available only in data centers with high-bandwidth interconnects. However, reducing the reliance on high-bandwidth interconnects between nodes enables the…

Machine Learning · Computer Science 2025-10-07 Sasho Nedelkoski , Alexander Acker , Odej Kao , Soeren Becker , Dominik Scheinert

This paper is concerned with the distributed composite optimization problem over networks, where agents aim to minimize a sum of local smooth components and a common nonsmooth term. Leveraging the probabilistic local updates mechanism, we…

Optimization and Control · Mathematics 2026-02-19 Luyao Guo , Xinli Shi , Wenying Xu , Jinde Cao

In this paper, we devise a scheduling algorithm for ordering transmission of synchrophasor data from the substation to the control center in as short a time frame as possible, within the realtime hierarchical communications infrastructure…

Information Theory · Computer Science 2015-11-03 K. G. Nagananda , P. P. Khargonekar

We introduce a new and increasingly relevant setting for distributed optimization in machine learning, where the data defining the optimization are unevenly distributed over an extremely large number of nodes. The goal is to train a…

Machine Learning · Computer Science 2016-10-11 Jakub Konečný , H. Brendan McMahan , Daniel Ramage , Peter Richtárik

On many parallel machines, the time LQCD applications spent in communication is a significant contribution to the total wall-clock time, especially in the strong-scaling limit. We present a novel high-performance communication library that…

High Energy Physics - Lattice · Physics 2017-01-31 Peter Georg , Daniel Richtmann , Tilo Wettig

Although recent works try to improve collective communication in grid systems by separating intra and inter-cluster communication, the optimisation of communications focus only on inter-cluster communications. We believe, instead, that the…

Distributed, Parallel, and Cluster Computing · Computer Science 2007-05-23 Luiz Angelo Barchet-Estefanel , Gregory Mounie

The distributed optimization problem has become increasingly relevant recently. It has a lot of advantages such as processing a large amount of data in less time compared to non-distributed methods. However, most distributed approaches…

Optimization and Control · Mathematics 2024-03-27 Daniil Medyakov , Gleb Molodtsov , Aleksandr Beznosikov , Alexander Gasnikov