English
Related papers

Related papers: OpTree: An Efficient Algorithm for All-gather Oper…

200 papers

All-to-All communication is a key performance bottleneck for distributed machine learning (ML) and high-performance computing (HPC) workloads, where dense traffic increasingly stresses scale-up interconnects. While these ML and HPC…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-27 Anton Juerss , Stefan Schmid

In this work, a heterogeneous set of wireless devices sharing a common access point collaborates to perform a set of tasks. Using the Map-Reduce distributed computing framework, the tasks are optimally distributed amongst the nodes with the…

Signal Processing · Electrical Eng. & Systems 2019-03-07 Antoine Paris , Hamed Mirghasemi , Ivan Stupia , Luc Vandendorpe

Collective algorithms are an essential part of MPI, allowing application programmers to utilize underlying optimizations of common distributed operations. The MPI_Allgather gathers data, which is originally distributed across all processes,…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-08-25 Amanda Bienz , Shreeman Gautam , Amun Kharel

In this paper we consider several problems concerning packet routing in distributed systems. Each problem is formulated using terms from Graph Theory and for each problem we present efficient, novel, algorithmic techniques for computing…

Data Structures and Algorithms · Computer Science 2009-06-19 Mugurel Ionut Andreica , Nicolae Tapus

The \texttt{MPI\_Allreduce} collective operation is a core kernel of many parallel codebases, particularly for reductions over a single value per process. The commonly used allreduce recursive-doubling algorithm obtains the lower bound…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-10-23 Amanda Bienz , Luke N. Olson , William D. Gropp

We introduce a data distribution scheme for $\mathcal{H}$-matrices and a distributed-memory algorithm for $\mathcal{H}$-matrix-vector multiplication. Our data distribution scheme avoids an expensive $\Omega(P^2)$ scheduling procedure used…

Numerical Analysis · Mathematics 2020-09-23 Yingzhou Li , Jack Poulson , Lexing Ying

This paper considers the distributed learning problem where a group of agents cooperatively minimizes the summation of their local cost functions based on peer-to-peer communication. Particularly, we propose a highly efficient algorithm,…

Optimization and Control · Mathematics 2024-11-22 Runze You , Shi Pu

Emerging reconfigurable optical communication technologies allow to enhance datacenter topologies with demand-aware links optimized towards traffic patterns. This paper studies the algorithmic problem of jointly optimizing topology and…

Performance · Computer Science 2024-01-10 Wenkai Dai , Michael Dinitz , Klaus-Tycho Foerster , Long Luo , Stefan Schmid

We present new, simple, fully distributed, practical algorithms with linear time communication cost for irregular gather and scatter operations in which processors contribute or consume possibly different amounts of data. In a linear cost…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-04-13 Jesper Larsson Träff

Trees are useful entities allowing to model data structures and hierarchical relationships in networked decision systems ubiquitously. An ordered tree is a rooted tree where the order of the subtrees (children) of a node is significant. In…

Data Structures and Algorithms · Computer Science 2020-11-10 Victor Parque , Tomoyuki Miyashita

AllReduce is an important and popular collective communication primitive, which has been widely used in areas such as distributed machine learning and high performance computing. To design, analyze, and choose from various algorithms and…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-09-09 Dian Xiong , Li Chen , Youhe Jiang , Dan Li , Shuai Wang , Songtao Wang

We give offline algorithms for processing a sequence of $2$ and $3$ edge and vertex connectivity queries in a fully-dynamic undirected graph. While the current best fully-dynamic online data structures for $3$-edge and $3$-vertex…

Data Structures and Algorithms · Computer Science 2019-03-22 Richard Peng , Bryce Sandlund , Daniel D. Sleator

Worst-case optimal join algorithms have gained a lot of attention in the database literature. We now count with several algorithms that are optimal in the worst case, and many of them have been implemented and validated in practice.…

Databases · Computer Science 2020-01-10 Gonzalo Navarro , Juan L. Reutter , Javiel Rojas-Ledesma

The collection of all the strongly connected components in a directed graph, among each cluster of which any node has a path to another node, is a typical example of the intertwining structure and dynamics in complex networks, as its…

Physics and Society · Physics 2016-05-31 Jin-Hua Zhao , Hai-Jun Zhou

Demand-aware communication networks are networks whose topology is optimized toward the traffic they need to serve. These networks have recently been enabled by novel optical communication technologies and are investigated intensively in…

Networking and Internet Architecture · Computer Science 2024-03-07 Maxim Buzdalov , Pavel Martynov , Sergey Pankratov , Vitaly Aksenov , Stefan Schmid

We show that the problem of constructing tree-structured descriptions of data layouts that are optimal with respect to space or other criteria from given sequences of displacements, can be solved in polynomial time. The problem is relevant…

Data Structures and Algorithms · Computer Science 2015-07-01 Robert Ganian , Martin Kalany , Stefan Szeider , Jesper Larsson Träff

We give the first linear-time counting algorithm for processes in anonymous 1-interval-connected dynamic networks with a leader. As a byproduct, we are able to compute in $3n$ rounds every function that is deterministically computable in…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-02-21 Giuseppe A. Di Luna , Giovanni Viglietta

Innovative shared mobility services provide on-demand flexible mobility options and have the potential to alleviate traffic congestion. These attractive services are challenging from different perspectives. One major challenge in such…

Data Structures and Algorithms · Computer Science 2020-05-25 Rui Yao , Shlomo Bekhor

Optical networks with multi-core fibers can replace several electronics networks with a single topology. Each electronic link is replaced by a single fiber, which can save space, weight, and cost, while having better segregation and EMI…

Networking and Internet Architecture · Computer Science 2021-04-06 Bjoern Annighoefer , Adrian Zeyher , Johannes Reinhart

Modern applied optimization problems become more and more complex every day. Due to this fact, distributed algorithms that can speed up the process of solving an optimization problem through parallelization are of great importance. The main…

Optimization and Control · Mathematics 2023-12-14 Svetlana Tkachenko , Artem Andreev , Aleksandr Beznosikov , Alexander Gasnikov