English
Related papers

Related papers: OpTree: An Efficient Algorithm for All-gather Oper…

200 papers

Modern large-scale scientific applications consist of thousands to millions of individual tasks. These tasks involve not only computation but also communication with one another. Typically, the communication pattern between tasks is sparse…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-04-03 Christian Schulz , Henning Woydt

Communication locality plays a key role in the performance of collective operations on large HPC systems, especially on oversubscribed networks where groups of nodes are fully connected internally but sparsely linked through global…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-11-14 Daniele De Sensi , Saverio Pasqualoni , Lorenzo Piarulli , Tommaso Bonato , Seydou Ba , Matteo Turisini , Jens Domke , Torsten Hoefler

The massive integration of distributed energy resources changes the operational demands of the electric power distribution system, motivating optimization-based approaches. The added computational complexities of the resulting optimal power…

Optimization and Control · Mathematics 2023-07-04 Yunqi Luo , Rabayet Sadnan , Bala Krishnamoorthy , Anamika Dubey

Distributed Pseudo-tree Optimization Procedure (DPOP) is a well-known message passing algorithm that has been used to provide optimal solutions of Distributed Constraint Optimization Problems (DCOPs) -- a framework that is designed to…

Multiagent Systems · Computer Science 2019-09-17 Mashrur Rashik , Md. Musfiqur Rahman , Md. Mamun-or-Rashid , Md. Mosaddek Khan

Communication scheduling has been shown to be effective in accelerating distributed training, which enables all-reduce communications to be overlapped with backpropagation computations. This has been commonly adopted in popular distributed…

Machine Learning · Computer Science 2023-06-16 Lin Zhang , Shaohuai Shi , Xiaowen Chu , Wei Wang , Bo Li , Chengjian Liu

On-demand peer-to-peer ride-sharing services provide flexible mobility options, and are expected to alleviate congestion by sharing empty car seats. An efficient matching algorithm is essential to the success of a ride-sharing system. The…

Data Structures and Algorithms · Computer Science 2021-05-28 Rui Yao , Shlomo Bekhor

Contemporary accelerator designs exhibit a high degree of spatial localization, wherein two-dimensional physical distance determines communication costs between processing elements. This situation presents considerable algorithmic…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-08-09 Yves Baumann , Tal Ben-Nun , Maciej Besta , Lukas Gianinazzi , Torsten Hoefler , Piotr Luczynski

The maximum common subtree isomorphism problem asks for the largest possible isomorphism between subtrees of two given input trees. This problem is a natural restriction of the maximum common subgraph problem, which is ${\sf NP}$-hard in…

Data Structures and Algorithms · Computer Science 2016-08-23 Andre Droschinsky , Nils M. Kriege , Petra Mutzel

Dynamic tree data structures maintain a forest while supporting insertion and deletion of edges and a broad set of queries in $O(\log n)$ time per operation. Such data structures are at the core of many modern algorithms. Recent work has…

Data Structures and Algorithms · Computer Science 2025-06-23 Humza Ikram , Andrew Brady , Daniel Anderson , Guy Blelloch

We develop distributed algorithms to allocate resources in multi-hop wireless networks with the aim of minimizing total cost. In order to observe the fundamental duplexing constraint that co-located transmitters and receivers cannot operate…

Networking and Internet Architecture · Computer Science 2016-11-15 Yufang Xi , Edmund M. Yeh

We show how to construct an overlay network of constant degree and diameter $O(\log n)$ in time $O(\log n)$ starting from an arbitrary weakly connected graph. We assume a synchronous communication network in which nodes can send messages to…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-07-28 Thorsten Götte , Kristian Hinnenthal , Christian Scheideler , Julian Werthmann

The increase and rapid growth of data produced by scientific instruments, the Internet of Things (IoT), and social media is causing data transfer performance and resource consumption to garner much attention in the research community. The…

Performance · Computer Science 2023-09-29 Hasibul Jamil , Lavone Rodolph , Jacob Goldverg , Tevfik Kosar

Distributed graph algorithms that separately optimize for either the number of rounds used or the total number of messages sent have been studied extensively. However, algorithms simultaneously efficient with respect to both measures have…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-05-18 Bernhard Haeupler , D. Ellis Hershkowitz , David Wajc

Distributed resource allocation is a central task in network systems such as smart grids, water distribution networks, and urban transportation systems. When solving such problems in practice it is often important to have nonasymptotic…

Optimization and Control · Mathematics 2021-03-30 Xuyang Wu , Sindri Magnusson , Mikael Johansson

This paper presents a decentralized algorithm for non-convex optimization over tree-structured networks. We assume that each node of this network can solve small-scale optimization problems and communicate approximate value functions with…

Optimization and Control · Mathematics 2020-11-02 Yuning Jiang , Dimitris Kouzoupis , Haoyu Yin , Moritz Diehl , Boris Houska

Distributed optimization has attracted lots of attention in the operation of power systems in recent years, where a large area is decomposed into smaller control regions each solving a local optimization problem with periodic information…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-11-07 Junyao Guo , Gabriela Hug , Ozan Tonguz

Decision tree (and its extensions such as Gradient Boosting Decision Trees and Random Forest) is a widely used machine learning algorithm, due to its practical effectiveness and model interpretability. With the emergence of big data, there…

Machine Learning · Computer Science 2016-11-07 Qi Meng , Guolin Ke , Taifeng Wang , Wei Chen , Qiwei Ye , Zhi-Ming Ma , Tie-Yan Liu

In light of recent achievements in optical computing and machine learning, we consider the conditions under which all-optical computing may surpass electronic and optoelectronic computing in terms of energy efficiency and scalability. When…

Emerging Technologies · Computer Science 2023-06-14 Michał Matuszewski , Adam Prystupiuk , Andrzej Opala

This paper discusses distributed optimization over a directed graph. We begin with some well known algorithms which achieve consensus among agents including FROST [1], which possesses the quickest convergence to the optimum. It is a well…

Optimization and Control · Mathematics 2021-02-12 Shuubham Ojha , Ketan Rajawat

Efficient collective communication is critical for many distributed ML and HPC applications. In this context, it is widely believed that the Ring algorithm for the AllReduce collective communication operation is optimal only for large…

Networking and Internet Architecture · Computer Science 2025-10-07 Sarah-Michelle Hammer , Stefan Schmid , Rachee Singh , Vamsi Addanki