English
Related papers

Related papers: Performance Analysis of Irregular Collective Commu…

200 papers

The fast iterative soft thresholding algorithm (FISTA) is used to solve convex regularized optimization problems in machine learning. Distributed implementations of the algorithm have become popular since they enable the analysis of large…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-10-25 Saeed Soori , Aditya Devarakonda , James Demmel , Mert Gurbuzbalaban , Maryam Mehri Dehnavi

Although recent works try to improve collective communication in grid systems by separating intra and inter-cluster communication, the optimisation of communications focus only on inter-cluster communications. We believe, instead, that the…

Distributed, Parallel, and Cluster Computing · Computer Science 2007-05-23 Luiz Angelo Barchet-Estefanel , Gregory Mounie

The increasing scale of large language models (LLMs) necessitates highly efficient collective communication frameworks, particularly as training workloads extend to hundreds of thousands of GPUs. Traditional communication methods face…

The present work is targeted at performing a strong scaling study of the high-order spectral element fluid dynamics solver Nek5000. Prior studies indicated a recommendable metric for strong scalability from a theoretical viewpoint, which we…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-06-12 Nicolas Offermans , Oana Marin , Michel Schanen , Jing Gong , Paul Fischer , Philipp Schlatter , Aleks Obabko , Adam Peplinksi , Maxwell Hutchinson , Elia Merzari

Modern reconfigurable architectures are increasingly favored for resource-constrained edge devices as they balance high performance, energy efficiency, and programmability well. However, their proficiency in handling regular compute…

Hardware Architecture · Computer Science 2025-04-30 Rohan Juneja , Pranav Dangi , Thilini Kaushalya Bandara , Tulika Mitra , Li-shiuan Peh

In this work, we study the $k$-median and $k$-means clustering problems when the data is distributed across many servers and can contain outliers. While there has been a lot of work on these problems for worst-case instances, we focus on…

Data Structures and Algorithms · Computer Science 2019-03-08 Pranjal Awasthi , Ainesh Bakshi , Maria-Florina Balcan , Colin White , David Woodruff

Machine Learning jobs, carried out on large number of distributed high performance systems, involve periodic communication using operations like AllReduce, AllGather, and Broadcast. These operations may create high bandwidth and bursty…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-07-11 Jit Gupta , Andrew Li , Tarun Banka , Ariel Cohen , T. Sridhar , Raj Yavatkar

Here, we test the performance and scalability of fully-asynchronous, best-effort communication on existing, commercially-available HPC hardware. A first set of experiments tested whether best-effort communication strategies can benefit…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-10-10 Matthew Andres Moreno , Charles Ofria

Ultra-reliable and low-latency communications (URLLC) are considered as one of three new application scenarios in the fifth generation cellular networks. In this work, we aim to reduce the user experienced delay through prediction and…

Signal Processing · Electrical Eng. & Systems 2024-10-30 Zhanwei Hou , Changyang She , Yonghui Li , Zhuo Li , Branka Vucetic

Nowadays the number of available processing cores within computing nodes which are used in recent clustered environments, are growing up with a rapid rate. Despite this trend, the number of available network interfaces in such computing…

Distributed, Parallel, and Cluster Computing · Computer Science 2012-07-13 Mohsen Soryani , Morteza Analoui , Ghobad Zarrinchian

In this thesis, we propose several modelling strategies to tackle evolving data in different contexts. In the framework of static clustering, we start by introducing a soft kernel spectral clustering (SKSC) algorithm, which can better deal…

Social and Information Networks · Computer Science 2014-11-24 Rocco Langone

Understanding and predicting the performance of big data applications running in the cloud or on-premises could help minimise the overall cost of operations and provide opportunities in efforts to identify performance bottlenecks. The…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-05-26 Sheriffo Ceesay , Adam Barker , Yuhui Lin

Primary user activity is a major bottleneck for existing routing protocols in cognitive radio networks. Typical routing protocols avoid areas that are highly congested with primary users, leaving only a small fragment of available links for…

Networking and Internet Architecture · Computer Science 2016-08-05 Arsany Guirguis , Mohammed Karmoose , Karim Habak , Mustafa El-Nainay , Moustafa Youssef

Communication-avoiding algorithms for Linear Algebra have become increasingly popular, in particular for distributed memory architectures. In practice, these algorithms assume that the data is already distributed in a specific way, thus…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-06-15 Marko Kabić , Simon Pintarelli , Anton Kozhevnikov , Joost VandeVondele

Cognitive radio networks (CRNs) propose a smart solution for spectrum usage inefficiency. Routing protocols for CRNs follow different criteria to choose the best route to the destination and to avoid the interference with primary users.…

Networking and Internet Architecture · Computer Science 2016-10-06 Arsany Guirguis , Mustafa El-Nainay

To realize cooperative computation and communication in a relay mobile edge computing system, we develop a hybrid relay forward protocol, where we seek to balance the execution delay and network energy consumption. The problem is formulated…

Information Theory · Computer Science 2017-11-01 Xihan Chen , Qingjiang Shi , Yunlong Cai , Minjian Zhao , Mingjie Zhao

With the rapid advancement of next-generation satellite networks, addressing clustering tasks, user grouping, and efficient link management has become increasingly critical to optimize network performance and reduce interference. In this…

Information Theory · Computer Science 2025-09-18 Tam Ninh Thi-Thanh , Nguyen Minh Quan , Do Son Tung , Trinh Van Chien , Hung Tran

This paper studies the performance of some state-of-the-art cooperative full-duplex relaying protocols in the context of a large wireless network modelled using stochastic geometry tools. We investigate the outage behaviour for different…

Information Theory · Computer Science 2018-01-12 Andres Altieri , Pablo Piantanida

Cooperative coevolution (CC) has shown great potential in solving large scale optimization problems (LSOPs). However, traditional CC algorithms often waste part of computation resource (CR) as they equally allocate CR among all the…

Neural and Evolutionary Computing · Computer Science 2018-07-25 Zhigang Ren , Yongsheng Liang , Aimin Zhang , Yang Yang , Zuren Feng , Lin Wang

In this paper we design and implement a resource management scheme based on cooperative association, where the STAs can share useful information in order to improve the performance of the association/handoff procedures. The cooperative…

Networking and Internet Architecture · Computer Science 2012-07-03 George Athanasiou , Leandros Tassiulas
‹ Prev 1 2 3 10 Next ›