English
Related papers

Related papers: Sparbit: a new logarithmic-cost and data locality-…

200 papers

The increasing complexity of HPC architectures and the growing adoption of irregular scientific algorithms demand efficient support for asynchronous, multithreaded communication. This need is especially pronounced with Asynchronous…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-08-27 Jiakun Yan , Marc Snir , Yanfei Guo

Comprehending the performance bottlenecks at the core of the intricate hardware-software interactions exhibited by highly parallel programs on HPC clusters is crucial. This paper sheds light on the issue of automatically asynchronous MPI…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-09-06 Ayesha Afzal , Georg Hager , Stefano Markidis , Gerhard Wellein

Modern compute nodes in high-performance computing provide a tremendous level of parallelism and processing power. However, as arithmetic performance has been observed to increase at a faster rate relative to memory and network bandwidths,…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-05-11 Johannes Pekkilä , Miikka S. Väisälä , Maarit J. Käpylä , Matthias Rheinhardt , Oskar Lappi

Contemporary accelerator designs exhibit a high degree of spatial localization, wherein two-dimensional physical distance determines communication costs between processing elements. This situation presents considerable algorithmic…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-08-09 Yves Baumann , Tal Ben-Nun , Maciej Besta , Lukas Gianinazzi , Torsten Hoefler , Piotr Luczynski

Modern heterogeneous supercomputing systems are comprised of CPUs, GPUs, and high-speed network interconnects. Communication libraries supporting efficient data transfers involving memory buffers from the GPU memory typically require the…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-06-29 Naveen Namashivayam , Krishna Kandalla , James B White , Larry Kaplan , Mark Pagel

We give optimally fast $O(\log p)$ time (per processor) algorithms for computing round-optimal broadcast schedules for message-passing parallel computing systems. This affirmatively answers difficult questions posed in a SPAA 2022 BA and a…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-07-29 Jesper Larsson Träff

A Partitioned Global Address Space (PGAS) approach treats a distributed system as if the memory were shared on a global level. Given such a global view on memory, the user may program applications very much like shared memory systems. This…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-07-08 Huan Zhou , Yousri Mhedheb , Kamran Idrees , Colin W. Glass , José Gracia , Karl Fürlinger , Jie Tao

Dynamic resource management is an increasingly important capability of High Performance Computing systems, as it enables jobs to adjust their resource allocation at runtime. This capability can reduce workload makespan, substantially…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-01-28 Iker Martín-Álvarez , José I. Aliaga , Maribel Castillo

Isomorphic (sparse) collective communication is a form of collective communication in which all involved processes communicate in small, identically structured neighborhoods of other processes. Isomorphic neighborhoods are defined via an…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-06-27 Jesper Larsson Träff , Alexandra Carpen-Amarie , Sascha Hunold , Antoine Rougier

MPI+threads is gaining prominence as an alternative to the traditional MPI everywhere model in order to better handle the disproportionate increase in the number of cores compared with other on-node resources. However, the communication…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-05-04 Rohit Zambre , Aparna Chandramowlishwaran , Pavan Balaji

Remote-memory-access models, also known as one-sided communication models, are becoming an interesting alternative to traditional two-sided communication models in the field of High Performance Computing. In this paper we extend previous…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-09-28 Huan Zhou , Jose Gracia

MPI applications matter. However, with the advent of many-core processors, traditional MPI applications are challenged to achieve satisfactory performance. This is due to the inability of these applications to respond to load imbalances, to…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-12-20 Jan Ciesko , Pedro J. Martínez-Ferrer , Raúl Peñacoba Veigas , Xavier Teruel , Vicenç Beltran

Due to the coarse granularity of data accesses and the heavy use of latches, indices in the B-tree family are not efficient for in-memory databases, especially in the context of today's multi-core architecture. In this paper, we present PI,…

Databases · Computer Science 2016-01-05 Zhongle Xie , Qingchao Cai , H. V. Jagadish , Beng Chin Ooi , Weng-Fai Wong

Due to its optimality on a single machine for the problem of minimizing average flow time, Shortest-Remaining-Processing-Time (\srpt) appears to be the most natural algorithm to consider for the problem of minimizing average flow time on…

Data Structures and Algorithms · Computer Science 2010-11-10 Kyle Fox , Benjamin Moseley

We present an experimental investigation of the performance of MPI derived datatypes. For messages up to the megabyte range most schemes perform comparably to each other and to manual copying into a regular send buffer. However, for large…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-10-01 Victor Eijkhout

With the increasing need for safer and reliable systems, Mandelbrot Set's use in the encryption world is evident to everyone. This document aims to provide an efficient method to generate this set using data parallelism. First Bernstein's…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-07-03 Bhanuka Manesha Samarasekara Vitharana Gamage , Vishnu Monn Baskaran

MPI uses the concept of communicators to connect groups of processes. It provides nonblocking collective operations on communicators to overlap communication and computation. Flexible algorithms demand flexible communicators. E.g., a…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-03-02 Michael Axtmann , Armin Wiebigke , Peter Sanders

We present a strongly polynomial-time algorithm to generate bandwidth optimal allgather/reduce-scatter on any network topology, with or without switches. Our algorithm constructs pipeline schedules achieving provably the best possible…

Networking and Internet Architecture · Computer Science 2023-06-02 Liangyu Zhao , Arvind Krishnamurthy

Two new algorithms for the all-reduce operation, optimized for imbalanced process arrival patterns (PAPs) are presented: (i) sorted linear tree (SLT), (ii) pre-reduced ring (PRR) as well as a new way of on-line PAP detection, including…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-04-17 Jerzy Proficz

We present a new method for performing global redistributions of multidimensional arrays essential to parallel fast Fourier (or similar) transforms. Traditional methods use standard all-to-all collective communication of contiguous memory…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-04-26 Lisandro Dalcin , Mikael Mortensen , David E Keyes