English
Related papers

Related papers: A Communication Avoiding and Reducing Algorithm fo…

200 papers

The use of hybrid scheme combining the message passing programming models for inter-node parallelism and the shared memory programming models for node-level parallelism is widely spread. Existing extensive practices on hybrid Message…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-07-23 Huan Zhou , Jose Gracia , Naweiluo Zhou , Ralf Schneider

Mass spectrometry (MS) based omics data analysis require significant time and resources. To date, few parallel algorithms have been proposed for deducing peptides from mass spectrometry-based data. However, these parallel algorithms were…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-08-12 Fahad Saeed , Muhammad Haseeb , SS Iyengar

Modern compute nodes in high-performance computing provide a tremendous level of parallelism and processing power. However, as arithmetic performance has been observed to increase at a faster rate relative to memory and network bandwidths,…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-05-11 Johannes Pekkilä , Miikka S. Väisälä , Maarit J. Käpylä , Matthias Rheinhardt , Oskar Lappi

Supercomputers getting ever larger and energy-efficient is at odds with the reliability of the used hardware. Thus, the time intervals between component failures are decreasing. Contrarily, the latencies for individual operations of…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-11-26 Demian Hespe , Lukas Hübner , Charel Mercatoris , Peter Sanders

We present and evaluate the ExaNeSt Prototype, a liquid-cooled rack prototype consisting of 256 Xilinx ZU9EG MPSoCs, 4 TBytes of DRAM, 16 TBytes of SSD, and configurable interconnection 10-Gbps hardware. We developed this testbed in…

We present scalable parallel algorithms with sublinear per-processor communication volume and low latency for several fundamental problems related to finding the most relevant elements in a set, for various notions of relevance: We begin…

Data Structures and Algorithms · Computer Science 2015-10-20 Lorenz Hübschle-Schneider , Peter Sanders , Ingo Müller

With the ever-increasing computing power of supercomputers and the growing scale of scientific applications, the efficiency of MPI collective communications turns out to be a critical bottleneck in large-scale distributed and parallel…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-01-19 Jiajun Huang , Sheng Di , Xiaodong Yu , Yujia Zhai , Zhaorui Zhang , Jinyang Liu , Xiaoyi Lu , Ken Raffenetti , Hui Zhou , Kai Zhao , Zizhong Chen , Franck Cappello , Yanfei Guo , Rajeev Thakur

We present our recent code modernizations of the of the ab initio molecular dynamics program CPMD (www.cpmd.org) with a special focus on the ultra-soft pseudopotential (USPP) code path. Following the internal instrumentation of CPMD, all…

Computational Physics · Physics 2020-03-20 Tobias Klöffel , Gerald Mathias , Bernd Meyer

Analytic, first-principles performance modeling of distributed-memory parallel codes is notoriously imprecise. Even for applications with extremely regular and homogeneous compute-communicate phases, simply adding communication time to…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-06-25 Ayesha Afzal , Georg Hager , Gerhard Wellein

The Simplex tableau has been broadly used and investigated in the industry and academia. With the advent of the big data era, ever larger problems are posed to be solved in ever larger machines whose architecture type did not exist in the…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-05-29 Demetrios Coutinho , Felipe O. Lins e Silva , Daniel Aloise , Samuel , Xavier-de-Souza

In this paper, we address the problem of designing a distributed application meant to run both classical and asynchronous iterations. MPI libraries are very popular and widely used in the scientific community, however asynchronous iterative…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-07-01 Guillaume Gbikpi-Benissan , Frederic Magoules

Parallel implementations of linear iterative solvers generally alternate between phases of data exchange and phases of local computation. Increasingly large problem sizes on more heterogeneous systems make load balancing and network layout…

Numerical Analysis · Mathematics 2020-08-12 Christian Glusa , Paritosh Ramanan , Erik G. Boman , Edmond Chow , Sivasankaran Rajamanickam

In this work, we consider the integration of MPI one-sided communication and non-blocking I/O in HPC-centric MapReduce frameworks. Using a decoupled strategy, we aim to overlap the Map and Reduce phases of the algorithm by allowing…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-10-10 Sergio Rivas-Gomez , Sai Narasimhamurthy , Keeran Brabazon , Oliver Perks , Erwin Laure , Stefano Markidis

We explore an approach due to Nievergelt of decomposing a time-evolution equation along the time dimension and solving it in parallel with as little communication as possible between the processors. This method computes a map from initial…

Numerical Analysis · Mathematics 2015-05-21 Andrew T. Barker

Communication and topology aware process mapping is a powerful approach to reduce communication time in parallel applications with known communication patterns on large, distributed memory systems. We address the problem as a quadratic…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-07-23 Christian Schulz , Jesper Larsson Träff , Konrad von Kirchbach

Exact diagonalization is a well-established method for simulating small quantum systems. Its applicability is limited by the exponential growth of the so-called Hamiltonian matrix that needs to be diagonalized. Physical symmetries are…

Computational Physics · Physics 2023-09-01 Tom Westerhout , Bradford L. Chamberlain

On many parallel machines, the time LQCD applications spent in communication is a significant contribution to the total wall-clock time, especially in the strong-scaling limit. We present a novel high-performance communication library that…

High Energy Physics - Lattice · Physics 2017-01-31 Peter Georg , Daniel Richtmann , Tilo Wettig

Matrix factorizations are among the most important building blocks of scientific computing. State-of-the-art libraries, however, are not communication-optimal, underutilizing current parallel architectures. We present novel algorithms for…

In this work we present a robust interface coupling algorithm called Compact Interface quasi-Newton (CIQN). It is designed for computationally intensive applications using an MPI multi-code partitioned scheme. The algorithm allows to reuse…

Computational Engineering, Finance, and Science · Computer Science 2020-06-02 A. Santiago , M. Zavala-Aké , R. Borell , G. Houzeaux

Recent increased interest in Cloud computing emphasizes the need to find an adequate solution to the load-balancing problem in parallel computing -- efficiently running several jobs concurrently on a cluster of shared computers (nodes). One…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-07-02 Adam Lev-Libfeld , Alex Margolin , Amnon Barak