English
Related papers

Related papers: Tuning MPI Collectives by Verifying Performance Gu…

200 papers

Modern compilers typically provide hundreds of options to optimize program performance, but users often cannot fully leverage them due to the huge number of options. While standard optimization combinations (e.g., -O3) provide reasonable…

Software Engineering · Computer Science 2025-06-25 Bingyu Gao , Mengyu Yao , Ziming Wang , Dong Liu , Ding Li , Xiangqun Chen , Yao Guo

Exactly solving multi-objective integer programming (MOIP) problems is often a very time consuming process, especially for large and complex problems. Parallel computing has the potential to significantly reduce the time taken to solve such…

Optimization and Control · Mathematics 2018-11-02 William Pettersson , Melih Ozlen

We examine natural expectations on communication performance using MPI derived datatypes in comparison to the baseline, "raw" performance of communicating simple, non-contiguous data layouts. We show that common MPI libraries sometimes…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-07-04 Alexandra Carpen-Amarie , Sascha Hunold , Jesper Larsson Träff

Existing works show that augmenting the training data of pre-trained language models (PLMs) for classification tasks fine-tuned via parameter-efficient fine-tuning methods (PEFT) using both clean and adversarial examples can enhance their…

Computation and Language · Computer Science 2024-06-18 Tuc Nguyen , Thai Le

Automated code instrumentation, i.e. the insertion of measurement hooks into a target application by the compiler, is an established technique for collecting reliable, fine-grained performance data. The set of functions to instrument has to…

Performance · Computer Science 2023-03-21 Sebastian Kreutzer , Christian Iwainsky , Marta Garcia-Gasulla , Victor Lopez , Christian Bischof

Machine learning models made up of millions or billions of parameters are trained and served on large multi-GPU systems. As models grow in size and execute on more GPUs, the collective communications used in these applications become a…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-07-21 Meghan Cowan , Saeed Maleki , Madanlal Musuvathi , Olli Saarikivi , Yifan Xiong

Taking snapshots of the state of a distributed computation is useful for off-line analysis of the computational state, for later restarting from the saved snapshot, for cloning a copy of the computation, and for migration to a new cluster.…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-10-09 Yao Xu , Gene Cooperman

In this paper we describe an autotuning tool for optimization of OpenMP applications on highly multicore and multithreaded architectures. Our work was motivated by in-depth performance analysis of scientific applications and synthetic…

Distributed, Parallel, and Cluster Computing · Computer Science 2014-01-17 Jakub Katarzyński , Maciej Cytowski

With the ever-increasing computing power of supercomputers and the growing scale of scientific applications, the efficiency of MPI collective communication turns out to be a critical bottleneck in large-scale distributed and parallel…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-02-27 Jiajun Huang , Sheng Di , Xiaodong Yu , Yujia Zhai , Zhaorui Zhang , Jinyang Liu , Xiaoyi Lu , Ken Raffenetti , Hui Zhou , Kai Zhao , Khalid Alharthi , Zizhong Chen , Franck Cappello , Yanfei Guo , Rajeev Thakur

MPI uses the concept of communicators to connect groups of processes. It provides nonblocking collective operations on communicators to overlap communication and computation. Flexible algorithms demand flexible communicators. E.g., a…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-03-02 Michael Axtmann , Armin Wiebigke , Peter Sanders

The collective operations are considered critical for improving the performance of exascale-ready and high-performance computing applications. On this paper we focus on the Message-Passing Interface (MPI) Allgather many to many collective,…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-09-21 Wilton Jaciel Loch , Guilherme Piêgas Koslovski

In this paper, we detail how two types of distributed coordinator election algorithms can be compared in terms of performance based on an evaluation on the High Performance Computing (HPC) infrastructure. An experimental approach based on…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-11-09 Filip De Turck

OpenCL for FPGA enables developers to design FPGAs using a programming model similar for processors. Recent works have shown that code optimization at the OpenCL level is important to achieve high computational efficiency. However, existing…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-02-06 Ji Liu , Abdullah-Al Kafi , Xipeng Shen , Huiyang Zhou

Automatically tuning parallel compute kernels allows libraries and frameworks to achieve performance on a wide range of hardware, however these techniques are typically focused on finding optimal kernel parameters for particular input sizes…

Performance · Computer Science 2020-09-01 John Lawson

The Message-Passing Interface (MPI) and C++ form the backbone of high-performance computing, but MPI only provides C and Fortran bindings. While this offers great language interoperability, high-level programming languages like C++ make…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-11-13 Tim Niklas Uhl , Matthias Schimek , Lukas Hübner , Demian Hespe , Florian Kurpicz , Christoph Stelz , Peter Sanders

As HPC system architectures and the applications running on them continue to evolve, the MPI standard itself must evolve. The trend in current and future HPC systems toward powerful nodes with multiple CPU cores and multiple GPU…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-02-20 Hui Zhou , Ken Raffenetti , Yanfei Guo , Thomas Gillis , Robert Latham , Rajeev Thakur

Embedded systems have proliferated in various consumer and industrial applications with the evolution of Cyber-Physical Systems and the Internet of Things. These systems are subjected to stringent constraints so that embedded software must…

MPI is the de facto standard for parallel computing on a cluster of computers. Checkpointing is an important component in any strategy for software resilience and for long-running jobs that must be executed by chaining together time-bounded…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-08-06 Yao Xu , Gene Cooperman

This paper explores reoptimization techniques for solving sequences of similar mixed integer programs (MIPs) more effectively. Traditionally, these MIPs are solved independently, without capitalizing on information from previously solved…

Optimization and Control · Mathematics 2024-01-26 Krunal Kishor Patel

This paper introduces a new C++/CUDA library for GPU-accelerated stochastic optimization called MPPI-Generic. It provides implementations of Model Predictive Path Integral control, Tube-Model Predictive Path Integral Control, and Robust…

Mathematical Software · Computer Science 2026-02-26 Bogdan Vlahov , Jason Gibson , Manan Gandhi , Evangelos A. Theodorou