English
Related papers

Related papers: Leveraging MPI-3 Shared-Memory Extensions for Effi…

200 papers

Data movement is the dominating factor affecting performance and energy in modern computing systems. Consequently, many algorithms have been developed to minimize the number of I/O operations for common computing patterns. Matrix…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-01-26 Johannes de Fine Licht , Grzegorz Kwasniewski , Torsten Hoefler

With the ever-increasing computing power of supercomputers and the growing scale of scientific applications, the efficiency of MPI collective communication turns out to be a critical bottleneck in large-scale distributed and parallel…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-02-27 Jiajun Huang , Sheng Di , Xiaodong Yu , Yujia Zhai , Zhaorui Zhang , Jinyang Liu , Xiaoyi Lu , Ken Raffenetti , Hui Zhou , Kai Zhao , Khalid Alharthi , Zizhong Chen , Franck Cappello , Yanfei Guo , Rajeev Thakur

With the ever-increasing computing power of supercomputers and the growing scale of scientific applications, the efficiency of MPI collective communications turns out to be a critical bottleneck in large-scale distributed and parallel…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-01-19 Jiajun Huang , Sheng Di , Xiaodong Yu , Yujia Zhai , Zhaorui Zhang , Jinyang Liu , Xiaoyi Lu , Ken Raffenetti , Hui Zhou , Kai Zhao , Zizhong Chen , Franck Cappello , Yanfei Guo , Rajeev Thakur

The emerging hybrid DRAM-NVM architecture is challenging the existing memory management mechanism in operating system. In this paper, we introduce memos, which can schedule memory resources over the entire memory hierarchy including cache,…

Operating Systems · Computer Science 2017-03-23 Lei Liu , Mengyao Xie , Hao Yang

Collective communication operations such as MPI_Alltoallv are central to many HPC applications, particularly those with irregular message sizes. We design, implement, and evaluate persistent MPI RMA variants of Alltoallv based on fence and…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-04-08 Evelyn Namugwanya

In order to satisfy their ever increasing capacity and compute requirements, machine learning models are distributed across multiple nodes using numerous parallelism strategies. As a result, collective communications are often on the…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-04-24 Kishore Punniyamurthy , Khaled Hamidouche , Bradford M. Beckmann

The performance gap between memory and processor has grown rapidly. Consequently, the energy and wall-clock time costs associated with moving data between the CPU and main memory predominate the overall computational cost. The…

Hardware Architecture · Computer Science 2024-03-01 Qingcai Jiang , Shaojie Tan , Junshi Chen , Hong An

Efficient signal detectors are rather important yet challenging to achieve satisfactory performance for large-scale communication systems. This paper considers a non-orthogonal sparse code multiple access (SCMA) configuration for…

Signal Processing · Electrical Eng. & Systems 2023-03-16 Yao Ge , Lei Liu , Shunqi Huang , David González G. , Yong Liang Guan , Zhi Ding

Remote Memory Access (RMA) is an emerging mechanism for programming high-performance computers and datacenters. However, little work exists on resilience schemes for RMA-based applications and systems. In this paper we analyze fault…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-10-20 Maciej Besta , Torsten Hoefler

Hybrid main memory systems combine both performance and capacity advantages from heterogeneous memory technologies. With larger capacities, higher associativities, and finer granularities, hybrid memory systems currently exhibit significant…

Hardware Architecture · Computer Science 2024-08-27 Yiwei Li , Boyu Tian , Mingyu Gao

The increasing density of transistors in Integrated Circuits (ICs) has enabled the development of highly integrated Systems-on-Chip (SoCs) and, more recently, Multiprocessor Systems-on-Chip (MPSoCs). To address scalability challenges in…

Hardware Architecture · Computer Science 2025-04-29 Rodrigo Cataldo , Cesar Marcon , Debora Matos

The energy-efficient Adapteva Epiphany architecture exhibits massive many-core scalability in a physically compact 2D array of RISC cores with a fast network-on-chip (NoC). With fully divergent cores capable of MIMD execution, the physical…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-04-15 James A. Ross , David A. Richie

In this paper, we introduce a new user-level DSM system which has the ability to directly interact with underlying interconnection networks. The DSM system provides the application programmer a flexible API to program parallel applications…

Distributed, Parallel, and Cluster Computing · Computer Science 2007-05-23 Bharath Ramesh , Srinidhi Varadarajan

Natural human interactions for Mixed Reality Applications are overwhelmingly multimodal: humans communicate intent and instructions via a combination of visual, aural and gestural cues. However, supporting low-latency and accurate…

Human-Computer Interaction · Computer Science 2020-12-21 Darshana Rathnayake , Ashen de Silva , Dasun Puwakdandawa , Lakmal Meegahapola , Archan Misra , Indika Perera

Considering backhaul consumption in practical systems, it may not be the best choice to engage all the time in full cooperative MIMO for interference mitigation. In this paper, we propose a novel downlink partial cooperative MIMO (Pco-MIMO)…

Information Theory · Computer Science 2013-07-10 Ying Cui , Vincent K. N. Lau , Huang Huang

We present an efficient distributed memory parallel algorithm for computing connected components in undirected graphs based on Shiloach-Vishkin's PRAM approach. We discuss multiple optimization techniques that reduce communication volume as…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-02-15 Chirag Jain , Patrick Flick , Tony Pan , Oded Green , Srinivas Aluru

Paper presents and evaluates various mechanisms for remote access to memory in distributed systems based on two distinct HPC clusters. We are comparing solutions based on the shared storage and MPI (over Infiniband and Slingshot) to the…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-12-03 Jan Meizner , Maciej Malawski

Advances in detectors and computational technologies provide new opportunities for applied research and the fundamental sciences. Concurrently, dramatic increases in the three Vs (Volume, Velocity, and Variety) of experimental data and the…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-05-15 Nikolay Malitsky , Aashish Chaudhary , Sebastien Jourdain , Matt Cowan , Patrick O'Leary , Marcus Hanwell , Kerstin Kleese Van Dam

The robot operating system is the de-facto standard for designing and implementing robotics applications. Several previous works deal with the integration of heterogeneous accelerators into ROS-based applications. One of these approaches is…

Robotics · Computer Science 2023-06-23 Christian Lienen , Alexander Philipp Nowosad , Marco Platzner

The implicit 2D3V particle-in-cell (PIC) code developed to study the interaction of ultrashort pulse lasers with matter [G. M. Petrov and J. Davis, Computer Phys. Comm. 179, 868 (2008); Phys. Plasmas 18, 073102 (2011)] has been parallelized…

Plasma Physics · Physics 2016-08-24 George M. Petrov , Jack Davis