English
Related papers

Related papers: Performance Impact of Data Layout on the GPU-accel…

200 papers

The simulation of the two-dimensional Ising model is used as a benchmark to show the computational capabilities of Graphic Processing Units (GPUs). The rich programming environment now available on GPUs and flexible hardware capabilities…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-08-26 Joshua Romero , Mauro Bisson , Massimiliano Fatica , Massimo Bernaschi

Efficiently scaling deep neural networks across GPU clusters requires navigating complex trade-offs between computational throughput, memory utilization, and synchronization overhead. This paper presents a unified empirical evaluation of…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-01-06 Md Sultanul Islam Ovi

In this paper we present a new methodology for data accesses when solving batches of Tridiagonal and Pentadiagonal matrices that all share the same LHS matrix. By only storing one copy of this matrix there is a significant reduction in…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-09-13 Andrew Gloster , Enda Carroll , Miguel Bustamante , Lennon O'Naraigh

In video generation models, particularly world models, training large-scale video diffusion Transformers (such as DiT and MMDiT) poses significant computational challenges due to the extreme variance in sequence lengths within mixed-mode…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-19 Yucheng Guo , Yongjian Guo , Zhong Guan , Haoran Sun , Wen Huang , Wanting Xu , Jing Long , Shuai Di , Junwu Xiong

The Whale Optimization Algorithm (WOA) has shown strong optimization ability but still suffers from premature convergence and weak search diversity. To address these issues, this paper proposes an enhanced WOA variant called CICDWOA. The…

Computational Engineering, Finance, and Science · Computer Science 2026-03-24 Junhao Wei , Yanxiao Li , Seyedali Mirjalili , Dexing Yao , Yifu Zhao , Haochen Li , Xudong Ye , Zikun Li , Qingyang Xu , Baili Lu , Ngai Cheong , Dengcheng Yang , Sio-Kei Im , Yapeng Wang , Xu Yang

Advanced driver-assistance systems (ADAS) require neural compute engines that deliver low-latency inference under strict power and area constraints. Posit arithmetic is attractive for such accelerators because it provides high numerical…

Hardware Architecture · Computer Science 2026-05-11 Mukul Lokhande , Ratko Pilipovic , Omkar Kokane , Adam Teman , Santosh Kumar Vishvakarma

Effective intra-node GPU communication is essential for optimizing performance in MPI-based HPC applications, especially when leveraging multiple communication paths. In this study, we propose a novel approach that integrates CUDA Graphs…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-04-28 Amirhossein Sojoodi , Yiltan Hassan Temucin , Amirreza Baratisedeh , Hamed Sharifian , Ahmad Afsahi

We present a scalable dissipative particle dynamics simulation code, fully implemented on the Graphics Processing Units (GPUs) using a hybrid CUDA/MPI programming model, which achieves 10-30 times speedup on a single GPU over 16 CPU cores…

Distributed, Parallel, and Cluster Computing · Computer Science 2014-12-01 Yu-Hang Tang , George Em Karniadakis

We discuss an implementation of adaptive fast multipole methods targeting hybrid multicore CPU- and GPU-systems. From previous experiences with the computational profile of our version of the fast multipole algorithm, suitable parts are…

Distributed, Parallel, and Cluster Computing · Computer Science 2014-09-03 Marcus Holm , Stefan Engblom , Anders Goude , Sverker Holmgren

We examine the problem of optimizing classification tree evaluation for on-line and real-time applications by using GPUs. Looking at trees with continuous attributes often used in image segmentation, we first put the existing algorithms for…

Distributed, Parallel, and Cluster Computing · Computer Science 2011-11-08 Jason Spencer

Accelerated computing is widely used in high-performance computing. Therefore, it is crucial to experiment and discover how to better utilize GPUGPUs latest generations on relevant applications. In this paper, we present results and share…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-08-13 Baodi Shan , Mauricio Araya-Polo

Many-particle continuous-time quantum walks (CTQWs) represent a resource for several tasks in quantum technology, including quantum search algorithms and universal quantum computation. In order to design and implement CTQWs in a realistic…

Quantum Physics · Physics 2017-10-02 Enrico Piccinini , Claudia Benedetti , Ilaria Siloi , Matteo G. A. Paris , Paolo Bordone

Intelligence Processing Units (IPU) have proven useful for many AI applications. In this paper, we evaluate them within the emerging field of \emph{AI for simulation}, where traditional numerical simulations are supported by artificial…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-04 P. Rosciszewski , A. Krzywaniak , S. Iserte , K. Rojek , P. Gepner

Iterative graph algorithms often compute intermediate values and update them as computation progresses. Updated output values are used as inputs for computations in current or subsequent iterations; hence the number of iterations required…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-10-05 Mark P. Blanco , Scott McMillan , Tze Meng Low

Over the past decade, the landscape of data analytics has seen a notable shift towards heterogeneous architectures, particularly the integration of GPUs to enhance overall performance. In the realm of in-memory analytics, which often…

Databases · Computer Science 2024-06-21 Harshit Sharma , Anmol Sharma

This paper presents efforts to improve the hierarchical parallelism of a two scale simulation code. Two methods to improve the GPU parallel performance were developed and compared. The first used the NVIDIA Multi-Process Service and the…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-05-15 Jacob Merson , Mark S. Shephard

Datalog is a declarative logic-programming language used for complex analytic reasoning workloads such as program analysis and graph analytics. Datalog's popularity is due to its unique price-point, marrying logic-defined specification with…

Databases · Computer Science 2026-04-24 Yihao Sun , Kunting Qi , Thomas Gilray , Sidharth Kumar , Kristopher Micinski

We present a customizable soft architecture which allows for the execution of GPGPU code on an FPGA without the need to recompile the design. Issues related to scaling the overlay architecture to multiple GPGPU multiprocessors are…

Hardware Architecture · Computer Science 2016-06-22 Kevin Andryc , Tedy Thomas , Russell Tessier

The growing demand for efficient, high-performance processing in machine learning (ML) and image processing has made hardware accelerators, such as GPUs and Data Streaming Accelerators (DSAs), increasingly essential. These accelerators…

Hardware Architecture · Computer Science 2025-04-17 Qunyou Liu , Marina Zapater , David Atienza

As modern AI workloads increasingly rely on heterogeneous accelerators, ensuring high-bandwidth and layout-flexible data movements between accelerator memories has become a pressing challenge. Direct Memory Access (DMA) engines promise high…

Hardware Architecture · Computer Science 2025-08-13 Fanchen Kong , Yunhao Deng , Xiaoling Yi , Ryan Antonio , Marian Verhelst