English
Related papers

Related papers: Scaling Up Large-Scale Graph Processing for GPU-Ac…

200 papers

Graph Transformer is gaining increasing attention in the field of machine learning and has demonstrated state-of-the-art performance on benchmarks for graph representation learning. However, as current implementations of Graph Transformer…

Machine Learning · Computer Science 2023-05-08 Wenhao Zhu , Tianyu Wen , Guojie Song , Xiaojun Ma , Liang Wang

There has been significant recent interest in parallel graph processing due to the need to quickly analyze the large graphs available today. Many graph codes have been designed for distributed memory or external memory. However, today even…

Data Structures and Algorithms · Computer Science 2019-08-22 Laxman Dhulipala , Guy E. Blelloch , Julian Shun

Using \textit{multiple streams} can improve the overall system performance by mitigating the data transfer overhead on heterogeneous systems. Prior work focuses a lot on GPUs but little is known about the performance impact on (Intel Xeon)…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-03-30 Zhaokui Li , Jianbin Fang , Tao Tang , Xuhao Chen , Cheng Chen , Canqun Yang

Large-scale graph problems are of critical and growing importance and historically parallel architectures have provided little support. In the spirit of co-design, we explore the question, How fast can graph computing go on a fine-grained…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-07-02 Yuqing Wang , Charles Colley , Brian Wheatman , Jiya Su , David F. Gleich , Andrew A. Chien

Graph Convolutional Networks (GCNs) have emerged as the state-of-the-art deep learning model for representation learning on graphs. It is challenging to accelerate training of GCNs, due to (1) substantial and irregular data communication to…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-01-09 Hanqing Zeng , Viktor Prasanna

Graphics Processing Units (GPUs) have become the standard in accelerating scientific applications on heterogeneous systems. However, as GPUs are getting faster, one potential performance bottleneck with GPU-accelerated applications is the…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-05-01 Jonah Ekelund , Stefano Markidis , Ivy Peng

Graph Neural Networks (GNNs) have been widely adopted for their ability to compute expressive node representations in graph datasets. However, serving GNNs on large graphs is challenging due to the high communication, computation, and…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-01-16 Geon-Woo Kim , Donghyun Kim , Jeongyoon Moon , Henry Liu , Tarannum Khan , Anand Iyer , Daehyeok Kim , Aditya Akella

We present a novel algorithm, \hdgc, that marries graph convolution with binding and bundling operations in hyperdimensional computing for transductive graph learning. For prediction accuracy \hdgc outperforms major and popular graph neural…

Machine Learning · Computer Science 2025-10-29 Guojing Cong , Tom Potok , Hamed Poursiami , Maryam Parsa

High parallel framework has been proved to be very suitable for graph processing. There are various work to optimize the implementation in FPGAs, a pipeline parallel device. The key to make use of the parallel performance of FPGAs is to…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-07-02 Chengbo Yang

We initiate the study of graph algorithms in the streaming setting on massive distributed and parallel systems inspired by practical data processing systems. The objective is to design algorithms that can efficiently process evolving graphs…

Data Structures and Algorithms · Computer Science 2025-01-20 Artur Czumaj , Gopinath Mishra , Anish Mukherjee

Graph Convolutional Networks (GCNs) are extensively utilized for deep learning on graphs. The large data sizes of graphs and their vertex features make scalable training algorithms and distributed memory systems necessary. Since the…

Machine Learning · Computer Science 2022-12-14 Gunduz Vehbi Demirci , Aparajita Haldar , Hakan Ferhatosmanoglu

Graph analysis performs many random reads and writes, thus, these workloads are typically performed in memory. Traditionally, analyzing large graphs requires a cluster of machines so the aggregate memory exceeds the graph size. We…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-01-27 Da Zheng , Disa Mhembere , Randal Burns , Joshua Vogelstein , Carey E. Priebe , Alexander S. Szalay

Recent studies showed that single-machine graph processing systems can be as highly competitive as cluster-based approaches on large-scale problems. While several out-of-core graph processing systems and computation models have been…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-02-19 Peng Sun , Yonggang Wen , Ta Nguyen Binh Duong , Xiaokui Xiao

We study distributed graph algorithms that adopt an iterative vertex-centric framework for graph processing, popularized by the Google's Pregel system. Since then, there are several attempts to implement many graph algorithms in a…

Databases · Computer Science 2016-12-23 Arijit Khan

High-performance implementations of graph algorithms are challenging to implement on new parallel hardware such as GPUs because of three challenges: (1) the difficulty of coming up with graph building blocks, (2) load imbalance on parallel…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-06-16 Carl Yang , Aydin Buluc , John D. Owens

Graph Neural Networks (GNNs) have been widely adopted due to their strong performance. However, GNN training often relies on expensive, high-performance computing platforms, limiting accessibility for many tasks. Profiling of representative…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-11-12 Tong Qiao , Ao Zhou , Yingjie Qi , Yiou Wang , Han Wan , Jianlei Yang , Chunming Hu

Connected components and spanning forest are fundamental graph algorithms due to their use in many important applications, such as graph clustering and image segmentation. GPUs are an ideal platform for graph algorithms due to their high…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-08-28 Changwan Hong , Laxman Dhulipala , Julian Shun

With the rapid evolution of GPU architectures, the heterogeneity of model training infrastructures is steadily increasing. In such environments, effectively utilizing all available heterogeneous accelerators becomes critical for distributed…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-05 Antian Liang , Zhigang Zhao , Kai Zhang , Xuri Shi , Chuantao Li , Chunxiao Wang , Zhenying He , Yinan Jing , X. Sean Wang

GPUs are now used for a wide range of problems within HPC. However, making efficient use of the computational power available with multiple GPUs is challenging. The main challenges in achieving good performance are memory layout, affecting…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-04-20 Robert Clucas , Philip Blakely , Nikolaos Nikiforakis

Recent years have witnessed the emerging success of graph neural networks (GNNs) for modeling structured data. However, most GNNs are designed for homogeneous graphs, in which all nodes and edges belong to the same types, making them…

Machine Learning · Computer Science 2020-03-04 Ziniu Hu , Yuxiao Dong , Kuansan Wang , Yizhou Sun