English
Related papers

Related papers: Overcoming Latency-bound Limitations of Distribute…

200 papers

Graph neural networks (GNNs) leverage the connectivity and structure of real-world graphs to learn intricate properties and relationships between nodes. Many real-world graphs exceed the memory capacity of a GPU due to their sheer size, and…

Machine Learning · Computer Science 2025-10-30 Aditya K. Ranjan , Siddharth Singh , Cunyang Wei , Abhinav Bhatele

In this paper, we introduce PASGAL (Parallel And Scalable Graph Algorithm Library), a parallel graph library that scales to a variety of graph types, many processors, and large graph sizes. One special focus of PASGAL is the efficiency on…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-04-29 Xiaojun Dong , Yan Gu , Yihan Sun , Letong Wang

Comprehensive evaluation is one of the basis of experimental science. In High-Performance Graph Processing, a thorough evaluation of contributions becomes more achievable by supporting common input formats over different frameworks.…

Hardware Architecture · Computer Science 2025-10-29 Mohsen Koohi Esfahani , Marco D'Antonio , Syed Ibtisam Tauhidi , Thai Son Mai , Hans Vandierendonck

Current graph systems can easily process billions of data, however when increased to exceed hundred billions, the performance decreases dramatically, time series data always be very huge, consequently computation on time series graphs still…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-10-25 Derong Tang

For a deep learning model, efficient execution of its computation graph is key to achieving high performance. Previous work has focused on improving the performance for individual nodes of the computation graph, while ignoring the…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-07-26 Linpeng Tang , Yida Wang , Theodore L. Willke , Kai Li

Hypergraphs offer flexible and robust data representations for many applications, but methods that work directly on hypergraphs are not readily available and tend to be prohibitively expensive. Much of the current analysis of hypergraphs…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-01-28 Xu T. Liu , Jesun Firoz , Sinan Aksoy , Ilya Amburg , Andrew Lumsdaine , Cliff Joslyn , Assefaw H. Gebremedhin , Brenda Praggastis

In this work, we are interested in adaptive and distributed estimation of graph filters from streaming data. We formulate this problem as a consensus estimation problem over graphs, which can be addressed with diffusion LMS strategies. Most…

Signal Processing · Electrical Eng. & Systems 2019-12-13 Fei Hua , Roula Nassif , Cédric Richard , Haiyan Wang , Ali H. Sayed

Graph computing has become increasingly crucial in processing large-scale graph data, with numerous systems developed for this purpose. Two years ago, we introduced GraphScope as a system addressing a wide array of graph computing needs,…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-12-20 Tao He , Shuxian Hu , Longbin Lai , Dongze Li , Neng Li , Xue Li , Lexiao Liu , Xiaojian Luo , Binqing Lyu , Ke Meng , Sijie Shen , Li Su , Lei Wang , Jingbo Xu , Wenyuan Yu , Weibin Zeng , Lei Zhang , Siyuan Zhang , Jingren Zhou , Xiaoli Zhou , Diwen Zhu

We present a distributed framework of the Primal-Dual Hybrid Gradient (PDHG) algorithm for solving massive-scale linear programming (LP) problems. Although PDHG-based solvers demonstrate strong performance on single-node GPU architectures,…

Optimization and Control · Mathematics 2026-05-11 Hongpei Li , Yicheng Huang , Huikang Liu , Dongdong Ge , Yinyu Ye

An important objective for analyzing real-world graphs is to achieve scalable performance on large, streaming graphs. A challenging and relevant example is the graph partition problem. As a combinatorial problem, graph partition is NP-hard,…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-11-10 Edward Kao , Vijay Gadepally , Michael Hurley , Michael Jones , Jeremy Kepner , Sanjeev Mohindra , Paul Monticciolo , Albert Reuther , Siddharth Samsi , William Song , Diane Staheli , Steven Smith

Designing and implementing efficient, provably correct parallel machine learning (ML) algorithms is challenging. Existing high-level parallel abstractions like MapReduce are insufficiently expressive while low-level tools like MPI and…

Machine Learning · Computer Science 2010-06-28 Yucheng Low , Joseph Gonzalez , Aapo Kyrola , Danny Bickson , Carlos Guestrin , Joseph M. Hellerstein

Hypergraph partitioning is a pervasive NP-hard problem, and accelerating its computation on GPU can both slice time-to-solution and raise quality of results. In this work, we implement a multi-level hypergraph partitioning algorithm on GPU…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-04-17 Marco Ronzani , Cristina Silvano

Scalable addressing of high dimensional constrained combinatorial optimization problems is a challenge that arises in several science and engineering disciplines. Recent work introduced novel application of graph neural networks for solving…

Optimization and Control · Mathematics 2024-05-20 Nasimeh Heydaribeni , Xinrui Zhan , Ruisi Zhang , Tina Eliassi-Rad , Farinaz Koushanfar

Designing and implementing efficient, provably correct parallel machine learning (ML) algorithms is challenging. Existing high-level parallel abstractions like MapReduce are insufficiently expressive while low-level tools like MPI and…

Machine Learning · Computer Science 2014-08-12 Yucheng Low , Joseph E. Gonzalez , Aapo Kyrola , Danny Bickson , Carlos E. Guestrin , Joseph Hellerstein

As computer clusters become more common and the size of the problems encountered in the field of AI grows, there is an increasing demand for efficient parallel inference algorithms. We consider the problem of parallel inference on large…

Artificial Intelligence · Computer Science 2012-05-14 Joseph E. Gonzalez , Yucheng Low , Carlos E. Guestrin , David O'Hallaron

This paper considers the problem of distributed optimization over time-varying graphs. For the case of undirected graphs, we introduce a distributed algorithm, referred to as DIGing, based on a combination of a distributed inexact gradient…

Optimization and Control · Mathematics 2017-03-21 Angelia Nedich , Alex Olshevsky , Wei Shi

We present a shared memory implementation of a parallel algorithm, called delta-stepping, for solving the single source shortest path problem for directed and undirected graphs. In order to reduce synchronization costs we make some…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-02-21 M. Kranjčević , D. Palossi , S. Pintarelli

Recent studies show that graph processing systems on a single machine can achieve competitive performance compared with cluster-based graph processing systems. In this paper, we present NXgraph, an efficient graph processing system on a…

Databases · Computer Science 2020-08-10 Yuze Chi , Guohao Dai , Yu Wang , Guangyu Sun , Guoliang Li , Huazhong Yang

Mining large graphs for information is becoming an increasingly important workload due to the plethora of graph structured data becoming available. An aspect of graph algorithms that has hitherto not received much interest is the effect of…

Data Structures and Algorithms · Computer Science 2012-03-27 Amitabha Roy

The scalability and efficiency of graph applications are significantly constrained by conventional systems and their supporting programming models. Technology trends like multicore, manycore, and heterogeneous system architectures are…

Distributed, Parallel, and Cluster Computing · Computer Science 2012-05-22 Chirag Dekate , Matthew Anderson , Maciej Brodowicz , Hartmut Kaiser , Bryce Adelstein-Lelbach , Thomas Sterling