English
Related papers

Related papers: Accelerating the SpMV kernel on standard CPUs by e…

200 papers

We contribute a third-party survey of sparse matrix-vector (SpMV) product performance on industrial-strength, large matrices using: (1) The SpMV implementations in Intel MKL, the Trilinos project (Tpetra subpackage), the CUSPARSE library,…

Performance · Computer Science 2016-08-03 Max Grossman , Christopher Thiele , Mauricio Araya-Polo , Florian Frank , Faruk O. Alpak , Vivek Sarkar

Sparse Matrix-Matrix multiplication is a key kernel that has applications in several domains such as scientific computing and graph analysis. Several algorithms have been studied in the past for this foundational kernel. In this paper, we…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-01-10 Mehmet Deveci , Christian Trott , Sivasankaran Rajamanickam

Sparse Matrix-Matrix Multiplication (SpMM) is a fundamental computation in graph analytics, scientific simulation, and sparse deep learning workloads. However, the extreme irregularity of real-world sparse matrices prevents existing…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-03-11 Aiying Li , Jingwei Sun , Han Li , Wence Ji , Guangzhong Sun

We present a novel approach for accelerating convolutions during inference for CPU-based architectures. The most common method of computation involves packing the image into the columns of a matrix (im2col) and performing general matrix…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Amir Ofir , Gil Ben-Artzi

The sparse matrix/vector product (SpMV) is a fundamental operation in scientific computing. Having access to an efficient SpMV implementation is therefore critical, if not mandatory, to solve challenging numerical problems. The ARM-based…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-07-28 Evann Regnault , Berenger Bramas

Sparse Matrix-Vector Multiplication (SpMV) is the cornerstone in many iterative workloads, including large-scale graph analytics and sparse iterative solvers. Accelerating SpMV on real-world graphs remains challenging due to highly…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-11 Qi Zhang , Zhengan Yao , Zhenglu Jiang , Zan-Bo Zhang

We present a distributed-memory library for computations with dense structured matrices. A matrix is considered structured if its off-diagonal blocks can be approximated by a rank-deficient matrix with low numerical rank. Here, we use…

Mathematical Software · Computer Science 2015-06-29 François-Henry Rouet , Xiaoye S. Li , Pieter Ghysels , Artem Napov

Field Programmable Gate Arrays generate algorithmic specific architectures that improve the code's FLOP per watt ratio. Such devices are re-gaining interest due to the rise of new tools that facilitate their programming, such as OmpSs. The…

Computational Physics · Physics 2021-07-28 Guillermo Oyarzun , Daniel Peyrolon , Carlos Alvarez , Xavier Martorell

Sparse matrix-vector multiplication (SpMV) multiplies a sparse matrix with a dense vector. SpMV plays a crucial role in many applications, from graph analytics to deep learning. The random memory accesses of the sparse matrix make…

Hardware Architecture · Computer Science 2022-05-10 Linghao Song , Yuze Chi , Licheng Guo , Jason Cong

General sparse matrix-matrix multiplication (SpGEMM) is a fundamental building block for numerous applications such as algebraic multigrid method (AMG), breadth first search and shortest path problem. Compared to other sparse BLAS routines,…

Mathematical Software · Computer Science 2015-09-15 Weifeng Liu , Brian Vinter

Hamiltonian simulation is a key workload in quantum computing, enabling the study of complex quantum systems and serving as a critical tool for classical verification of quantum devices. However, it is computationally challenging because…

Hardware Architecture · Computer Science 2025-10-31 Yuchao Su , Srikar Chundury , Jiajia Li , Frank Mueller

Sparse matrix-sparse matrix multiplication (SpGEMM) is a key kernel in many scientific applications and graph workloads. Unfortunately, SpGEMM is bottlenecked by data movement due to its irregular memory access patterns. Significant work…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-07-30 Abdullah Al Raqibul Islam , Helen Xu , Dong Dai , Aydın Buluç

Sparse matrices, more specifically SpGEMM kernels, are commonly found in a wide range of applications, spanning graph-based path-finding to machine learning algorithms (e.g., neural networks). A particular challenge in implementing SpGEMM…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-06-01 Kaustubh Shivdikar

HipMCL is a high-performance distributed memory implementation of the popular Markov Cluster Algorithm (MCL) and can cluster large-scale networks within hours using a few thousand CPU-equipped nodes. It relies on sparse matrix computations…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-02-26 Oguz Selvitopi , Md Taufique Hussain , Ariful Azad , Aydın Buluç

The Sparse GEneral Matrix-Matrix multiplication (SpGEMM) $C = A \times B$ is a fundamental routine extensively used in domains like machine learning or graph analytics. Despite its relevance, the efficient execution of SpGEMM on vector…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-06-05 Valentin Le Fèvre , Marc Casas

High-performance sparse matrix-matrix (SpMM) multiplication is paramount for science and industry, as the ever-increasing sizes of data prohibit using dense data structures. Yet, existing hardware, such as Tensor Cores (TC), is ill-suited…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-08-22 Patrik Okanovic , Grzegorz Kwasniewski , Paolo Sylos Labini , Maciej Besta , Flavio Vella , Torsten Hoefler

Multiplication of a sparse matrix to a dense matrix (SpDM) is widely used in many areas like scientific computing and machine learning. However, existing works under-look the performance optimization of SpDM on modern many-core…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-06-01 Shaohuai Shi , Qiang Wang , Xiaowen Chu

Many recent GPUs feature matrix multiplication engines (aka Tensor Core Units or TCUs) that perform small fixed-size matrix-matrix products at very high throughput. They have been used very effectively to speed up dense matrix-matrix…

Performance · Computer Science 2025-11-25 Lizhi Xiang , Omid Asudeh , Gerald Sabin , Aravind Sukumaran-Rajam , P. Sadayappan

Recently, graphics processors (GPUs) have been increasingly leveraged in a variety of scientific computing applications. However, architectural differences between CPUs and GPUs necessitate the development of algorithms that take advantage…

Mathematical Software · Computer Science 2015-01-05 Jonathan Wong , Ellen Kuhl , Eric Darve

Owing to the diverse scales and varying distributions of sparse matrices arising from practical problems, a multitude of choices are present in the design and implementation of sparse matrix-vector multiplication (SpMV). Researchers have…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-11-18 Jianhua Gao , Bingjie Liu , Yizhuo Wang , Weixing Ji , Hua Huang