English
Related papers

Related papers: CB-SpMV:A Data Aggregating and Balance Algorithm f…

200 papers

We study exact sparse linear regression with an $\ell_0-\ell_2$ penalty and develop a branch-and-bound (BnB) algorithm explicitly designed for GPU execution. Starting from a perspective reformulation, we derive an interval relaxation that…

Optimization and Control · Mathematics 2026-02-05 Xiang Meng , Ryan Lucas , Rahul Mazumder

Sparse Matrix-Matrix Multiplication (SpMM) has served as fundamental components in various domains. Many previous studies exploit GPUs for SpMM acceleration because GPUs provide high bandwidth and parallelism. We point out that a static…

Hardware Architecture · Computer Science 2022-02-18 Guohao Dai , Guyue Huang , Shang Yang , Zhongming Yu , Hengrui Zhang , Yufei Ding , Yuan Xie , Huazhong Yang , Yu Wang

Sparse matrix multiplication (SpGEMM) is a fundamental kernel used in many diverse application areas, both numerical and discrete. For example, many algebraic graph algorithms rely on SpGEMM in the tropical semiring to compute shortest…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-06-01 Alexander van der Grinten , Geert Custers , Duy Le Thanh , Henning Meyerhenke

Singular Value Decomposition (SVD) is a fundamental matrix factorization technique in linear algebra, widely applied in numerous matrix-related problems. However, traditional SVD approaches are hindered by slow panel factorization and…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-08-18 Shifang Liu , Huiyuan Li , Hongjiao Sheng , Haoyuan Gui , Xiaoyu Zhang

Important workloads, such as machine learning and graph analytics applications, heavily involve sparse linear algebra operations. These operations use sparse matrix compression as an effective means to avoid storing zeros and performing…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-10-25 Konstantinos Kanellopoulos , Nandita Vijaykumar , Christina Giannoula , Roknoddin Azizi , Skanda Koppula , Nika Mansouri Ghiasi , Taha Shahroodi , Juan Gomez Luna , Onur Mutlu

Sparse support vector machine (SVM) is a popular classification technique that can simultaneously learn a small set of the most interpretable features and identify the support vectors. It has achieved great successes in many real-world…

Machine Learning · Statistics 2019-07-19 Weizhong Zhang , Bin Hong , Wei Liu , Jieping Ye , Deng Cai , Xiaofei He , Jie Wang

KBLAS is a new open source high performance library that provides optimized kernels for a subset of Level 2 BLAS functionalities on CUDA-enabled GPUs. Since performance of dense matrix-vector multiplication is hindered by the overhead of…

Mathematical Software · Computer Science 2014-10-08 Ahmad Abdelfattah , David Keyes , Hatem Ltaief

Sparse general matrix-matrix multiplication (SpGEMM) is a critical operation in many applications. Current multithreaded implementations are based on Gustavson's algorithm and often perform poorly on large matrices due to limited cache…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-04-11 Jordi Wolfson-Pou , Jan Laukemann , Fabrizio Petrini

In recent years, considerable attention has been devoted to the regularization models due to the presence of high-dimensional data in scientific research. Sparse support vector machine (SVM) are useful tools in high-dimensional data…

Computation · Statistics 2023-12-27 Jiawei Wen

Sparse General Matrix-Matrix Multiplication (SpGEMM) is a fundamental operation in numerous scientific computing and data analytics applications, often bottlenecked by irregular memory access patterns. This paper presents Hash based…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-12-16 Shiju Li , Younghoon Min , Hane Yie , Hoshik Kim , Soohong Ahn , Joonseop Sim , Chul-Ho Lee , Jongryool Kim

Sparse coding (SC) is attracting more and more attention due to its comprehensive theoretical studies and its excellent performance in many signal processing applications. However, most existing sparse coding algorithms are nonconvex and…

Machine Learning · Computer Science 2017-09-12 Xiaodong Feng , Zhiwei Tang , Sen Wu

This work evaluates the impact of sparse matrix reordering on the performance of sparse matrix-vector multiplication across different multicore CPU platforms. Reordering can significantly enhance performance by optimizing the non-zero…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-09-23 Omid Asudeh , Sina Mahdipour Saravani , Gerald Sabin , Fabrice Rastello , P Sadayappan

Large language models (LLMs) face significant inference latency due to inefficiencies in GEMM operations, weight access, and KV cache access, especially in real-time scenarios. This highlights the need for a versatile compute-memory…

Hardware Architecture · Computer Science 2025-09-15 Huizheng Wang , Zichuan Wang , Zhiheng Yue , Yousheng Long , Taiquan Wei , Jianxun Yang , Yang Wang , Chao Li , Shaojun Wei , Yang Hu , Shouyi Yin

In this paper, we focus on three sparse matrix operations that are relevant for machine learning applications, namely, the sparse-dense matrix multiplication (SPMM), the sampled dense-dense matrix multiplication (SDDMM), and the composition…

Machine Learning · Computer Science 2023-11-02 Mohammad Zubair , Christoph Bauinger

Cascade SVM (CSVM) can group datasets and train subsets in parallel, which greatly reduces the training time and memory consumption. However, the model accuracy obtained by using this method has some errors compared with direct training. In…

Machine Learning · Computer Science 2022-03-14 Yi Cheng , Liu , XiaoYan , Liu

Kernel-based methods for support vector machines (SVM) have shown highly advantageous performance in various applications. However, they may incur prohibitive computational costs for large-scale sample datasets. Therefore, data reduction…

Optimization and Control · Mathematics 2021-04-27 Shenglong Zhou

Sparse representation of a single measurement vector (SMV) has been explored in a variety of compressive sensing applications. Recently, SMV models have been extended to solve multiple measurement vectors (MMV) problems, where the…

Optimization and Control · Mathematics 2020-08-25 Jing Qin , Shuang Li , Deanna Needell , Anna Ma , Rachel Grotheer , Chenxi Huang , Natalie Durgin

We present a novel parallel algorithm for cloth simulation that exploits multiple GPUs for fast computation and the handling of very high resolution meshes. To accelerate implicit integration, we describe new parallel algorithms for sparse…

Graphics · Computer Science 2020-08-05 Cheng Li , Min Tang , Ruofeng Tong , Ming Cai , Jieyi Zhao , Dinesh Manocha

A multiply-accumulate (MAC) operation is the main computation unit for DSP applications. DSP blocks are one of the efficient solutions to implement MACs in FPGA's. However, since the DSP blocks have wide multiplier and adder blocks, MAC…

Hardware Architecture · Computer Science 2021-10-26 Ercan Kalali , Rene van Leuken

Architectures with multiple classes of memory media are becoming a common part of mainstream supercomputer deployments. So called multi-level memories offer differing characteristics for each memory component including variation in…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-04-04 Mehmet Deveci , Simon D. Hammond , Michael M. Wolf , Sivasankaran Rajamanickam