English
Related papers

Related papers: Hierarchical Matrix Operations on GPUs: Matrix-Vec…

200 papers

A randomized algorithm for computing a compressed representation of a given rank-structured matrix $A \in \mathbb{R}^{N\times N}$ is presented. The algorithm interacts with $A$ only through its action on vectors. Specifically, it draws two…

Numerical Analysis · Mathematics 2024-06-25 James Levitt , Per-Gunnar Martinsson

Scientific workflows are often represented as directed acyclic graphs (DAGs), where vertices correspond to tasks and edges represent the dependencies between them. Since these graphs are often large in both the number of tasks and their…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-07-15 Svetlana Kulagina , Henning Meyerhenke , Anne Benoit

Modern GPGPUs provide massive arithmetic throughput, yet many scientific kernels remain limited by memory bandwidth. In particular, repeatedly loading precomputed auxiliary data wastes abundant compute resources while stressing the memory…

Performance · Computer Science 2025-11-04 Zijian Cao , Qiao Sun , Tiangong Zhang , Huiyuan Li

Efficient and scalable 3D surface reconstruction from range data remains a core challenge in computer graphics and vision, particularly in real-time and resource-constrained scenarios. Traditional volumetric methods based on…

Graphics · Computer Science 2025-11-27 Lorenzo De Rebotti , Emanuele Giacomini , Giorgio Grisetti , Luca Di Giammarino

This paper addresses representational block named Hierarchical-Split Block, which can be taken as a plug-and-play block to upgrade existing convolutional neural networks, improves model performance significantly in a network.…

Computer Vision and Pattern Recognition · Computer Science 2020-10-16 Pengcheng Yuan , Shufei Lin , Cheng Cui , Yuning Du , Ruoyu Guo , Dongliang He , Errui Ding , Shumin Han

Hierarchical clustering over graphs is a fundamental task in data mining and machine learning with applications in domains such as phylogenetics, social network analysis, and information retrieval. Specifically, we consider the recently…

Data Structures and Algorithms · Computer Science 2022-06-16 Arpit Agarwal , Sanjeev Khanna , Huan Li , Prathamesh Patil

Co-clustering simultaneously clusters rows and columns, revealing more fine-grained groups. However, existing co-clustering methods suffer from poor scalability and cannot handle large-scale data. This paper presents a novel and scalable…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-03-20 Zihan Wu , Zhaoke Huang , Hong Yan

The Variable Block Row (VBR) format is an influential blocked sparse matrix format designed for matrices with shared sparsity structure between adjacent rows and columns. VBR groups adjacent rows and columns, storing the resulting blocks…

Data Structures and Algorithms · Computer Science 2023-10-13 Willow Ahrens , Erik G. Boman

Matrix multiplication is the foundation from much of the success from high performance technologies like deep learning, scientific simulations, and video graphics. High level programming languages like Python and R rely on highly optimized…

Performance · Computer Science 2025-09-08 Ethan Davis

Rapid growth in scientific data and a widening gap between computational speed and I/O bandwidth make it increasingly infeasible to store and share all data produced by scientific simulations. Instead, we need methods for reducing data…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-03-02 Jieyang Chen , Lipeng Wan , Xin Liang , Ben Whitney , Qing Liu , David Pugmire , Nicholas Thompson , Matthew Wolf , Todd Munson , Ian Foster , Scott Klasky

The inversion of extremely high order matrices has been a challenging task because of the limited processing and memory capacity of conventional computers. In a scenario in which the data does not fit in memory, it is worth to consider…

Numerical Analysis · Mathematics 2018-05-08 Iria C. S. Cosme , Isaac F. Fernandes , João L. de Carvalho , Samuel Xavier-de-Souza

Graph Convolutional Networks (GCNs) are extensively utilized for deep learning on graphs. The large data sizes of graphs and their vertex features make scalable training algorithms and distributed memory systems necessary. Since the…

Machine Learning · Computer Science 2022-12-14 Gunduz Vehbi Demirci , Aparajita Haldar , Hakan Ferhatosmanoglu

Multiplication of a sparse matrix to a dense matrix (SpDM) is widely used in many areas like scientific computing and machine learning. However, existing works under-look the performance optimization of SpDM on modern many-core…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-06-01 Shaohuai Shi , Qiang Wang , Xiaowen Chu

In this paper, we propose a hierarchical random compression method (HRCM) for kernel matrices in fast kernel summations. The HRCM combines the hierarchical framework of the H-matrix and a randomized sampling technique of the column and row…

Numerical Analysis · Mathematics 2018-03-15 Duan Chen , Wei Cai

The Hierarchical Clustering (HC) problem consists of building a hierarchy of clusters to represent a given dataset. Motivated by the modern large-scale applications, we study the problem in the \streaming model, in which the memory is…

Data Structures and Algorithms · Computer Science 2022-06-16 Sepehr Assadi , Vaggos Chatziafratis , Jakub Łącki , Vahab Mirrokni , Chen Wang

The sparse matrix-vector multiplication (SpMxV) is a kernel operation widely used in iterative linear solvers. The same sparse matrix is multiplied by a dense vector repeatedly in these solvers. Matrices with irregular sparsity patterns…

Numerical Analysis · Computer Science 2012-02-28 Kadir Akbudak , Enver Kayaaslan , Cevdet Aykanat

Rapid growth in scientific data and a widening gap between computational speed and I/O bandwidth makes it increasingly infeasible to store and share all data produced by scientific simulations. Instead, we need methods for reducing data…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-05-28 Jieyang Chen , Lipeng Wan , Xin Liang , Ben Whitney , Qing Liu , Qian Gong , David Pugmire , Nicholas Thompson , Jong Youl Choi , Matthew Wolf , Todd Munson , Ian Foster , Scott Klasky

Standard Gaussian Process (GP) regression, a powerful machine learning tool, is computationally expensive when it is applied to large datasets, and potentially inaccurate when data points are sparsely distributed in a high-dimensional…

Machine Learning · Computer Science 2016-03-08 Z. Zhang , K. Duraisamy , N. A. Gumerov

In recent years, deep learning has led to impressive results in many fields. In this paper, we introduce a multi-scale artificial neural network for high-dimensional non-linear maps based on the idea of hierarchical nested bases in the fast…

Numerical Analysis · Mathematics 2019-02-27 Yuwei Fan , Jordi Feliu-Faba , Lin Lin , Lexing Ying , Leonardo Zepeda-Nunez

This paper presents a new fast iterative solver for large systems involving kernel matrices. Advantageous aspects of H2 matrix approximations and the multigrid method are hybridized to create the H2-MG algorithm. This combination provides…

Numerical Analysis · Mathematics 2025-09-12 Daria Sushnikova , George Turkiyyah , Edmond Chow , David Keyes