中文
相关论文

相关论文: Loading Large Sparse Matrices Stored in Files in t…

200 篇论文

Despite the importance of sparse matrices in numerous fields of science, software implementations remain difficult to use for non-expert users, generally requiring the understanding of underlying details of the chosen sparse matrix storage…

数学软件 · 计算机科学 2019-07-23 Conrad Sanderson , Ryan Curtin

Sparse matrices and linear algebra are at the heart of scientific simulations. Over the years, more than 70 sparse matrix storage formats have been developed, targeting a wide range of hardware architectures and matrix types, each of which…

分布式、并行与集群计算 · 计算机科学 2023-04-20 Christodoulos Stylianou , Mark Klaisoongnoen , Ricardo Jesus , Nick Brown , Michele Weiland

Modern large language models (LLMs) place extraordinary pressure on memory and compute budgets, making principled compression indispensable for both deployment and continued training. We present Hierarchical Sparse Plus Low-Rank (HSS)…

机器学习 · 计算机科学 2026-01-14 Pawan Kumar , Aditi Gupta

Hierarchical matrices provide a highly memory-efficient way of storing dense linear operators arising, for example, from boundary element methods, particularly when stored in the H^2 format. In such data-sparse representations, iterative…

数值分析 · 数学 2025-09-23 Sven Christophersen

The research in parallel machine scheduling in combinatorial optimization suggests that the desirable parallel efficiency could be achieved when the jobs are sorted in the non-increasing order of processing times. In this paper, we find…

数值分析 · 数学 2012-02-15 Lei Wang , Heng Liang , Fengshan Bai , Yan Huo

Traditional heterogeneous parallel algorithms, designed for heterogeneous clusters of workstations, are based on the assumption that the absolute speed of the processors does not depend on the size of the computational task. This assumption…

分布式、并行与集群计算 · 计算机科学 2011-09-15 Alexey Lastovetsky , Ravi Reddy , Vladimir Rychkov , David Clarke

This article describes a geometric partitioning software that can be used for quick computation of data partitions on many-core HPC machines. It is most suited for dynamic applications with load distributions that vary with time.…

分布式、并行与集群计算 · 计算机科学 2025-08-19 Aparna Sasidharan

Hashing method maps similar data to binary hashcodes with smaller hamming distance, and it has received a broad attention due to its low storage cost and fast retrieval speed. However, the existing limitations make the present algorithms…

计算机视觉与模式识别 · 计算机科学 2016-09-29 Shifeng Zhang , Jianmin Li , Jinma Guo , Bo Zhang

Data-intensive computing has become one of the major workloads on traditional high-performance computing (HPC) clusters. Currently, deploying data-intensive computing software framework on HPC clusters still faces performance and…

分布式、并行与集群计算 · 计算机科学 2015-10-13 Pengfei Xuan , Jeffrey Denton , Rong Ge , Pradip K. Srimani , Feng Luo

Multiresolution Matrix Factorization (MMF) was recently introduced as a method for finding multiscale structure and defining wavelets on graphs/matrices. In this paper we derive pMMF, a parallel algorithm for computing the MMF…

数值分析 · 计算机科学 2015-07-17 Risi Kondor , Nedelina Teneva , Pramod K. Mudrakarta

When implementing functionality which requires sparse matrices, there are numerous storage formats to choose from, each with advantages and disadvantages. To achieve good performance, several formats may need to be used in one program,…

数学软件 · 计算机科学 2019-10-22 Conrad Sanderson , Ryan Curtin

A new format for storing sparse matrices is proposed for efficient sparse matrix-vector (SpMV) product calculation on modern graphics processing units (GPUs). This format extends the standard compressed row storage (CRS) format and can be…

计算物理 · 物理学 2014-04-29 Zbigniew Koza , Maciej Matyka , Sebastian Szkoda , Łukasz Mirosław

Generalized sparse matrix-matrix multiplication is a key primitive for many high performance graph algorithms as well as some linear solvers such as multigrid. We present the first parallel algorithms that achieve increasing speedups for an…

分布式、并行与集群计算 · 计算机科学 2016-08-09 Aydın Buluç , John R. Gilbert

We investigate effects of ordering in blocked matrix--matrix multiplication. We find that submatrices do not have to be stored contiguously in memory to achieve near optimal performance. Instead it is the choice of execution order of the…

数据结构与算法 · 计算机科学 2008-08-15 Nicolas Bock , Emanuel H. Rubensson , Paweł Sałek , Anders M. N. Niklasson , Matt Challacombe

We propose CFS, a distributed file system for large scale container platforms. CFS supports both sequential and random file accesses with optimized storage for both large files and small files, and adopts different replication protocols for…

分布式、并行与集群计算 · 计算机科学 2019-11-11 Haifeng Liu , Wei Ding , Yuan Chen , Weilong Guo , Shuoran Liu , Tianpeng Li , Mofei Zhang , Jianxing Zhao , Hongyin Zhu , Zhengyi Zhu

In this work, we consider the reformulation of hierarchical ($\mathcal{H}$) matrix algorithms for many-core processors with a model implementation on graphics processing units (GPUs). $\mathcal{H}$ matrices approximate specific dense…

分布式、并行与集群计算 · 计算机科学 2017-09-04 Peter Zaspel

Hierarchical matrices are space and time efficient representations of dense matrices that exploit the low rank structure of matrix blocks at different levels of granularity. The hierarchically low rank block partitioning produces…

数据结构与算法 · 计算机科学 2019-02-06 Wajih Halim Boukaram , George Turkiyyah , David E. Keyes

Lossy compression is one of the most efficient solutions to reduce storage overhead and improve I/O performance for HPC applications. However, existing parallel I/O libraries cannot fully utilize lossy compression to accelerate parallel…

分布式、并行与集群计算 · 计算机科学 2022-06-30 Sian Jin , Dingwen Tao , Houjun Tang , Sheng Di , Suren Byna , Zarija Lukic , Franck Cappello

Multiplication of a sparse matrix to a dense matrix (SpDM) is widely used in many areas like scientific computing and machine learning. However, existing works under-look the performance optimization of SpDM on modern many-core…

分布式、并行与集群计算 · 计算机科学 2020-06-01 Shaohuai Shi , Qiang Wang , Xiaowen Chu

We suggest a technique to reduce the storage size of sparse matrices at no loss of information. We call this technique Diagonally-Adressed (DA) storage. It exploits the typically low matrix bandwidth of matrices arising in applications. For…

数值分析 · 数学 2025-01-24 Jens Saak , Jonas Schulze