中文
相关论文

相关论文: Loading Large Sparse Matrices Stored in Files in t…

200 篇论文

Spark is an in-memory analytics platform that targets commodity server environments today. It relies on the Hadoop Distributed File System (HDFS) to persist intermediate checkpoint states and final processing results. In Spark, immutable…

分布式、并行与集群计算 · 计算机科学 2017-08-22 Mijung Kim , Jun Li , Haris Volos , Manish Marwah , Alexander Ulanov , Kimberly Keeton , Joseph Tucek , Lucy Cherkasova , Le Xu , Pradeep Fernando

With lowrank approximation the storage requirements for dense data are reduced down to linear complexity and with the addition of hierarchy this also works for data without global lowrank properties. However, the lowrank factors itself are…

数学软件 · 计算机科学 2023-08-23 Ronald Kriemann

In recent years, considerable attention has been devoted to the regularization models due to the presence of high-dimensional data in scientific research. Sparse support vector machine (SVM) are useful tools in high-dimensional data…

统计计算 · 统计学 2023-12-27 Jiawei Wen

HPC-based applications often have complex workflows with many software dependencies that hinder their portability on contemporary HPC architectures. In addition, these applications often require extraordinary efforts to deploy and execute…

分布式、并行与集群计算 · 计算机科学 2023-12-14 Sameh Abdulah , Jorge Ejarque , Omar Marzouk , Hatem Ltaief , Ying Sun , Marc G. Genton , Rosa M. Badia , David E. Keyes

Associative memories are structures that store data patterns and retrieve them given partial inputs. Sparse Clustered Networks (SCNs) are recently-introduced binary-weighted associative memories that significantly improve the storage and…

神经与进化计算 · 计算机科学 2016-11-18 Hooman Jarollahi , Naoya Onizawa , Takahiro Hanyu , Warren J. Gross

Iterative methods for solving large sparse systems of linear equations are widely used in many HPC applications. Extreme scaling of these methods can be difficult, however, since global communication to form dot products is typically…

数学软件 · 计算机科学 2020-09-29 Nick Brown , J. Mark Bull , Iain Bethune

In this paper, an efficient divide-and-conquer (DC) algorithm is proposed for the symmetric tridiagonal matrices based on ScaLAPACK and the hierarchically semiseparable (HSS) matrices. HSS is an important type of rank-structured…

数学软件 · 计算机科学 2016-12-27 Shengguo Li , Francois-Henry Rouet , Jie Liu , Chun Huang , Xingyu Gao , Xuebin Chi

Sparse matrix ordering is a vital optimization technique often employed for solving large-scale sparse matrices. Its goal is to minimize the matrix bandwidth by reorganizing its rows and columns, thus enhancing efficiency. Conventional…

分布式、并行与集群计算 · 计算机科学 2025-11-14 Tao Tang , Youfu Jiang , Yingbo Cui , Jianbin Fang , Peng Zhang , Lin Peng , Chun Huang

Large-scale machine learning (ML) models are increasingly being used in critical domains like education, lending, recruitment, healthcare, criminal justice, etc. However, the training, deployment, and utilization of these models demand…

机器学习 · 计算机科学 2025-03-31 Ding Zhu , Zhiqun Zuo , Mohammad Mahdi Khalili

Hadoop is an open source implementation of the MapReduce Framework in the realm of distributed processing. A Hadoop cluster is a unique type of computational cluster designed for storing and analyzing large data sets across cluster of…

分布式、并行与集群计算 · 计算机科学 2014-11-10 Muralikrishnan Ramane , Sharmila Krishnamoorthy , Sasikala Gowtham

Storage systems are essential building blocks for cloud computing infrastructures. Although high performance storage servers are the ultimate solution for cloud storage, the implementation of inexpensive storage system remains an open…

分布式、并行与集群计算 · 计算机科学 2011-12-30 Julia Myint , Thinn Thu Naing

Matrix factorization is a common machine learning technique for recommender systems. Despite its high prediction accuracy, the Bayesian Probabilistic Matrix Factorization algorithm (BPMF) has not been widely used on large scale data because…

分布式、并行与集群计算 · 计算机科学 2017-05-12 Tom Vander Aa , Imen Chakroun , Tom Haber

This paper proposes a hierarchical adaptive sampling scheme for passivity characterization of large-scale linear lumped macromodels. Here, large-scale is intended both in terms of dynamic order and especially number of input/output ports.…

计算工程、金融与科学 · 计算机科学 2020-11-06 Marco De Stefano , Stefano Grivet-Talocia , Torben Wendt , Cheng Yang , Christian Schuster

Bytewise approximate matching algorithms have in recent years shown significant promise in de- tecting files that are similar at the byte level. This is very useful for digital forensic investigators, who are regularly faced with the…

密码学与安全 · 计算机科学 2022-11-15 David Lillis , Frank Breitinger , Mark Scanlon

The matrices used in many computational settings are naturally sparse, holding a small percentage of nonzero elements. Storing such matrices in specialized sparse formats enables algorithms that avoid wasting computation on zeros,…

分布式、并行与集群计算 · 计算机科学 2026-02-13 Pratyush Das , Amirhossein Basareh , Adhitha Dias , Artem Pelenitsyn , Kirshanthan Sundararajah , Milind Kulkarni , Ben Delaware

Artificial intelligence (AI) application domains consist of a mix of tensor operations with high and low arithmetic intensities (aka reuse). Hierarchical (i.e. compute along multiple levels of memory hierarchy) and heterogeneous (multiple…

分布式、并行与集群计算 · 计算机科学 2025-02-19 Raveesh Garg , Michael Pellauer , Tushar Krishna

Matrix-vector multiplication forms the basis of many iterative solution algorithms and as such is an important algorithm also for hierarchical matrices which are used to represent dense data in an optimized form by applying low-rank…

分布式、并行与集群计算 · 计算机科学 2026-01-30 Ronald Kriemann

Partitioning graphs into blocks of roughly equal size such that few edges run between blocks is a frequently needed operation when processing graphs on a parallel computer. When a topology of a distributed system is known an important task…

Reservoir computing systems rely on the recurrent multiplication of a very large, sparse, fixed matrix. We argue that direct spatial implementation of these fixed matrices minimizes the work performed in the computation, and allows for…

硬件体系结构 · 计算机科学 2021-01-25 Matthew Denton , Herman Schmit

Sparse Matrix-Matrix multiplication is a key kernel that has applications in several domains such as scientific computing and graph analysis. Several algorithms have been studied in the past for this foundational kernel. In this paper, we…

分布式、并行与集群计算 · 计算机科学 2018-01-10 Mehmet Deveci , Christian Trott , Sivasankaran Rajamanickam