English
Related papers

Related papers: Computing Sparse Tensor Decompositions via Chapel …

200 papers

Given an array $\mathcal{A}$ of $n$ elements and a value $2 \leq k \leq n$, a frequent item or $k$-majority element is an element occurring in $\mathcal{A}$ more than $n/k$ times. The $k$-majority problem requires finding all of the…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-01-12 Massimo Cafaro , Marco Pulimeno , Italo Epicoco , Giovanni Aloisio

We consider a sparse matrix-matrix multiplication (SpGEMM) setting where one matrix is square and the other is tall and skinny. This special variant, called TS-SpGEMM, has important applications in multi-source breadth-first search,…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-08-23 Isuru Ranawaka , Md Taufique Hussain , Charles Block , Gerasimos Gerogiannis , Josep Torrellas , Ariful Azad

The DenseNet architecture is highly computationally efficient as a result of feature reuse. However, a naive DenseNet implementation can require a significant amount of GPU memory: If not properly managed, pre-activation batch normalization…

Computer Vision and Pattern Recognition · Computer Science 2017-07-24 Geoff Pleiss , Danlu Chen , Gao Huang , Tongcheng Li , Laurens van der Maaten , Kilian Q. Weinberger

Sparse Matrix-Matrix Multiplication (SpMM) is a fundamental computation in graph analytics, scientific simulation, and sparse deep learning workloads. However, the extreme irregularity of real-world sparse matrices prevents existing…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-03-11 Aiying Li , Jingwei Sun , Han Li , Wence Ji , Guangzhong Sun

Applications to process seismic data employ scalable parallel systems to produce timely results. To fully exploit emerging processor architectures, application will need to employ threaded parallelism within a node and message passing…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-03-15 Sri Raj Paul , John Mellor-Crummey , Mauricio Araya-Polo , Detlef Hohl

The Tucker decomposition generalizes the notion of Singular Value Decomposition (SVD) to tensors, the higher dimensional analogues of matrices. We study the problem of constructing the Tucker decomposition of sparse tensors on distributed…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-01-22 Venkatesan T. Chakaravarthy , Jee W. Choi , Douglas J. Joseph , Prakash Murali , Shivmaran S. Pandian , Yogish Sabharwal , Dheeraj Sreedhar

Sparse Matrix-Matrix Multiplication (SpMM) is a fundamental operation in graph computing and analytics. However, the irregularity of real-world graphs poses significant challenges to achieving efficient SpMM operation for graph data on…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-12-13 Zhonggen Li , Xiangyu Ke , Yifan Zhu , Yunjun Gao , Yaofeng Tu

Nowadays, analyzing and reducing the ever larger astronomical datasets is becoming a crucial challenge, especially for long cumulated observation times. The INTEGRAL/SPI X-gamma-ray spectrometer is an instrument for which it is essential to…

Instrumentation and Methods for Astrophysics · Physics 2013-05-27 L. Bouchet , P. Amestoy , A. Buttari , F. -H. Rouet , M. Chauvin

Sparse-dense linear algebra is crucial in many domains, but challenging to handle efficiently on CPUs, GPUs, and accelerators alike; multiplications with sparse formats like CSR and CSF require indirect memory lookups. In this work, we…

Hardware Architecture · Computer Science 2020-12-15 Paul Scheffler , Florian Zaruba , Fabian Schuiki , Torsten Hoefler , Luca Benini

Intel Xeon Phi is a recently released high-performance coprocessor which features 61 cores each supporting 4 hardware threads with 512-bit wide SIMD registers achieving a peak theoretical performance of 1Tflop/s in double precision. Many…

Performance · Computer Science 2013-02-06 Erik Saule , Kamer Kaya , Umit V. Catalyurek

We introduce an approach for the real-time (2Hz) creation of a dense map and alignment of a moving robotic agent within that map by rendering using a Graphics Processing Unit (GPU). This is done by recasting the scan alignment part of the…

Computer Vision and Pattern Recognition · Computer Science 2017-02-23 Julian Ryde , Xuchu , Ding

Sparse matrix-vector multiplication (SpMV) operations are commonly used in various scientific applications. The performance of the SpMV operation often depends on exploiting regularity patterns in the matrix. Various representations have…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-07-25 Karan Aggarwal , Uday Bondhugula

We introduce Nerva, a fast neural network library under development in C++. It supports sparsity by using the sparse matrix operations of Intel's Math Kernel Library (MKL), which eliminates the need for binary masks. We show that Nerva…

Machine Learning · Computer Science 2024-07-25 Wieger Wesselink , Bram Grooten , Qiao Xiao , Cassio de Campos , Mykola Pechenizkiy

Neural networks with a latency requirement on the order of microseconds, like the ones used at the CERN Large Hadron Collider, are typically deployed on FPGAs fully unrolled and pipelined. A bottleneck for the deployment of such neural…

Hardware Architecture · Computer Science 2026-04-27 Chang Sun , Zhiqiang Que , Vladimir Loncar , Wayne Luk , Maria Spiropulu

Sparse tensors are prevalent in real-world applications, often characterized by their large-scale, high-order, and high-dimensional nature. Directly handling raw tensors is impractical due to the significant memory and computational…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-05-24 Zixuan Li , Mingxing Duan , Huizhang Luo , Wangdong Yang , Kenli Li , Keqin Li

Matrix-multiply-accumulate (MMA) units, or tensor cores, are now widespread across modern computing architectures. Yet, their use for particle-grid operators remains limited. In implicit particle methods, mass-matrix assembly is a…

Computational Engineering, Finance, and Science · Computer Science 2026-04-22 Luca Pennati , Stefano Markidis

Sparse tiling is a technique to fuse loops that access common data, thus increasing data locality. Unlike traditional loop fusion or blocking, the loops may have different iteration spaces and access shared datasets through indirect memory…

Computational Engineering, Finance, and Science · Computer Science 2019-06-20 Fabio Luporini , Michael Lange , Christian T. Jacobs , Gerard J. Gorman , J. Ramanujam , Paul H. J. Kelly

This paper presents a code generator for sparse tensor contraction computations. It leverages a mathematical representation of loop nest computations in the sparse polyhedral framework (SPF), which extends the polyhedral model to support…

Programming Languages · Computer Science 2022-08-26 Tuowen Zhao , Tobi Popoola , Mary Hall , Catherine Olschanowsky , Michelle Mills Strout

Generalized sparse matrix-matrix multiplication is a key primitive for many high performance graph algorithms as well as some linear solvers such as multigrid. We present the first parallel algorithms that achieve increasing speedups for an…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-08-09 Aydın Buluç , John R. Gilbert

Processing massive application graphs on distributed memory systems requires to map the graphs onto the system's processing elements (PEs). This task becomes all the more important when PEs have non-uniform communication costs or the input…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-07-07 Maria Predari , Charilaos Tzovas , Christian Schulz , Henning Meyerhenke