中文
相关论文

相关论文: A Parallel Scan Algorithm in the Tensor Core Unit …

200 篇论文

Driven by deep learning, there has been a surge of specialized processors for matrix multiplication, referred to as TensorCore Units (TCUs). These TCUs are capable of performing matrix multiplications on small matrices (usually 4x4 or…

性能 · 计算机科学 2019-11-26 Abdul Dakkak , Cheng Li , Isaac Gelado , Jinjun Xiong , Wen-mei Hwu

To respond to the need of efficient training and inference of deep neural networks, a plethora of domain-specific hardware architectures have been introduced, such as Google Tensor Processing Units and NVIDIA Tensor Cores. A common feature…

数据结构与算法 · 计算机科学 2020-07-10 Rezaul Chowdhury , Francesco Silvestri , Flavio Vella

We design and implement parallel prefix sum (scan) algorithms using Ascend AI accelerators. Ascend accelerators feature specialized computing units: the cube units for efficient matrix multiplication and the vector units for optimized…

分布式、并行与集群计算 · 计算机科学 2026-01-05 Bartłomiej Wróblewski , Gioele Gottardo , Anastasios Zouzias

Tensor Core Units (TCUs) are hardware accelerators developed for deep neural networks, which efficiently support the multiplication of two dense $\sqrt{m}\times \sqrt{m}$ matrices, where $m$ is a given hardware parameter. In this paper, we…

数据结构与算法 · 计算机科学 2020-06-24 Thomas D. Ahle , Francesco Silvestri

We present efficient and scalable parallel algorithms for performing mathematical operations for low-rank tensors represented in the tensor train (TT) format. We consider algorithms for addition, elementwise multiplication, computing norms…

数值分析 · 数学 2021-09-08 Hussam Al Daas , Grey Ballard , Peter Benner

We have repurposed Google Tensor Processing Units (TPUs), application-specific chips developed for machine learning, into large-scale dense linear algebra supercomputers. The TPUs' fast inter-core interconnects (ICI)s, physically…

Linear-scaling electronic-structure techniques, also called O(N) techniques, rely heavily on the multiplication of sparse matrices, where the sparsity arises from spatial cut-offs. In order to treat very large systems, the calculations must…

材料科学 · 物理学 2009-10-31 D. R. Bowler , T. Miyazaki , M. J. Gillan

SCAN (Structural Clustering Algorithm for Networks) is a well-studied, widely used graph clustering algorithm. For large graphs, however, sequential SCAN variants are prohibitively slow, and parallel SCAN variants do not effectively share…

数据库 · 计算机科学 2021-04-01 Tom Tseng , Laxman Dhulipala , Julian Shun

In this paper we describe a parallel Gaussian elimination algorithm for matrices with entries in a finite field. Unlike previous approaches, our algorithm subdivides a very large input matrix into smaller submatrices by subdividing both…

环与代数 · 数学 2018-06-13 Stephen Linton , Gabriele Nebe , Alice Niemeyer , Richard Parker , Jon Thackray

Sparse general matrix-matrix multiplication (spGEMM) is an essential component in many scientific and data analytics applications. However, the sparsity pattern of the input matrices and the interaction of their patterns make spGEMM…

数学软件 · 计算机科学 2020-10-01 Orestis Zachariadis , Nitin Satpute , Juan Gómez-Luna , Joaquín Olivares

The DBSCAN method for spatial clustering has received significant attention due to its applicability in a variety of data analysis tasks. There are fast sequential algorithms for DBSCAN in Euclidean space that take $O(n\log n)$ work for two…

数据结构与算法 · 计算机科学 2021-01-29 Yiqiu Wang , Yan Gu , Julian Shun

Designing problems using matrices is very important in Computer Science. Fields like graph computer, graphs theory, and machine learning use matrices very often to solve their own problems. The most often matrix operation is the…

性能 · 计算机科学 2019-05-10 Andre G. C. Pacheco

Machine Learning approaches like clustering methods deal with massive datasets that present an increasing challenge. We devise parallel algorithms to compute the Multi-Slice Clustering (MSC) for 3rd-order tensors. The MSC method is based on…

分布式、并行与集群计算 · 计算机科学 2023-10-02 Dina Faneva Andriantsiory , Camille Coti , Joseph Ben Geloun , Mustapha Lebbah

The Linear Combination of Unitaries (LCU) method is a powerful scheme for the block encoding of operators but suffers from high overheads. In this work, we discuss the parallelisation of LCU and in particular the SELECT subroutine of LCU…

量子物理 · 物理学 2024-08-22 Gregory Boyd

The tensor-train (TT) decomposition expresses a tensor in a data-sparse format used in molecular simulations, high-order correlation functions, and optimization. In this paper, we propose four parallelizable algorithms that compute the TT…

数值分析 · 数学 2021-11-23 Tianyi Shi , Maximilian Ruth , Alex Townsend

Parallel tensor network contraction algorithms have emerged as the pivotal benchmarks for assessing the classical limits of computation, exemplified by Google's demonstration of quantum supremacy through random circuit sampling. However,…

信息论 · 计算机科学 2024-05-24 Jin Lee , Sofia Gonzalez-Garcia , Zheng Zhang , Haewon Jeong

We propose a new parallel framework for fast computation of inverse and forward dynamics of articulated robots based on prefix sums (scans). We re-investigate the well-known recursive Newton-Euler formulation of robot dynamics and show that…

机器人学 · 计算机科学 2016-09-16 Yajue Yang , Yuanqing Wu , Jia Pan

We show that a particular class of parallel algorithm for linear functions can be straightforwardly generalized to a parallel algorithm of their tensor product. The central idea is to take a model of parallel algorithms -- Bulk Synchronous…

范畴论 · 数学 2025-10-02 Thomas Koopman , Rob H. Bisseling , Sven-Bodo Scholz

In this paper, we present a concurrent implementation of a powerful topological thinning operator. This operator is able to act directly over grayscale images without modifying their topology. We introduce an adapted parallelization…

分布式、并行与集群计算 · 计算机科学 2016-03-31 Ramzi Mahmoudi , Mohamed Akil , Petr Matas

The Massive Parallel Computation (MPC) model is a theoretical framework for popular parallel and distributed platforms such as MapReduce, Hadoop, or Spark. We consider the task of computing a large matching or small vertex cover in this…

数据结构与算法 · 计算机科学 2018-07-24 Krzysztof Onak
‹ 上一页 1 2 3 10 下一页 ›