中文
相关论文

相关论文: An Efficient Hardware Accelerator for Structured S…

200 篇论文

Deep Convolutional Neural Networks (CNNs) have become state-of-the art for computer vision and other signal processing tasks due to their superior accuracy. In recent years, large efforts have been made to reduce the computational costs of…

硬件体系结构 · 计算机科学 2021-04-13 Mario Fischer , Juergen Wassner

Sparse training is one of the promising techniques to reduce the computational cost of DNNs while retaining high accuracy. In particular, N:M fine-grained structured sparsity, where only N out of consecutive M elements can be nonzero, has…

机器学习 · 计算机科学 2023-09-25 Chao Fang , Wei Sun , Aojun Zhou , Zhongfeng Wang

Sparsity is a growing trend in modern DNN models. Existing Sparse-Sparse Matrix Multiplication (SpMSpM) accelerators are tailored to a particular SpMSpM dataflow (i.e., Inner Product, Outer Product or Gustavsons), that determines their…

Spiking neural networks (SNNs) recently gained momentum due to their low-power multiplication-free computing and the closer resemblance of biological processes in the nervous system of humans. However, SNNs require very long spike trains…

硬件体系结构 · 计算机科学 2022-06-07 Daniel Gerlinghoff , Zhehui Wang , Xiaozhe Gu , Rick Siow Mong Goh , Tao Luo

Generative Artificial Intelligence (AI) has become incredibly popular in recent years, and the significance of traditional accelerators in dealing with large-scale parameters is urgent. With the diffusion model's parallel structure, the…

硬件体系结构 · 计算机科学 2024-09-27 Huan-Ke Hsu , I-Chyn Wey , T. Hui Teo

Nowadays, increasingly larger Deep Neural Networks (DNNs) are being developed, trained, and utilized. These networks require significant computational resources, putting a strain on both advanced and limited devices. Our solution is to…

We present a novel low latency CMOS hardware accelerator for fully connected (FC) layers in deep neural networks (DNNs). The FC accelerator, FC-ACCL, is based on 128 8x8 or 16x16 processing elements (PEs) for matrix-vector multiplication,…

硬件体系结构 · 计算机科学 2020-11-26 Nick Iliev , Amit Ranjan Trivedi

Weight pruning in deep neural networks (DNNs) can reduce storage and computation cost, but struggles to bring practical speedup to the model inference time. Tensor-cores can significantly boost the throughput of GPUs on dense computation,…

分布式、并行与集群计算 · 计算机科学 2022-03-15 Guyue Huang , Haoran Li , Minghai Qin , Fei Sun , Yufei Ding , Yuan Xie

We propose a new method for creating computationally efficient and compact convolutional neural networks (CNNs) using a novel sparse connection structure that resembles a tree root. This allows a significant reduction in computational cost…

神经与进化计算 · 计算机科学 2020-10-13 Yani Ioannou , Duncan Robertson , Roberto Cipolla , Antonio Criminisi

As neural network model sizes have dramatically increased, so has the interest in various techniques to reduce their parameter counts and accelerate their execution. An active area of research in this field is sparsity - encouraging zero…

A new trans-disciplinary knowledge area, Edge Artificial Intelligence or Edge Intelligence, is beginning to receive a tremendous amount of interest from the machine learning community due to the ever increasing popularization of the…

神经与进化计算 · 计算机科学 2020-06-23 Christiam F. Frasser , Pablo Linares-Serrano , V. Canals , Miquel Roca , T. Serrano-Gotarredona , Josep L. Rossello

Graph Neural Networks (GNNs) have garnered a lot of recent interest because of their success in learning representations from graph-structured data across several critical applications in cloud and HPC. Owing to their unique compute and…

Streaming coarse-grained reconfgurable array (CGRA) is a promising architecture for data/computing-intensive applications because of its fexibility, high throughput and efcient memory system. However,when accelerating sparse CNNs, the…

分布式、并行与集群计算 · 计算机科学 2024-12-17 Xiaobing Ni , Mengke Ge , Jiaheng Ruan , Song Chen , Yi Kang

Neural networks achieve state-of-the-art performance in image classification, speech recognition, scientific analysis and many more application areas. Due to the high computational complexity and memory footprint of neural networks, various…

硬件体系结构 · 计算机科学 2025-04-21 Benjamin Ramhorst , Vladimir Loncar , George A. Constantinides

\textit{Graph Neural Network} (GNN) is a promising approach for analyzing graph-structured data that tactfully captures their dependency information via node-level message passing. It has achieved state-of-the-art performances in many…

机器学习 · 计算机科学 2021-05-05 Feng Shi , Ahren Yiqiao Jin , Song-Chun Zhu

Weight pruning is a technique to make Deep Neural Network (DNN) inference more computationally efficient by reducing the number of model parameters over the course of training. However, most weight pruning techniques generally does not…

机器学习 · 计算机科学 2022-02-03 Bradley McDanel , Helia Dinh , John Magallanes

This paper proposes an ultra-low power, mixed-bit-width sparse convolutional neural network (CNN) accelerator to accelerate ventricular arrhythmia (VA) detection. The chip achieves 50% sparsity in a quantized 1D CNN using a sparse…

硬件体系结构 · 计算机科学 2024-10-24 Yifan Qin , Zhenge Jia , Zheyu Yan , Jay Mok , Manto Yung , Yu Liu , Xuejiao Liu , Wujie Wen , Luhong Liang , Kwang-Ting Tim Cheng , X. Sharon Hu , Yiyu Shi

Convolutional Neural Networks (CNNs) have achieved state-of-the-art accuracy in Synthetic Aperture Radar (SAR) Automatic Target Recognition (ATR). However, their high computational cost, latency, and memory footprint make its deployment…

硬件体系结构 · 计算机科学 2026-03-05 Sachini Wickramasinghe , Tian Ye , Cauligi Raghavendra , Viktor Prasanna

In recent years, Transformer-based language models have become the standard approach for natural language processing tasks. However, stringent throughput and latency requirements in industrial applications are limiting their adoption. To…

Hyperspectral image (HSI) classification has been widely adopted in applications involving remote sensing imagery analysis which require high classification accuracy and real-time processing speed. Methods based on Convolutional neural…

图像与视频处理 · 电气工程与系统科学 2019-08-21 Shuanglong Liu , Ringo S. W. Chu , Xiwei Wang , Wayne Luk