English
Related papers

Related papers: SPRING: A Sparsity-Aware Reduced-Precision Monolit…

200 papers

Introducing sparsity in a neural network has been an efficient way to reduce its complexity while keeping its performance almost intact. Most of the time, sparsity is introduced using a three-stage pipeline: 1) train the model to…

Computer Vision and Pattern Recognition · Computer Science 2022-07-05 Nathan Hubens , Matei Mancas , Bernard Gosselin , Marius Preda , Titus Zaharia

We propose GrateTile, an efficient, hardwarefriendly data storage scheme for sparse CNN feature maps (activations). It divides data into uneven-sized subtensors and, with small indexing overhead, stores them in a compressed yet randomly…

Machine Learning · Computer Science 2020-09-21 Yu-Sheng Lin , Hung Chang Lu , Yang-Bin Tsao , Yi-Min Chih , Wei-Chao Chen , Shao-Yi Chien

Sparse neural networks have been widely applied to reduce the computational demands of training and deploying over-parameterized deep neural networks. For inference acceleration, methods that discover a sparse network from a pre-trained…

Machine Learning · Computer Science 2021-06-16 Shiwei Liu , Decebal Constantin Mocanu , Yulong Pei , Mykola Pechenizkiy

Convolutional neural networks (CNNs) are now the de facto solution for computer vision problems thanks to their impressive results and ease of learning. These networks are composed of layers of connected units called artificial neurons,…

Computer Vision and Pattern Recognition · Computer Science 2021-04-27 Loïc Cordone , Benoît Miramond , Sonia Ferrante

This paper proposes a new hardware accelerator for sparse convolutional neural networks (CNNs) by building a hardware unit to perform the Image to Column (IM2COL) transformation of the input feature map coupled with a systolic array-based…

Hardware Architecture · Computer Science 2021-11-29 Mohammadreza Soltaniyeh , Richard P. Martin , Santosh Nagarakatte

Ultra-fast \& low-power superconductor single-flux-quantum (SFQ)-based CNN systolic accelerators are built to enhance the CNN inference throughput. However, shift-register (SHIFT)-based scratchpad memory (SPM) arrays prevent a SFQ CNN…

Hardware Architecture · Computer Science 2021-09-06 Farzaneh Zokaee , Lei Jiang

Semantic segmentation is the task to cluster pixels on an image belonging to the same class. It is widely used in the real-world applications including autonomous driving, medical imaging analysis, industrial inspection, smartphone camera…

Computer Vision and Pattern Recognition · Computer Science 2021-01-27 Baohua Sun , Weixiong Lin , Hao Sha , Jiapeng Su

Weight pruning is a technique to make Deep Neural Network (DNN) inference more computationally efficient by reducing the number of model parameters over the course of training. However, most weight pruning techniques generally does not…

Machine Learning · Computer Science 2022-02-03 Bradley McDanel , Helia Dinh , John Magallanes

Deep neural networks generate and process large volumes of data, posing challenges for low-resource embedded systems. In-memory computing has been demonstrated as an efficient computing infrastructure and shows promise for embedded AI…

Emerging Technologies · Computer Science 2025-07-03 Benjamin Chen Ming Choong , Tao Luo , Cheng Liu , Bingsheng He , Wei Zhang , Joey Tianyi Zhou

Weight pruning has been widely acknowledged as a straightforward and effective method to eliminate redundancy in Deep Neural Networks (DNN), thereby achieving acceleration on various platforms. However, most of the pruning techniques are…

Computer Vision and Pattern Recognition · Computer Science 2020-07-07 Xiaolong Ma , Wei Niu , Tianyun Zhang , Sijia Liu , Sheng Lin , Hongjia Li , Xiang Chen , Jian Tang , Kaisheng Ma , Bin Ren , Yanzhi Wang

Resource efficiency plays an important role for machine learning nowadays. The energy and decision latency are two critical aspects to ensure a sustainable and practical application. Unfortunately, the energy consumption and decision…

Cryptography and Security · Computer Science 2024-03-28 Andreas Müller , Erwin Quiring

Sparsity in Deep Neural Networks (DNNs) has been widely studied to compress and accelerate the models on resource-constrained environments. It can be generally categorized into unstructured fine-grained sparsity that zeroes out multiple…

Computer Vision and Pattern Recognition · Computer Science 2021-04-20 Aojun Zhou , Yukun Ma , Junnan Zhu , Jianbo Liu , Zhijie Zhang , Kun Yuan , Wenxiu Sun , Hongsheng Li

Dynamic Sparse Training (DST) methods achieve state-of-the-art results in sparse neural network training, matching the generalization of dense models while enabling sparse training and inference. Although the resulting models are highly…

Machine Learning · Computer Science 2024-02-23 Mike Lasby , Anna Golubeva , Utku Evci , Mihai Nica , Yani Ioannou

Convolutional neural networks (CNNs) achieve remarkable performance in a wide range of fields. However, intensive memory access of activations introduces considerable energy consumption, impeding deployment of CNNs on resourceconstrained…

Computer Vision and Pattern Recognition · Computer Science 2021-10-19 Yu-Shan Tai , Chieh-Fang Teng , Cheng-Yang Chang , An-Yeu Wu

Bayesian Neural Networks (BNNs) provide principled estimates of model and data uncertainty by encoding parameters as distributions. This makes them key enablers for reliable AI that can be deployed on safety critical edge systems. These…

Emerging Technologies · Computer Science 2024-11-13 Prabodh Katti , Bashir M. Al-Hashimi , Bipin Rajendran

Recently, a new trend of exploring sparsity for accelerating neural network training has emerged, embracing the paradigm of training on the edge. This paper proposes a novel Memory-Economic Sparse Training (MEST) framework targeting for…

Convolutional neural networks (CNNs) perform well on problems such as handwriting recognition and image classification. However, the performance of the networks is often limited by budget and time constraints, particularly when trying to…

Computer Vision and Pattern Recognition · Computer Science 2014-09-23 Benjamin Graham

Scientific workloads have traditionally exploited high levels of sparsity to accelerate computation and reduce memory requirements. While deep neural networks can be made sparse, achieving practical speedups on GPUs is difficult because…

Machine Learning · Computer Science 2020-09-02 Trevor Gale , Matei Zaharia , Cliff Young , Erich Elsen

The advent of sparsity inducing techniques in neural networks has been of a great help in the last few years. Indeed, those methods allowed to find lighter and faster networks, able to perform more efficiently in resource-constrained…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Nathan Hubens , Victor Delvigne , Matei Mancas , Bernard Gosselin , Marius Preda , Titus Zaharia

Spiking Neural Networks (SNNs) are promising biologically plausible models of computation which utilize a spiking binary activation function similar to that of biological neurons. SNNs are well positioned to process spatiotemporal data, and…

Neural and Evolutionary Computing · Computer Science 2025-05-20 Boxun Xu , Richard Boone , Peng Li