English
Related papers

Related papers: Subtractor-Based CNN Inference Accelerator

200 papers

We propose a novel approach to reduce the computational cost of evaluation of convolutional neural networks, a factor that has hindered their deployment in low-power devices such as mobile phones. Inspired by the loop perforation technique…

Computer Vision and Pattern Recognition · Computer Science 2016-10-18 Michael Figurnov , Aijan Ibraimova , Dmitry Vetrov , Pushmeet Kohli

Accelerating deep neural network (DNN) inference on resource-limited devices is one of the most important barriers to ensuring a wider and more inclusive adoption. To alleviate this, DNN binary quantization for faster convolution and memory…

Machine Learning · Computer Science 2021-08-24 Meshia Cédric Oveneke

Low-cardinality activations permit an algorithm based on fetching the inference values from pre-calculated lookup tables instead of calculating them every time. This algorithm can have extensions, some of which offer abilities beyond those…

Machine Learning · Computer Science 2021-04-06 Grigor Gatchev , Valentin Mollov

Channel pruning is widely accepted to accelerate modern convolutional neural networks (CNNs). The resulting pruned model benefits from its immediate deployment on general-purpose software and hardware resources. However, its large pruning…

Computer Vision and Pattern Recognition · Computer Science 2024-03-11 Mincheol Park , Dongjin Kim , Cheonjun Park , Yuna Park , Gyeong Eun Gong , Won Woo Ro , Suhyun Kim

To accelerate inference of Convolutional Neural Networks (CNNs), various techniques have been proposed to reduce computation redundancy. Converting convolutional layers into frequency domain significantly reduces the computation complexity…

Computer Vision and Pattern Recognition · Computer Science 2023-10-12 Yue Niu , Hanqing Zeng , Ajitesh Srivastava , Kartik Lakhotia , Rajgopal Kannan , Yanzhi Wang , Viktor Prasanna

Many recent works have designed accelerators for Convolutional Neural Networks (CNNs). While digital accelerators have relied on near data processing, analog accelerators have further reduced data movement by performing in-situ computation.…

Machine Learning · Computer Science 2018-03-20 Anirban Nag , Ali Shafiee , Rajeev Balasubramonian , Vivek Srikumar , Naveen Muralimanohar

Compressing convolutional neural networks (CNNs) by pruning and distillation has received ever-increasing focus in the community. In particular, designing a class-discrimination based approach would be desired as it fits seamlessly with the…

Computer Vision and Pattern Recognition · Computer Science 2021-10-22 Yuchen Liu , David Wentzlaff , S. Y. Kung

Channel pruning is a promising technique to compress the parameters of deep convolutional neural networks(DCNN) and to speed up the inference. This paper aims to address the long-standing inefficiency of channel pruning. Most channel…

Computer Vision and Pattern Recognition · Computer Science 2021-09-01 Zhouyang Xie , Yan Fu , Shengzhao Tian , Junlin Zhou , Duanbing Chen

As neural networks grow in size and complexity, inference speeds decline. To combat this, one of the most effective compression techniques -- channel pruning -- removes channels from weights. However, for multi-branch segments of a model,…

Computer Vision and Pattern Recognition · Computer Science 2023-07-19 Alvin Wan , Hanxiang Hao , Kaushik Patnaik , Yueyang Xu , Omer Hadad , David Güera , Zhile Ren , Qi Shan

We show how parameter redundancy in Convolutional Neural Network (CNN) filters can be effectively reduced by pruning in spectral domain. Specifically, the representation extracted via Discrete Cosine Transform (DCT) is more conducive for…

Machine Learning · Computer Science 2020-10-26 Matej Ulicny , Vladimir A. Krylov , Rozenn Dahyot

On-device CNN inference for real-time computer vision applications can result in computational demands that far exceed the energy budgets of mobile devices. This paper proposes FixyNN, a co-designed hardware accelerator platform which…

Machine Learning · Computer Science 2019-02-28 Paul Whatmough , Chuteng Zhou , Patrick Hansen , Matthew Mattina

The concept of compressing deep Convolutional Neural Networks (CNNs) is essential to use limited computation, power, and memory resources on embedded devices. However, existing methods achieve this objective at the cost of a drop in…

Computer Vision and Pattern Recognition · Computer Science 2021-04-20 Waqar Ahmed , Andrea Zunino , Pietro Morerio , Vittorio Murino

As traditional neural network consumes a significant amount of computing resources during back propagation, \citet{Sun2017mePropSB} propose a simple yet effective technique to alleviate this problem. In this technique, only a small subset…

Machine Learning · Computer Science 2017-09-27 Bingzhen Wei , Xu Sun , Xuancheng Ren , Jingjing Xu

Deep convolutional neural networks (CNN) are widely used in modern artificial intelligence (AI) and smart vision systems but also limited by computation latency, throughput, and energy efficiency on a resource-limited scenario, such as…

Hardware Architecture · Computer Science 2017-09-18 Yuan Du , Li Du , Yilei Li , Junjie Su , Mau-Chung Frank Chang

Convolutional Neural Networks (CNNs) have proven to be extremely accurate for image recognition, even outperforming human recognition capability. When deployed on battery-powered mobile devices, efficient computer architectures are required…

Hardware Architecture · Computer Science 2020-10-05 Mehdi Ahmadi , Shervin Vakili , J. M. Pierre Langlois

Recent advances in Artificial Intelligence (AI) on the Internet of Things (IoT)-enabled network edge has realized edge intelligence in several applications such as smart agriculture, smart hospitals, and smart factories by enabling…

Machine Learning · Computer Science 2024-01-18 Muhammad Zawish , Steven Davy , Lizy Abraham

Convolutional neural network (CNN) accelerators are being widely used for their efficiency, but they require a large amount of memory, leading to the use of a slow and power consuming external memory. This paper exploits two schemes to…

Hardware Architecture · Computer Science 2022-12-23 Hyeong-Ju Kang

This paper optimizes the Convolutional Neural Network (CNN) algorithm using high-performance computing (HPC) technologies. It uses multi-core processors, GPUs, and parallel computing frameworks like OpenMPI and CUDA to speed up CNN model…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-03-11 Shahrin Rahman

Convolutional Neural Networks (CNNs) have shown outstanding accuracy for many vision tasks during recent years. When deploying CNNs on portable devices and embedded systems, however, the large number of parameters and computations result in…

Signal Processing · Electrical Eng. & Systems 2020-02-19 Mehdi Ahmadi , Shervin Vakili , J. M. Pierre Langlois

Stochastic computing (SC) offers significant reductions in hardware complexity for traditional convolutional neural networks(CNNs). However, despite its advantages, stochastic computing neural networks (SCNNs) often suffer from high…

Hardware Architecture · Computer Science 2026-01-29 Sheng Lu , Qianhou Qu , Sungyong Jung , Qilian Liang , Chenyun Pan