English
Related papers

Related papers: Hardware-oriented Approximation of Convolutional N…

200 papers

The state-of-the-art performance for several real-world problems is currently reached by convolutional neural networks (CNN). Such learning models exploit recent results in the field of deep learning, typically leading to highly performing,…

Machine Learning · Computer Science 2021-08-31 Giosuè Cataldo Marinò , Alessandro Petrini , Dario Malchiodi , Marco Frasca

Recent convolutional neural network (CNN) development continues to advance the state-of-the-art model accuracy for various applications. However, the enhanced accuracy comes at the cost of substantial memory bandwidth and storage…

Computer Vision and Pattern Recognition · Computer Science 2021-07-20 Hsu-Hsun Chin , Ren-Song Tsay , Hsin-I Wu

The high computation, memory, and power budgets of inferring convolutional neural networks (CNNs) are major bottlenecks of model deployment to edge computing platforms, e.g., mobile devices and IoT. Moreover, training CNNs is time and…

Machine Learning · Computer Science 2021-07-09 Mostafa Elhoushi , Zihao Chen , Farhan Shafiq , Ye Henry Tian , Joey Yiwei Li

This work presents a novel Convolutional Neural Network (CNN) architecture and a training procedure to enable robust and accurate pose estimation of a noncooperative spacecraft. First, a new CNN architecture is introduced that has scored a…

Computer Vision and Pattern Recognition · Computer Science 2019-09-04 Tae Ha Park , Sumant Sharma , Simone D'Amico

Convolutional neural networks (CNNs) have massively impacted visual recognition in 2D images, and are now ubiquitous in state-of-the-art approaches. CNNs do not easily extend, however, to data that are not represented by regular grids, such…

Computer Vision and Pattern Recognition · Computer Science 2018-03-29 Nitika Verma , Edmond Boyer , Jakob Verbeek

Convolutional Neural Networks (ConvNets) are commonly developed at a fixed resource budget, and then scaled up for better accuracy if more resources are available. In this paper, we systematically study model scaling and identify that…

Machine Learning · Computer Science 2020-09-14 Mingxing Tan , Quoc V. Le

A novel convolution neural network model, abbreviated NL-CNN is proposed, where nonlinear convolution is emulated in a cascade of convolution + nonlinearity layers. The code for its implementation and some trained models are made publicly…

Machine Learning · Computer Science 2021-02-03 Radu Dogaru , Ioana Dogaru

The intrinsic error tolerance of neural network (NN) makes approximate computing a promising technique to improve the energy efficiency of NN inference. Conventional approximate computing focuses on balancing the efficiency-accuracy…

Machine Learning · Computer Science 2018-05-23 Xin He , Liu Ke , Wenyan Lu , Guihai Yan , Xuan Zhang

The heavy burdens of computation and off-chip traffic impede deploying the large scale convolution neural network on embedded platforms. As CNN is attributed to the strong endurance to computation errors, employing block floating point…

Machine Learning · Computer Science 2017-11-27 Zhourui Song , Zhenyu Liu , Dongsheng Wang

Although the latest high-end smartphone has powerful CPU and GPU, running deeper convolutional neural networks (CNNs) for complex tasks such as ImageNet classification on mobile devices is challenging. To deploy deep CNNs on mobile devices,…

Computer Vision and Pattern Recognition · Computer Science 2016-02-25 Yong-Deok Kim , Eunhyeok Park , Sungjoo Yoo , Taelim Choi , Lu Yang , Dongjun Shin

Neural Networks (NN) provide a solid and reliable way of executing different types of applications, ranging from speech recognition to medical diagnosis, speeding up onerous and long workloads. The challenges involved in their…

Hardware Architecture · Computer Science 2023-09-26 Federico Manca , Francesco Ratto

Light-weight convolutional neural networks (CNNs) are specially designed for applications on mobile devices with faster inference speed. The convolutional operation can only capture local information in a window region, which prevents…

Computer Vision and Pattern Recognition · Computer Science 2022-11-24 Yehui Tang , Kai Han , Jianyuan Guo , Chang Xu , Chao Xu , Yunhe Wang

In order to handle modern convolutional neural networks (CNNs) efficiently, a hardware architecture of CNN inference accelerator is proposed to handle depthwise convolutions and regular convolutions, which are both essential building blocks…

Computer Vision and Pattern Recognition · Computer Science 2021-04-30 Tse-Wei Chen , Wei Tao , Deyu Wang , Dongchao Wen , Kinya Osa , Masami Kato

Convolutional Neural Networks (CNNs) are becoming increasingly popular due to their superior performance in the domain of computer vision, in applications such as objection detection and recognition. However, they demand complex,…

Neural and Evolutionary Computing · Computer Science 2018-08-24 Ali Athar

Recent studies in image classification have demonstrated a variety of techniques for improving the performance of Convolutional Neural Networks (CNNs). However, attempts to combine existing techniques to create a practical model are still…

Computer Vision and Pattern Recognition · Computer Science 2020-03-16 Jungkyu Lee , Taeryun Won , Tae Kwan Lee , Hyemin Lee , Geonmo Gu , Kiho Hong

We present an efficient high-resolution network, Lite-HRNet, for human pose estimation. We start by simply applying the efficient shuffle block in ShuffleNet to HRNet (high-resolution network), yielding stronger performance over popular…

Computer Vision and Pattern Recognition · Computer Science 2021-04-14 Changqian Yu , Bin Xiao , Changxin Gao , Lu Yuan , Lei Zhang , Nong Sang , Jingdong Wang

The deployment of Convolutional Neural Networks (CNNs) on resource constrained platforms such as mobile devices and embedded systems has been greatly hindered by their high implementation cost, and thus motivated a lot research interest in…

Computer Vision and Pattern Recognition · Computer Science 2019-08-12 Boyu Zhang , Azadeh Davoodi , Yu Hen Hu

Binary Convolutional Neural Networks (CNNs) can significantly reduce the number of arithmetic operations and the size of memory storage, which makes the deployment of CNNs on mobile or embedded systems more promising. However, the accuracy…

Computer Vision and Pattern Recognition · Computer Science 2020-09-01 Baozhou Zhu , Zaid Al-Ars , Wei Pan

Convolutional neural networks (CNNs) have been shown to achieve optimal approximation and estimation error rates (in minimax sense) in several function classes. However, previous analyzed optimal CNNs are unrealistically wide and difficult…

Machine Learning · Statistics 2023-08-15 Kenta Oono , Taiji Suzuki

This paper aims to accelerate the test-time computation of convolutional neural networks (CNNs), especially very deep CNNs that have substantially impacted the computer vision community. Unlike previous methods that are designed for…

Computer Vision and Pattern Recognition · Computer Science 2015-11-19 Xiangyu Zhang , Jianhua Zou , Kaiming He , Jian Sun