English
Related papers

Related papers: REPrune: Channel Pruning via Kernel Representative…

200 papers

Convolutional neural network (CNN) pruning has become one of the most successful network compression approaches in recent years. Existing works on network pruning usually focus on removing the least important filters in the network to…

Computer Vision and Pattern Recognition · Computer Science 2021-04-09 Zi Wang , Chengcheng Li , Xiangyang Wang

Convolutional neural networks (CNNs) have demonstrated extraordinarily good performance in many computer vision tasks. The increasing size of CNN models, however, prevents them from being widely deployed to devices with limited…

Computer Vision and Pattern Recognition · Computer Science 2020-09-22 Guan Li , Junpeng Wang , Han-Wei Shen , Kaixin Chen , Guihua Shan , Zhonghua Lu

Convolutional Neural Networks (CNN) are becoming a common presence in many applications and services, due to their superior recognition accuracy. They are increasingly being used on mobile devices, many times just by porting large models…

Machine Learning · Computer Science 2020-02-21 Valentin Radu , Kuba Kaszyk , Yuan Wen , Jack Turner , Jose Cano , Elliot J. Crowley , Bjorn Franke , Amos Storkey , Michael O'Boyle

Even though the Convolutional Neural Networks (CNN) has shown superior results in the field of computer vision, it is still a challenging task to implement computer vision algorithms in real-time at the edge, especially using a low-cost IoT…

Computer Vision and Pattern Recognition · Computer Science 2020-03-06 Chinthaka Gamanayake , Lahiru Jayasinghe , Benny Ng , Chau Yuen

The advancement of convolutional neural networks (CNNs) on various vision applications has attracted lots of attention. Yet the majority of CNNs are unable to satisfy the strict requirement for real-world deployment. To overcome this, the…

Computer Vision and Pattern Recognition · Computer Science 2021-07-13 Wei He , Zhongzhan Huang , Mingfu Liang , Senwei Liang , Haizhao Yang

As the convolutional neural network (CNN) gets deeper and wider in recent years, the requirements for the amount of data and hardware resources have gradually increased. Meanwhile, CNN also reveals salient redundancy in several tasks. The…

Computer Vision and Pattern Recognition · Computer Science 2021-01-19 Jingfei Chang , Yang Lu , Ping Xue , Yiqun Xu , Zhen Wei

Convolutional neural networks (CNN) play a major role in image processing tasks like image classification, object detection, semantic segmentation. Very often CNN networks have from several to hundred stacked layers with several megabytes…

Machine Learning · Computer Science 2020-02-18 Marcin Pietron , Maciej Wielgosz

Channel pruning is among the predominant approaches to compress deep neural networks. To this end, most existing pruning methods focus on selecting channels (filters) by importance/optimization or regularization based on rule-of-thumb…

Computer Vision and Pattern Recognition · Computer Science 2020-06-30 Mingbao Lin , Rongrong Ji , Yuxin Zhang , Baochang Zhang , Yongjian Wu , Yonghong Tian

Channel pruning is one of the predominant approaches for deep model compression. Existing pruning methods either train from scratch with sparsity constraints on channels, or minimize the reconstruction error between the pre-trained feature…

Computer Vision and Pattern Recognition · Computer Science 2019-01-15 Zhuangwei Zhuang , Mingkui Tan , Bohan Zhuang , Jing Liu , Yong Guo , Qingyao Wu , Junzhou Huang , Jinhui Zhu

Acceleration of convolutional neural network has received increasing attention during the past several years. Among various acceleration techniques, filter pruning has its inherent merit by effectively reducing the number of convolution…

Computer Vision and Pattern Recognition · Computer Science 2019-06-19 Dong Wang , Lei Zhou , Xiao Bai , Jun Zhou

Though network pruning receives popularity in reducing the complexity of convolutional neural networks (CNNs), it remains an open issue to concurrently maintain model accuracy as well as achieve significant speedups on general CPUs. In this…

Computer Vision and Pattern Recognition · Computer Science 2022-10-18 Mingbao Lin , Yuxin Zhang , Yuchao Li , Bohong Chen , Fei Chao , Mengdi Wang , Shen Li , Yonghong Tian , Rongrong Ji

The success of convolutional neural networks (CNNs) in computer vision applications has been accompanied by a significant increase of computation and memory costs, which prohibits its usage on resource-limited environments such as mobile or…

Computer Vision and Pattern Recognition · Computer Science 2019-03-25 Shaohui Lin , Rongrong Ji , Yuchao Li , Cheng Deng , Xuelong Li

Filter level pruning is an effective method to accelerate the inference speed of deep CNN models. Although numerous pruning algorithms have been proposed, there are still two open issues. The first problem is how to prune residual…

Computer Vision and Pattern Recognition · Computer Science 2020-04-28 Jian-Hao Luo , Jianxin Wu

Biological membranes are one of the most basic structures and regions of interest in cell biology. In the study of membranes, segment extraction is a well-known and difficult problem because of impeding noise, directional and thickness…

Computer Vision and Pattern Recognition · Computer Science 2018-10-24 Joris Roels , Jonas De Vylder , Jan Aelterman , Yvan Saeys , Wilfried Philips

Convolutional neural networks (CNNs) have succeeded in many practical applications. However, their high computation and storage requirements often make them difficult to deploy on resource-constrained devices. In order to tackle this issue,…

Machine Learning · Computer Science 2022-01-14 Tianzong Yu , Chunyuan Zhang , Yuan Wang , Meng Ma , Qi Song

Many state-of-the-art computer vision algorithms use large scale convolutional neural networks (CNNs) as basic building blocks. These CNNs are known for their huge number of parameters, high redundancy in weights, and tremendous computing…

Computer Vision and Pattern Recognition · Computer Science 2018-01-24 Qiangui Huang , Kevin Zhou , Suya You , Ulrich Neumann

Channel-based pruning has achieved significant successes in accelerating deep convolutional neural network, whose pipeline is an iterative three-step procedure: ranking, pruning and fine-tuning. However, this iterative procedure is…

Computer Vision and Pattern Recognition · Computer Science 2019-02-19 Zi Wang , Chengcheng Li , Dali Wang , Xiangyang Wang , Hairong Qi

Filters are the essential elements in convolutional neural networks (CNNs). Filters are corresponded to the feature maps and form the main part of the computational and memory requirement for the CNN processing. In filter pruning methods, a…

Computer Vision and Pattern Recognition · Computer Science 2020-02-11 Morteza Mousa-Pasandi , Mohsen Hajabdollahi , Nader Karimi , Shadrokh Samavi , Shahram Shirani

Convolutional Neural Networks (CNNs) are state-of-the-art in numerous computer vision tasks such as object classification and detection. However, the large amount of parameters they contain leads to a high computational complexity and…

Machine Learning · Computer Science 2019-01-01 Ghouthi Boukli Hacene , Vincent Gripon , Matthieu Arzel , Nicolas Farrugia , Yoshua Bengio

We propose ResRep, a novel method for lossless channel pruning (a.k.a. filter pruning), which slims down a CNN by reducing the width (number of output channels) of convolutional layers. Inspired by the neurobiology research about the…

Machine Learning · Computer Science 2021-08-17 Xiaohan Ding , Tianxiang Hao , Jianchao Tan , Ji Liu , Jungong Han , Yuchen Guo , Guiguang Ding