中文
相关论文

相关论文: Carrying out CNN Channel Pruning in a White Box

200 篇论文

Channel pruning and tensor decomposition have received extensive attention in convolutional neural network compression. However, these two techniques are traditionally deployed in an isolated manner, leading to significant accuracy drop…

计算机视觉与模式识别 · 计算机科学 2021-05-25 Yuchao Li , Shaohui Lin , Jianzhuang Liu , Qixiang Ye , Mengdi Wang , Fei Chao , Fan Yang , Jincheng Ma , Qi Tian , Rongrong Ji

This paper introduces channel gating, a dynamic, fine-grained, and hardware-efficient pruning scheme to reduce the computation cost for convolutional neural networks (CNNs). Channel gating identifies regions in the features that contribute…

机器学习 · 计算机科学 2019-10-30 Weizhe Hua , Yuan Zhou , Christopher De Sa , Zhiru Zhang , G. Edward Suh

We study network pruning which aims to remove redundant channels/kernels and hence speed up the inference of deep networks. Existing pruning methods either train from scratch with sparsity constraints or minimize the reconstruction error…

计算机视觉与模式识别 · 计算机科学 2021-03-30 Jing Liu , Bohan Zhuang , Zhuangwei Zhuang , Yong Guo , Junzhou Huang , Jinhui Zhu , Mingkui Tan

Recently there has been a lot of work on pruning filters from deep convolutional neural networks (CNNs) with the intention of reducing computations.The key idea is to rank the filters based on a certain criterion (say, l1-norm) and retain…

机器学习 · 计算机科学 2018-12-27 Deepak Mittal , Shweta Bhardwaj , Mitesh M. Khapra , Balaraman Ravindran

Despite the promising results of convolutional neural networks (CNNs), their application on devices with limited resources is still a big challenge; this is mainly due to the huge memory and computation requirements of the CNN. To counter…

机器学习 · 计算机科学 2020-03-04 Csanád Sándor , Szabolcs Pável , Lehel Csató

Channel pruning is one of the important methods for deep model compression. Most of existing pruning methods mainly focus on classification. Few of them conduct systematic research on object detection. However, object detection is different…

计算机视觉与模式识别 · 计算机科学 2020-03-03 Zihao Xie , Wenbing Tao , Li Zhu , Lin Zhao

Channel pruning is a promising method for accelerating and compressing convolutional neural networks. However, current pruning algorithms still remain unsolved problems that how to assign layer-wise pruning ratios properly and discard the…

信息论 · 计算机科学 2024-09-04 Yihao Chen , Zefang Wang

The enormous inference cost of deep neural networks can be scaled down by network compression. Pruning is one of the predominant approaches used for deep network compression. However, existing pruning techniques have one or more of the…

机器学习 · 计算机科学 2020-10-13 Sai Aparna Aketi , Sourjya Roy , Anand Raghunathan , Kaushik Roy

Filter pruning is effective to reduce the computational costs of neural networks. Existing methods show that updating the previous pruned filter would enable large model capacity and achieve better performance. However, during the iterative…

计算机视觉与模式识别 · 计算机科学 2022-02-14 Yang He , Ping Liu , Linchao Zhu , Yi Yang

We propose a simple but effective data-driven channel pruning algorithm, which compresses deep neural networks in a differentiable way by exploiting the characteristics of operations. The proposed approach makes a joint consideration of…

机器学习 · 计算机科学 2020-07-23 Minsoo Kang , Bohyung Han

Numerous studies have revealed that deep learning-based medical image classification models may exhibit bias towards specific demographic attributes, such as race, gender, and age. Existing bias mitigation methods often achieve high level…

计算机视觉与模式识别 · 计算机科学 2024-05-15 Qingpeng Kong , Ching-Hao Chiu , Dewen Zeng , Yu-Jen Chen , Tsung-Yi Ho , Jingtong hu , Yiyu Shi

Channel pruning is a promising technique to compress the parameters of deep convolutional neural networks(DCNN) and to speed up the inference. This paper aims to address the long-standing inefficiency of channel pruning. Most channel…

计算机视觉与模式识别 · 计算机科学 2021-09-01 Zhouyang Xie , Yan Fu , Shengzhao Tian , Junlin Zhou , Duanbing Chen

Convolutional Neural Networks (CNNs) compression is crucial to deploying these models in edge devices with limited resources. Existing channel pruning algorithms for CNNs have achieved plenty of success on complex models. They approach the…

计算机视觉与模式识别 · 计算机科学 2022-09-08 Alireza Ganjdanesh , Shangqian Gao , Heng Huang

We propose an efficient and unified framework, namely ThiNet, to simultaneously accelerate and compress CNN models in both training and inference stages. We focus on the filter level pruning, i.e., the whole filter would be discarded if it…

计算机视觉与模式识别 · 计算机科学 2017-07-21 Jian-Hao Luo , Jianxin Wu , Weiyao Lin

To apply deep CNNs to mobile terminals and portable devices, many scholars have recently worked on the compressing and accelerating deep convolutional neural networks. Based on this, we propose a novel uniform channel pruning (UCP) method…

计算机视觉与模式识别 · 计算机科学 2020-10-06 Jingfei Chang , Yang Lu , Ping Xue , Xing Wei , Zhen Wei

Nowadays, it is still difficult to adapt Convolutional Neural Network (CNN) based models for deployment on embedded devices. The heavy computation and large memory footprint of CNN models become the main burden in real application. In this…

计算机视觉与模式识别 · 计算机科学 2017-08-09 Xin Li , Changsong Liu

One of the major challenges in deploying deep neural network architectures is their size which has an adverse effect on their inference time and memory requirements. Deep CNNs can either be pruned width-wise by removing filters based on…

计算机视觉与模式识别 · 计算机科学 2020-10-07 Muhammad Umair Haider , Murtaza Taj

Convolutional Neural Network (CNN) has an amount of parameter redundancy, filter pruning aims to remove the redundant filters and provides the possibility for the application of CNN on terminal devices. However, previous works pay more…

计算机视觉与模式识别 · 计算机科学 2021-12-15 Pengkun Liu , Yaru Yue , Yanjun Guo , Xingxiang Tao , Xiaoguang Zhou

Channel pruning has demonstrated its effectiveness in compressing ConvNets. In many related arts, the importance of an output feature map is only determined by its associated filter. However, these methods ignore a small part of weights in…

计算机视觉与模式识别 · 计算机科学 2021-04-21 Yangchun Yan , Rongzuo Guo , Chao Li , Kang Yang , Yongjun Xu

Convolutional neural networks (CNNs) achieve state-of-the-art performance in a wide variety of tasks in computer vision. However, interpreting CNNs still remains a challenge. This is mainly due to the large number of parameters in these…

机器学习 · 统计学 2017-11-08 Reza Abbasi-Asl , Bin Yu