DRNet: Dissect and Reconstruct the Convolutional Neural Network via Interpretable Manners
Abstract
Convolutional neural networks (ConvNets) are widely used in real life. People usually use ConvNets which pre-trained on a fixed number of classes. However, for different application scenarios, we usually do not need all of the classes, which means ConvNets are redundant when dealing with these tasks. This paper focuses on the redundancy of ConvNet channels. We proposed a novel idea: using an interpretable manner to find the most important channels for every single class (dissect), and dynamically run channels according to classes in need (reconstruct). For VGG16 pre-trained on CIFAR-10, we only run 11\% parameters for two-classes sub-tasks on average with negligible accuracy loss. For VGG16 pre-trained on ImageNet, our method averagely gains 14.29\% accuracy promotion for two-classes sub-tasks. In addition, analysis show that our method captures some semantic meanings of channels, and uses the context information more targeted for sub-tasks of ConvNets.
Cite
@article{arxiv.1911.08691,
title = {DRNet: Dissect and Reconstruct the Convolutional Neural Network via Interpretable Manners},
author = {Xiaolong Hu and Zhulin An and Chuanguang Yang and Hui Zhu and Kaiqaing Xu and Yongjun Xu},
journal= {arXiv preprint arXiv:1911.08691},
year = {2020}
}
Comments
ECAI2020