以充分必要特征集简化深度神经网络解释:以文本分类为例
摘要
在过去十年中,深度神经网络(DNN)在解决医学、金融、法律等多个领域的广泛问题时表现出令人印象深刻的性能。尽管性能优异,它们长期被视为黑箱系统,能给出良好结果却无法解释。然而,在医学等关乎人类生命的 critical 领域中,无法解释系统决策会带来严重风险。已有若干工作致力于揭示深度神经网络的内部推理。显著图方法通过为输入特征分配反映其对分类器决策贡献的权重来解释模型决策。然而,并非所有特征都是解释模型决策所必需的。实践中,分类器可能强烈依赖于一个特征子集,该子集足以解释特定决策。本文旨在提出一种方法,通过识别充分且必要的特征集,来简化一维(1D)卷积神经网络(CNN)的预测解释。我们还提出了一种适用于 1D-CNN 的逐层相关性传播改进方法。在多个数据集上的实验表明,特征间的相关性分布与知名 SOTA 模型所得结果相似。此外,提取出的充分必要特征在感知上对人类而言颇具说服力。
引用
@article{arxiv.2010.03724,
title = {Simplifying the explanation of deep neural networks with sufficient and necessary feature-sets: case of text classification},
author = {Jiechieu Kameni Florentin Flambeau and Tsopze Norbert},
journal= {arXiv preprint arXiv:2010.03724},
year = {2020}
}
备注
Figure 3.d has been replaced : the distribution of relevances was shifted by mistake, Fig. 4 has been replaced : Sufficient features was wrongly highlighted, Fig. 2 has been replaced : The sum z was incorrect. Related calculations has been updated accordingly. Notes : These changes are minor changes and do not alter the comprehension of the findings highlted in the work