English

Provable Robust Saliency-based Explanations

Machine Learning 2024-12-30 v4 Artificial Intelligence

Abstract

To foster trust in machine learning models, explanations must be faithful and stable for consistent insights. Existing relevant works rely on the p\ell_p distance for stability assessment, which diverges from human perception. Besides, existing adversarial training (AT) associated with intensive computations may lead to an arms race. To address these challenges, we introduce a novel metric to assess the stability of top-kk salient features. We introduce R2ET which trains for stable explanation by efficient and effective regularizer, and analyze R2ET by multi-objective optimization to prove numerical and statistical stability of explanations. Moreover, theoretical connections between R2ET and certified robustness justify R2ET's stability in all attacks. Extensive experiments across various data modalities and model architectures show that R2ET achieves superior stability against stealthy attacks, and generalizes effectively across different explanation methods.

Keywords

Cite

@article{arxiv.2212.14106,
  title  = {Provable Robust Saliency-based Explanations},
  author = {Chao Chen and Chenghua Guo and Rufeng Chen and Guixiang Ma and Ming Zeng and Xiangwen Liao and Xi Zhang and Sihong Xie},
  journal= {arXiv preprint arXiv:2212.14106},
  year   = {2024}
}

Comments

Accepted to NeurIPS 2024