English
Related papers

Related papers: Towards Fine-Grained Interpretability: Counterfact…

200 papers

Counterfactual explanation methods have recently received significant attention for explaining CNN-based image classifiers due to their ability to provide easily understandable explanations that align more closely with human reasoning.…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Syed Ali Tariq , Tehseen Zia

An important line of research attempts to explain CNN image classifier predictions and intermediate layer representations in terms of human-understandable concepts. Previous work supports that deep representations are linearly separable…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Alexandros Doumanoglou , Stylianos Asteriadis , Dimitrios Zarpalas

Counterfactual examples have emerged as an effective approach to produce simple and understandable post-hoc explanations. In the context of graph classification, previous work has focused on generating counterfactual explanations by…

Machine Learning · Computer Science 2023-07-28 Carlo Abrate , Giulia Preti , Francesco Bonchi

Fine-grained recognition is challenging due to its subtle local inter-class differences versus large intra-class variations such as poses. A key to address this problem is to localize discriminative parts to extract pose-invariant features.…

Computer Vision and Pattern Recognition · Computer Science 2017-03-22 Xiao Liu , Tian Xia , Jiang Wang , Yi Yang , Feng Zhou , Yuanqing Lin

Extracting and fusing part features have become the key of fined-grained image recognition. Recently, Non-local (NL) module has shown excellent improvement in image recognition. However, it lacks the mechanism to model the interactions…

Computer Vision and Pattern Recognition · Computer Science 2020-05-20 Zihan Ye , Fuyuan Hu , Yin Liu , Zhenping Xia , Fan Lyu , Pengqing Liu

Few-Shot Semantic Segmentation (FSS) models achieve strong performance in segmenting novel classes with minimal labeled examples, yet their decision-making processes remain largely opaque. While explainable AI has advanced significantly in…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Pasquale De Marinis , Uzay Kaymak , Rogier Brussee , Gennaro Vessio , Giovanna Castellano

Fine-grained image recognition is very challenging due to the difficulty of capturing both semantic global features and discriminative local features. Meanwhile, these two features are not easy to be integrated, which are even conflicting…

Computer Vision and Pattern Recognition · Computer Science 2021-02-22 Shaokang Yang , Shuai Liu , Cheng Yang , Changhu Wang

Building explainable systems is a critical problem in the field of Natural Language Processing (NLP), since most machine learning models provide no explanations for the predictions. Existing approaches for explainable machine learning…

Computation and Language · Computer Science 2019-06-12 Hui Liu , Qingyu Yin , William Yang Wang

Counterfactual explanations are an emerging tool to enhance interpretability of deep learning models. Given a sample, these methods seek to find and display to the user similar samples across the decision boundary. In this paper, we propose…

Machine Learning · Computer Science 2023-08-22 Cassio F. Dantas , Diego Marcos , Dino Ienco

Deep learning models achieve high predictive performance but lack intrinsic interpretability, hindering our understanding of the learned prediction behavior. Existing local explainability methods focus on associations, neglecting the causal…

Machine Learning · Computer Science 2025-09-18 Niklas Penzel , Joachim Denzler

As deep learning models are increasingly used in safety-critical applications, explainability and trustworthiness become major concerns. For simple images, such as low-resolution face portraits, synthesizing visual counterfactual…

Computer Vision and Pattern Recognition · Computer Science 2022-07-20 Paul Jacob , Éloi Zablocki , Hédi Ben-Younes , Mickaël Chen , Patrick Pérez , Matthieu Cord

In this paper, we propose leveraging causal generative learning as an interpretable tool for explaining image classifiers. Specifically, we present a generative counterfactual inference approach to study the influence of visual features…

Machine Learning · Computer Science 2024-01-23 Will Taylor-Melanson , Zahra Sadeghi , Stan Matwin

In current visual model training, models often rely on only limited sufficient causes for their predictions, which makes them sensitive to distribution shifts or the absence of key features. Attribution methods can accurately identify a…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Yannan Chen , Ruoyu Chen , Bin Zeng , Wei Wang , Shiming Liu , Qunli Zhang , Zheng Hu , Laiyuan Wang , Yaowei Wang , Xiaochun Cao

Deep generative models can emulate the perceptual properties of complex image datasets, providing a latent representation of the data. However, manipulating such representation to perform meaningful and controllable transformations in the…

Machine Learning · Computer Science 2019-12-13 Michel Besserve , Arash Mehrjou , Rémy Sun , Bernhard Schölkopf

Interpretability is crucial for machine learning algorithms in high-stakes medical applications. However, high-performing neural networks typically cannot explain their predictions. Post-hoc explanation methods provide a way to understand…

Computer Vision and Pattern Recognition · Computer Science 2025-11-14 Susu Sun , Stefano Woerner , Andreas Maier , Lisa M. Koch , Christian F. Baumgartner

Fine-grained image classification involves identifying different subcategories of a class which possess very subtle discriminatory features. Fine-grained datasets usually provide bounding box annotations along with class labels to aid the…

Computer Vision and Pattern Recognition · Computer Science 2021-07-30 Farha Al Breiki , Muhammad Ridzuan , Rushali Grandhe

Deep neural networks for medical image diagnosis often achieve high predictive accuracy while relying on spurious or clinically irrelevant visual cues, limiting their trustworthiness in practice. Post-hoc explanation methods are widely used…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Zubair Faruqui , Rahul Dubey

Fine-grained clustering is a practical yet challenging task, whose essence lies in capturing the subtle differences between instances of different classes. Such subtle differences can be easily disrupted by data augmentation or be…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Ruohong Yang , Peng Hu , Xi Peng , Xiting Liu , Yunfan Li

Model explanations based on pure observational data cannot compute the effects of features reliably, due to their inability to estimate how each factor alteration could affect the rest. We argue that explanations should be based on the…

Machine Learning · Statistics 2019-09-20 Álvaro Parafita , Jordi Vitrià

Fine-grained image recognition is a longstanding computer vision challenge that focuses on differentiating objects belonging to multiple subordinate categories within the same meta-category. Since images belonging to the same meta-category…

Computer Vision and Pattern Recognition · Computer Science 2023-09-04 Yifan Pu , Yizeng Han , Yulin Wang , Junlan Feng , Chao Deng , Gao Huang