English
Related papers

Related papers: Explainable Image Classification with Evidence Cou…

200 papers

We propose Automatic Feature Explanation using Contrasting Concepts (FALCON), an interpretability framework to explain features of image representations. For a target feature, FALCON captions its highly activating cropped images using a…

Computer Vision and Pattern Recognition · Computer Science 2023-09-11 Neha Kalibhat , Shweta Bhardwaj , Bayan Bruss , Hamed Firooz , Maziar Sanjabi , Soheil Feizi

While recent years have witnessed the emergence of various explainable methods in machine learning, to what degree the explanations really represent the reasoning process behind the model prediction -- namely, the faithfulness of…

Computation and Language · Computer Science 2021-09-07 Yingqiang Ge , Shuchang Liu , Zelong Li , Shuyuan Xu , Shijie Geng , Yunqi Li , Juntao Tan , Fei Sun , Yongfeng Zhang

Unsupervised image captioning is a challenging task that aims at generating captions without the supervision of image-sentence pairs, but only with images and sentences drawn from different sources and object labels detected from the…

Computation and Language · Computer Science 2021-06-02 Ukyo Honda , Yoshitaka Ushiku , Atsushi Hashimoto , Taro Watanabe , Yuji Matsumoto

Explanation techniques that synthesize small, interpretable changes to a given image while producing desired changes in the model prediction have become popular for introspecting black-box models. Commonly referred to as counterfactuals,…

Machine Learning · Computer Science 2021-10-06 Jayaraman J. Thiagarajan , Vivek Narayanaswamy , Deepta Rajan , Jason Liang , Akshay Chaudhari , Andreas Spanias

Counterfactual inference is a powerful tool, capable of solving challenging problems in high-profile sectors. To perform counterfactual inference, one requires knowledge of the underlying causal mechanisms. However, causal mechanisms cannot…

Machine Learning · Computer Science 2023-01-23 Athanasios Vlontzos , Bernhard Kainz , Ciaran M. Gilligan-Lee

Counterfactual examples explain a prediction by highlighting changes of instance that flip the outcome of a classifier. This paper proposes TIGTEC, an efficient and modular method for generating sparse, plausible and diverse counterfactual…

Machine Learning · Computer Science 2023-04-26 Milan Bhan , Jean-Noel Vittaut , Nicolas Chesneau , Marie-Jeanne Lesot

Visual counterfactual explainers (VCEs) are a straightforward and promising approach to enhancing the transparency of image classifiers. VCEs complement other types of explanations, such as feature attribution, by revealing the specific…

Machine Learning · Computer Science 2026-01-13 Sidney Bender , Jan Herrmann , Klaus-Robert Müller , Grégoire Montavon

The Image Difference Captioning (IDC) task aims to describe the visual differences between two similar images with natural language. The major challenges of this task lie in two aspects: 1) fine-grained visual differences that require…

Multimedia · Computer Science 2022-02-10 Linli Yao , Weiying Wang , Qin Jin

As AI models grow more complex, explainability is essential for building trust, yet concept-based counterfactual methods still face a trade-off between expressivity and efficiency. Representing underlying concepts as atomic sets is fast but…

Artificial Intelligence · Computer Science 2026-05-22 Angeliki Dimitriou , Nikolaos Chaidos , Maria Lymperaiou , Giorgos Filandrianos , Giorgos Stamou

Understanding predictions made by deep neural networks is notoriously difficult, but also crucial to their dissemination. As all machine learning based methods, they are as good as their training data, and can also capture unwanted biases.…

Computation and Language · Computer Science 2022-11-15 Amir Feder , Nadav Oved , Uri Shalit , Roi Reichart

Deep learning models are widely used for image analysis. While they offer high performance in terms of accuracy, people are concerned about if these models inappropriately make inferences using irrelevant features that are not encoded from…

Machine Learning · Computer Science 2021-05-25 Yongqiang Tian , Shiqing Ma , Ming Wen , Yepang Liu , Shing-Chi Cheung , Xiangyu Zhang

Selective classification enables models to make predictions only when they are sufficiently confident, aiming to enhance safety and reliability, which is important in high-stakes scenarios. Previous methods mainly use deep neural networks…

Machine Learning · Computer Science 2024-06-10 Yu-Chang Wu , Shen-Huan Lyu , Haopu Shang , Xiangyu Wang , Chao Qian

Counterfactual examples for an input -- perturbations that change specific features but not others -- have been shown to be useful for evaluating bias of machine learning models, e.g., against specific demographic groups. However,…

Computer Vision and Pattern Recognition · Computer Science 2022-01-07 Saloni Dash , Vineeth N Balasubramanian , Amit Sharma

Counterfactual explanations (CE) explain model decisions by identifying input modifications that lead to different predictions. Most existing methods operate at the instance level. Distributional Counterfactual Explanations (DCE) extend…

Machine Learning · Computer Science 2026-03-18 Yikai Gu , Lele Cao , Bo Zhao , Lei Lei , Lei You

Model explanations based on pure observational data cannot compute the effects of features reliably, due to their inability to estimate how each factor alteration could affect the rest. We argue that explanations should be based on the…

Machine Learning · Statistics 2019-09-20 Álvaro Parafita , Jordi Vitrià

Understanding why specific items are recommended to users can significantly increase their trust and satisfaction in the system. While neural recommenders have become the state-of-the-art in recent years, the complexity of deep models still…

Information Retrieval · Computer Science 2021-05-12 Khanh Hiep Tran , Azin Ghazimatin , Rishiraj Saha Roy

In this paper titled A Model-Agnostic SAT-based approach for Symbolic Explanation Enumeration we propose a generic agnostic approach allowing to generate different and complementary types of symbolic explanations. More precisely, we…

Artificial Intelligence · Computer Science 2022-08-17 Ryma Boumazouza , Fahima Cheikh-Alili , Bertrand Mazure , Karim Tabia

Understanding and explaining the mistakes made by trained models is critical to many machine learning objectives, such as improving robustness, addressing concept drift, and mitigating biases. However, this is often an ad hoc process that…

Machine Learning · Computer Science 2022-06-16 Abubakar Abid , Mert Yuksekgonul , James Zou

Machine learning plays a role in many deployed decision systems, often in ways that are difficult or impossible to understand by human stakeholders. Explaining, in a human-understandable way, the relationship between the input and output of…

Machine Learning · Computer Science 2022-11-17 Sahil Verma , Varich Boonsanong , Minh Hoang , Keegan E. Hines , John P. Dickerson , Chirag Shah

The effectiveness of Convolutional Neural Networks (CNNs)in classifying image data has been thoroughly demonstrated. In order to explain the classification to humans, methods for visualizing classification evidence have been developed in…

Computer Vision and Pattern Recognition · Computer Science 2021-01-13 Anna Nguyen , Adrian Oberföll , Michael Färber