English
Related papers

Related papers: SelfExplain: A Self-Explaining Architecture for Ne…

200 papers

We present a new Convolutional Neural Network (CNN) model for text classification that jointly exploits labels on documents and their component sentences. Specifically, we consider scenarios in which annotators explicitly mark sentences (or…

Computation and Language · Computer Science 2016-09-27 Ye Zhang , Iain Marshall , Byron C. Wallace

Currently, there is a significant amount of research being conducted in the field of artificial intelligence to improve the explainability and interpretability of deep learning models. It is found that if end-users understand the reason for…

Information Retrieval · Computer Science 2023-06-02 Niloofar Ranjbar , Saeedeh Momtazi , MohammadMehdi Homayounpour

Graph Neural Networks (GNNs) are widely used for node classification, yet their opaque decision-making limits trust and adoption. While local explanations offer insights into individual predictions, global explanation methods, those that…

Machine Learning · Computer Science 2025-10-30 Burouj Armgaan , Eshan Jain , Harsh Pandey , Mahesh Chandran , Sayan Ranu

Recent work on interpretability in machine learning and AI has focused on the building of simplified models that approximate the true criteria used to make decisions. These models are a useful pedagogical device for teaching trained…

Artificial Intelligence · Computer Science 2018-11-06 Brent Mittelstadt , Chris Russell , Sandra Wachter

Explaining Graph Neural Networks (GNNs) has garnered significant attention due to the need for interpretability, enabling users to understand the behavior of these black-box models better and extract valuable insights from their…

Machine Learning · Computer Science 2025-06-03 Jiaxing Zhang , Xiaoou Liu , Dongsheng Luo , Hua Wei

Explanations shed light on a machine learning model's rationales and can aid in identifying deficiencies in its reasoning process. Explanation generation models are typically trained in a supervised way given human explanations. When such…

Machine Learning · Computer Science 2021-09-09 Pepa Atanasova , Jakob Grue Simonsen , Christina Lioma , Isabelle Augenstein

The emergence of tools based on artificial intelligence has also led to the need of producing explanations which are understandable by a human being. In most approaches, the system is considered a black box, making it difficult to generate…

Artificial Intelligence · Computer Science 2024-10-23 Germán Vidal

In the context of explainable artificial intelligence (XAI), limited research has identified role-specific explanation needs. This study investigates the explanation needs of data scientists, who are responsible for training, testing,…

Human-Computer Interaction · Computer Science 2025-02-25 Helmut Degen , Ziran Min , Parinitha Nagaraja

We introduce the notion of pointwise coverage to measure the explainability properties of machine learning classifiers. An explanation for a prediction is a definably simple region of the feature space sharing the same label as the…

Machine Learning · Computer Science 2019-10-24 Brett Mullins

Linear approximations to the decision boundary of a complex model have become one of the most popular tools for interpreting predictions. In this paper, we study such linear explanations produced either post-hoc by a few recent methods or…

Machine Learning · Computer Science 2018-01-31 Maruan Al-Shedivat , Avinava Dubey , Eric P. Xing

State-of-the-art NLP methods achieve human-like performance on many tasks, but make errors nevertheless. Characterizing these errors in easily interpretable terms gives insight into whether a classifier is prone to making systematic errors,…

Computation and Language · Computer Science 2023-11-21 Michael A. Hedderich , Jonas Fischer , Dietrich Klakow , Jilles Vreeken

When predictive models are used to support complex and important decisions, the ability to explain a model's reasoning can increase trust, expose hidden biases, and reduce vulnerability to adversarial attacks. However, attempts at…

Machine Learning · Computer Science 2019-07-11 Dimitris Bertsimas , Arthur Delarue , Patrick Jaillet , Sebastien Martin

The last decade has seen huge progress in the development of advanced machine learning models; however, those models are powerless unless human users can interpret them. Here we show how the mind's construction of concepts and meaning can…

Machine Learning · Statistics 2016-07-04 Nick Condry

Providing personalized explanations for recommendations can help users to understand the underlying insight of the recommendation results, which is helpful to the effectiveness, transparency, persuasiveness and trustworthiness of…

Information Retrieval · Computer Science 2021-01-12 Hanxiong Chen , Xu Chen , Shaoyun Shi , Yongfeng Zhang

Attention mechanisms have improved the performance of NLP tasks while allowing models to remain explainable. Self-attention is currently widely used, however interpretability is difficult due to the numerous attention distributions. Recent…

Computation and Language · Computer Science 2020-10-30 Khalil Mrini , Franck Dernoncourt , Quan Tran , Trung Bui , Walter Chang , Ndapa Nakashole

Interpretation and explanation of deep models is critical towards wide adoption of systems that rely on them. In this paper, we propose a novel scheme for both interpretation as well as explanation in which, given a pretrained model, we…

Computer Vision and Pattern Recognition · Computer Science 2019-03-11 Jose Oramas , Kaili Wang , Tinne Tuytelaars

Explanations of neural models aim to reveal a model's decision-making process for its predictions. However, recent work shows that current methods giving explanations such as saliency maps or counterfactuals can be misleading, as they are…

Computation and Language · Computer Science 2023-07-03 Pepa Atanasova , Oana-Maria Camburu , Christina Lioma , Thomas Lukasiewicz , Jakob Grue Simonsen , Isabelle Augenstein

We formalize a novel modeling framework for achieving interpretability in deep learning, anchored in the principle of inference equivariance. While the direct verification of interpretability scales exponentially with the number of…

The provision of natural language explanations for the predictions of deep-learning-based vehicle controllers is critical as it enhances transparency and easy audit. In this work, a state-of-the-art (SOTA) prediction and explanation model…

Computation and Language · Computer Science 2023-04-18 Marc Alexander Kühn , Daniel Omeiza , Lars Kunze

With recent advances in natural language processing, rationalization becomes an essential self-explaining diagram to disentangle the black box by selecting a subset of input texts to account for the major variation in prediction. Yet,…

Machine Learning · Computer Science 2023-09-12 Wenbo Zhang , Tong Wu , Yunlong Wang , Yong Cai , Hengrui Cai