English
Related papers

Related papers: Robustness and Usefulness in AI Explanation Method…

200 papers

Automated decision-making systems are becoming increasingly ubiquitous, which creates an immediate need for their interpretability and explainability. However, it remains unclear whether users know what insights an explanation offers and,…

Human-Computer Interaction · Computer Science 2024-09-27 Yueqing Xuan , Edward Small , Kacper Sokol , Danula Hettiachchi , Mark Sanderson

The growing capabilities of AI models are leading to their wider use, including in safety-critical domains. Explainable AI (XAI) aims to make these models safer to use by making their inference process more transparent. However, current…

Understanding why a classification model prefers one class over another for an input instance is the challenge of contrastive explanation. This work implements concept-based contrastive explanations for image classification by leveraging…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Yuliia Kaidashova , Bettina Finzel , Ute Schmid

Neural networks are widely regarded as black-box models, creating significant challenges in understanding their inner workings, especially in natural language processing (NLP) applications. To address this opacity, model explanation…

Computation and Language · Computer Science 2025-01-10 Melkamu Mersha , Mingiziem Bitewa , Tsion Abay , Jugal Kalita

Recent work on interpretability in machine learning and AI has focused on the building of simplified models that approximate the true criteria used to make decisions. These models are a useful pedagogical device for teaching trained…

Artificial Intelligence · Computer Science 2018-11-06 Brent Mittelstadt , Chris Russell , Sandra Wachter

Deep Learning NLP domain lacks procedures for the analysis of model robustness. In this paper we propose a framework which validates robustness of any Question Answering model through model explainers. We propose that a robust model should…

Computation and Language · Computer Science 2018-12-07 Barbara Rychalska , Dominika Basaj , Przemyslaw Biecek

The adoption of machine learning in high-stakes applications such as healthcare and law has lagged in part because predictions are not accompanied by explanations comprehensible to the domain user, who often holds the ultimate…

With the availability of large databases and recent improvements in deep learning methodology, the performance of AI systems is reaching or even exceeding the human level on an increasing number of complex tasks. Impressive examples of this…

Artificial Intelligence · Computer Science 2017-08-29 Wojciech Samek , Thomas Wiegand , Klaus-Robert Müller

Recent years have seen a boom in interest in machine learning systems that can provide a human-understandable rationale for their predictions or decisions. However, exactly what kinds of explanation are truly human-interpretable remains…

Artificial Intelligence · Computer Science 2018-02-05 Menaka Narayanan , Emily Chen , Jeffrey He , Been Kim , Sam Gershman , Finale Doshi-Velez

In the present paper we present the potential of Explainable Artificial Intelligence methods for decision-support in medical image analysis scenarios. With three types of explainable methods applied to the same medical image data set our…

Artificial Intelligence · Computer Science 2021-05-20 Samanta Knapič , Avleen Malhi , Rohit Saluja , Kary Främling

As neural networks become dominant in essential systems, Explainable Artificial Intelligence (XAI) plays a crucial role in fostering trust and detecting potential misbehavior of opaque models. LIME (Local Interpretable Model-agnostic…

Machine Learning · Computer Science 2025-04-01 Patrick Knab , Sascha Marton , Udo Schlegel , Christian Bartelt

In-context learning (ICL) has emerged as a successful paradigm for leveraging large language models (LLMs). However, it often struggles to generalize beyond the distribution of the provided demonstrations. A recent advancement in enhancing…

Computation and Language · Computer Science 2025-06-04 Ukyo Honda , Tatsushi Oka

Model interpretability is an increasingly important component of practical machine learning. Some of the most common forms of interpretability systems are example-based, local, and global explanations. One of the main challenges in…

Machine Learning · Computer Science 2019-01-08 Gregory Plumb , Denali Molitor , Ameet Talwalkar

Explainable Artificial Intelligence (XAI) aims to make machine learning models transparent and trustworthy, yet most current approaches communicate explanations visually or through text. This paper introduces an information theoretic…

Human-Computer Interaction · Computer Science 2026-02-10 Mona Rajhans , Vishal Khawarey

Machine learning and especially deep learning have garneredtremendous popularity in recent years due to their increased performanceover other methods. The availability of large amount of data has aidedin the progress of deep learning.…

Machine Learning · Computer Science 2019-09-06 Sharath M. Shankaranarayana , Davor Runje

Automated Machine Learning-based systems' integration into a wide range of tasks has expanded as a result of their performance and speed. Although there are numerous advantages to employing ML-based systems, if they are not interpretable,…

Machine Learning · Computer Science 2022-12-08 Ioannis Mollas , Nick Bassiliades , Grigorios Tsoumakas

Recent work has investigated the concept of adversarial attacks on explainable AI (XAI) in the NLP domain with a focus on examining the vulnerability of local surrogate methods such as Lime to adversarial perturbations or small changes on…

Machine Learning · Computer Science 2025-01-07 Christopher Burger , Charles Walter , Thai Le , Lingwei Chen

The main objective of eXplainable Artificial Intelligence (XAI) is to provide effective explanations for black-box classifiers. The existing literature lists many desirable properties for explanations to be useful, but there is no consensus…

Artificial Intelligence · Computer Science 2021-06-02 Elvio G. Amparore , Alan Perotti , Paolo Bajardi

Artificial intelligence (AI) has rapidly developed through advancements in computational power and the growth of massive datasets. However, this progress has also heightened challenges in interpreting the "black-box" nature of AI models. To…

Computer Vision and Pattern Recognition · Computer Science 2024-12-19 Shilin Sun , Wenbin An , Feng Tian , Fang Nan , Qidong Liu , Jun Liu , Nazaraf Shah , Ping Chen

Counterfactual explanations (CEs) are advocated as being ideally suited to providing algorithmic recourse for subjects affected by the predictions of machine learning models. While CEs can be beneficial to affected individuals, recent work…

Machine Learning · Computer Science 2024-02-06 Junqi Jiang , Francesco Leofante , Antonio Rago , Francesca Toni