English
Related papers

Related papers: Does It Make Sense to Explain a Black Box With Ano…

200 papers

Binary classifiers are traditionally studied by propositional logic (PL). PL can only represent them as white boxes, under the assumption that the underlying Boolean function is fully known. Binary classifiers used in practical applications…

Logic in Computer Science · Computer Science 2024-03-04 Xinghan Liu , Emiliano Lorini

A variety of explanation methods have been proposed in recent years to help users gain insights into the results returned by neural networks, which are otherwise complex and opaque black-boxes. However, explanations give rise to potential…

Machine Learning · Computer Science 2022-06-29 Pengrui Quan , Supriyo Chakraborty , Jeya Vikranth Jeyakumar , Mani Srivastava

Existing algorithms for generating Counterfactual Explanations (CXs) for Machine Learning (ML) typically assume fully specified inputs. However, real-world data often contains missing values, and the impact of these incomplete inputs on the…

Artificial Intelligence · Computer Science 2026-04-10 Francesco Leofante , Daniel Neider , Mustafa Yalçıner

Neural networks are widely regarded as black-box models, creating significant challenges in understanding their inner workings, especially in natural language processing (NLP) applications. To address this opacity, model explanation…

Computation and Language · Computer Science 2025-01-10 Melkamu Mersha , Mingiziem Bitewa , Tsion Abay , Jugal Kalita

Counterfactual explanation is an important Explainable AI technique to explain machine learning predictions. Despite being studied actively, existing optimization-based methods often assume that the underlying machine-learning model is…

Artificial Intelligence · Computer Science 2022-06-01 Wenzhuo Yang , Jia Li , Caiming Xiong , Steven C. H. Hoi

Counterfactual explanations offer actionable insights by illustrating how changes to inputs can lead to different outcomes. However, these explanations often suffer from ambiguity and impracticality, limiting their utility for non-expert…

Human-Computer Interaction · Computer Science 2025-04-22 Aditya Bhattacharya , Tim Vanherwegen , Katrien Verbert

There has been a recent resurgence of interest in explainable artificial intelligence (XAI) that aims to reduce the opaqueness of AI-based decision-making systems, allowing humans to scrutinize and trust them. Prior work in this context has…

Artificial Intelligence · Computer Science 2021-06-24 Sainyam Galhotra , Romila Pradhan , Babak Salimi

As machine learning models evolve, maintaining transparency demands more human-centric explainable AI techniques. Counterfactual explanations, with roots in human reasoning, identify the minimal input changes needed to obtain a given output…

Artificial Intelligence · Computer Science 2025-04-23 Marharyta Domnich , Julius Välja , Rasmus Moorits Veski , Giacomo Magnifico , Kadi Tulver , Eduard Barbu , Raul Vicente

Counterfactual inference is a powerful tool for analysing and evaluating autonomous agents, but its application to language model (LM) agents remains challenging. Existing work on counterfactuals in LMs has primarily focused on token-level…

Machine Learning · Computer Science 2025-06-04 Edoardo Pona , Milad Kazemi , Yali Du , David Watson , Nicola Paoletti

In many applications, it is important to be able to explain the decisions of machine learning systems. An increasingly popular approach has been to seek to provide \emph{counterfactual instance explanations}. These specify close possible…

Artificial Intelligence · Computer Science 2021-09-22 Adam White , Artur d'Avila Garcez

Natural language processing (NLP) models often replicate or amplify social bias from training data, raising concerns about fairness. At the same time, their black-box nature makes it difficult for users to recognize biased predictions and…

Computation and Language · Computer Science 2026-02-12 Yifan Wang , Mayank Jobanputra , Ji-Ung Lee , Soyoung Oh , Isabel Valera , Vera Demberg

For AI systems to garner widespread public acceptance, we must develop methods capable of explaining the decisions of black-box models such as neural networks. In this work, we identify two issues of current explanatory methods. First, we…

Computation and Language · Computer Science 2019-12-06 Oana-Maria Camburu , Eleonora Giunchiglia , Jakob Foerster , Thomas Lukasiewicz , Phil Blunsom

We are used to the availability of big data generated in nearly all fields of science as a consequence of technological progress. However, the analysis of such data possess vast challenges. One of these relates to the explainability of…

Artificial Intelligence · Computer Science 2022-09-14 Frank Emmert-Streib , Olli Yli-Harja , Matthias Dehmer

Modern instance-based model-agnostic explanation methods (LIME, SHAP, L2X) are of great use in data-heavy industries for model diagnostics, and for end-user explanations. These methods generally return either a weighting or subset of input…

Machine Learning · Computer Science 2019-12-03 Matt Chapman-Rounds , Marc-Andre Schulz , Erik Pazos , Konstantinos Georgatzis

While deep neural networks are extremely effective at classifying images, they remain opaque and hard to interpret. We introduce local and global explanation methods for black-box models that generate explanations in terms of…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Bhavan Vasu , Giuseppe Raffa , Prasad Tadepalli

Sophisticated machine models are increasingly used for high-stakes decisions in everyday life. There is an urgent need to develop effective explanation techniques for such automated decisions. Rule-Based Explanations have been proposed for…

Machine Learning · Computer Science 2022-11-01 Zixuan Geng , Maximilian Schleich , Dan Suciu

Counterfactual explanations (CEs) are a practical tool for demonstrating why machine learning classifiers make particular decisions. For CEs to be useful, it is important that they are easy for users to interpret. Existing methods for…

Machine Learning · Computer Science 2021-03-17 Lisa Schut , Oscar Key , Rory McGrath , Luca Costabello , Bogdan Sacaleanu , Medb Corcoran , Yarin Gal

Understanding the behavior of large language models (LLMs) is crucial for ensuring their safe and reliable use. However, existing explainable AI (XAI) methods for LLMs primarily rely on word-level explanations, which are often…

Computation and Language · Computer Science 2025-08-08 Furui Cheng , Vilém Zouhar , Robin Shing Moon Chan , Daniel Fürst , Hendrik Strobelt , Mennatallah El-Assady

Explaining autonomous and intelligent systems is critical in order to improve trust in their decisions. Counterfactuals have emerged as one of the most compelling forms of explanation. They address ``why not'' questions by revealing how…

Artificial Intelligence · Computer Science 2026-02-05 Leila Amgoud , Martin Cooper

With the development and proliferation of large, complex, black-box models for solving many natural language processing (NLP) tasks, there is also an increasing necessity of methods to stress-test these models and provide some degree of…

Computation and Language · Computer Science 2024-11-20 Amrita Bhattacharjee , Raha Moraffah , Joshua Garland , Huan Liu