English
Related papers

Related papers: Towards Compositional Interpretability for XAI

200 papers

Interactive Artificial Intelligence (AI) agents are becoming increasingly prevalent in society. However, application of such systems without understanding them can be problematic. Black-box AI systems can lead to liability and…

Computers and Society · Computer Science 2023-01-16 Pradyumna Tambwekar , Matthew Gombolay

As machine learning models become increasingly prevalent in medical diagnostics, the need for interpretability and transparency becomes paramount. The XAI Renaissance signifies a significant shift in the field, aiming to redefine the…

Machine Learning · Computer Science 2023-06-05 Sujith K Mandala

Deep learning is becoming increasingly adopted in business and industry due to its ability to transform large quantities of data into high-performing models. These models, however, are generally regarded as black boxes, which, in spite of…

Machine Learning · Computer Science 2023-02-21 Stefan Druc , Peter Wooldridge , Adarsh Krishnamurthy , Soumik Sarkar , Aditya Balu

Mechanistic interpretability aims to explain neural model behaviour by reverse-engineering learned computational structure into human-understandable components. Without a formal framework, however, mechanistic explanations cannot be…

Machine Learning · Computer Science 2026-05-12 Ward Gauderis , Thomas Dooms , Steven T. Holmer , Kola Ayonrinde , Geraint A. Wiggins

This paper presents a comprehensive theoretical investigation into the parameterized complexity of explanation problems in various machine learning (ML) models. Contrary to the prevalent black-box perception, our study focuses on models…

Artificial Intelligence · Computer Science 2025-11-06 Sebastian Ordyniak , Giacomo Paesani , Mateusz Rychlicki , Stefan Szeider

As large language models (LLMs) are increasingly deployed in sensitive domains such as healthcare, law, and education, the demand for transparent, interpretable, and accountable AI systems becomes more urgent. Explainable AI (XAI) acts as a…

Computers and Society · Computer Science 2025-05-28 Francisco Herrera

Recent advancements in artificial intelligence (AI) have facilitated its widespread adoption in primary medical services, addressing the demand-supply imbalance in healthcare. Vision Transformers (ViT) have emerged as state-of-the-art…

Computer Vision and Pattern Recognition · Computer Science 2023-09-04 Tin Lai

Artificial intelligence is reshaping science and industry, yet many users still regard its models as opaque "black boxes". Conventional explainable artificial-intelligence methods clarify individual predictions but overlook the upstream…

Machine Learning · Computer Science 2025-08-18 George Paterakis , Andrea Castellani , George Papoutsoglou , Tobias Rodemann , Ioannis Tsamardinos

Explainable artificial intelligence (XAI) plays an indispensable role in demystifying the decision-making processes of AI, especially within the healthcare industry. Clinicians rely heavily on detailed reasoning when making a diagnosis,…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Anna Stubbin , Thompson Chyrikov , Jim Zhao , Christina Chajo

As artificial intelligence systems become increasingly integrated into daily life, the field of explainability has gained significant attention. This trend is particularly driven by the complexity of modern AI models and their…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Rémi Kazmierczak , Eloïse Berthier , Goran Frehse , Gianni Franchi

Artificial Intelligence models are becoming increasingly more powerful and accurate, supporting or even replacing humans' decision making. But with increased power and accuracy also comes higher complexity, making it hard for users to…

Artificial Intelligence · Computer Science 2019-07-10 Vivian S. Silva , André Freitas , Siegfried Handschuh

A main drawback of eXplainable Artificial Intelligence (XAI) approaches is the feature independence assumption, hindering the study of potential variable dependencies. This leads to approximating black box behaviors by analyzing the effects…

Artificial Intelligence · Computer Science 2024-10-16 Martina Cinquini , Riccardo Guidotti

Recent advancements in AI applications to healthcare have shown incredible promise in surpassing human performance in diagnosis and disease prognosis. With the increasing complexity of AI models, however, concerns regarding their opacity,…

Machine Learning · Computer Science 2023-08-17 Munib Mesinovic , Peter Watkinson , Tingting Zhu

Explainable AI (XAI) has been investigated for decades and, together with AI itself, has witnessed unprecedented growth in recent years. Among various approaches to XAI, argumentative models have been advocated in both the AI and social…

Artificial Intelligence · Computer Science 2021-05-25 Kristijonas Čyras , Antonio Rago , Emanuele Albini , Pietro Baroni , Francesca Toni

Explainable AI (XAI) is a necessity in safety-critical systems such as in clinical diagnostics due to a high risk for fatal decisions. Currently, however, XAI resembles a loose collection of methods rather than a well-defined process. In…

Computer Vision and Pattern Recognition · Computer Science 2022-07-12 Lukas Klein , Mennatallah El-Assady , Paul F. Jäger

Explainable AI (XAI) methods focus on explaining what a neural network has learned - in other words, identifying the features that are the most influential to the prediction. In this paper, we call them "distinguishing features". However,…

Computer Vision and Pattern Recognition · Computer Science 2021-04-19 Kaili Wang , Jose Oramas , Tinne Tuytelaars

This review paper provides an integrated perspective of Explainable Artificial Intelligence techniques applied to Brain-Computer Interfaces. BCIs use predictive models to interpret brain signals for various high-stake applications. However,…

Human-Computer Interaction · Computer Science 2023-12-21 Param Rajpura , Hubert Cecotti , Yogesh Kumar Meena

Explainable AI (XAI) seeks to transform black-box algorithmic processes into transparent ones, enhancing trust in AI applications across various sectors such as education. This review aims to examine the various definitions of XAI within…

Computers and Society · Computer Science 2025-04-07 Zaid M. Altukhi , Sojen Pradhan

Explainable Artificial Intelligence (XAI) has emerged as a critical tool for interpreting the predictions of complex deep learning models. While XAI has been increasingly applied in various domains within acoustics, its use in bioacoustics,…

Sound · Computer Science 2025-09-11 Zubair Faruqui , Mackenzie S. McIntire , Rahul Dubey , Jay McEntee

Interpretability of machine learning models has gained more and more attention among researchers in the artificial intelligence (AI) and human-computer interaction (HCI) communities. Most existing work focuses on decision making, whereas we…

Human-Computer Interaction · Computer Science 2020-04-16 Haizi Yu , Heinrich Taube , James A. Evans , Lav R. Varshney