English
Related papers

Related papers: ABE: A Unified Framework for Robust and Faithful A…

200 papers

In the field of artificial intelligence, AI models are frequently described as `black boxes' due to the obscurity of their internal mechanisms. It has ignited research interest on model interpretability, especially in attribution methods…

Machine Learning · Computer Science 2024-08-16 Zhiyu Zhu , Zhibo Jin , Jiayu Zhang , Huaming Chen

To better understand the output of deep neural networks (DNN), attribution based methods have been an important approach for model interpretability, which assign a score for each input dimension to indicate its importance towards the model…

Computer Vision and Pattern Recognition · Computer Science 2023-12-22 Zhiyu Zhu , Huaming Chen , Jiayu Zhang , Xinyi Wang , Zhibo Jin , Minhui Xue , Dongxiao Zhu , Kim-Kwang Raymond Choo

Deep learning (DL) algorithms are becoming ubiquitous in everyday life and in scientific research. However, the price we pay for their impressively accurate predictions is significant: their inner workings are notoriously opaque - it is…

Machine Learning · Computer Science 2026-01-26 Florian J. Boge , Annika Schuster

The growing reliance on deep learning models in safety-critical domains such as healthcare and autonomous navigation underscores the need for defenses that are both robust to adversarial perturbations and transparent in their…

Machine Learning · Computer Science 2026-01-06 Longwei Wang , Mohammad Navid Nayyem , Abdullah Al Rakin , KC Santosh , Chaowei Zhang , Yang Zhou

As machine learning and algorithmic decision making systems are increasingly being leveraged in high-stakes human-in-the-loop settings, there is a pressing need to understand the rationale of their predictions. Researchers have responded to…

Machine Learning · Computer Science 2020-12-07 Jonathan Dinu , Jeffrey Bigham , J. Zico Kolter

Advancements in deep learning techniques have given a boost to the performance of anomaly detection. However, real-world and safety-critical applications demand a level of transparency and reasoning beyond accuracy. The task of anomaly…

Machine Learning · Computer Science 2023-11-03 Laya Rafiee Sevyeri , Ivaxi Sheth , Farhood Farahnak , Samira Ebrahimi Kahou , Shirin Abbasinejad Enger

We present IXAM, an Interactive eXplainability framework for Authorship Attribution Models. Given an authorship attribution (AA) task and an embedding-based AA model, our tool enables users to interactively explore the model's embedding…

Computation and Language · Computer Science 2025-12-09 Milad Alshomary , Anisha Bhatnagar , Peter Zeng , Smaranda Muresan , Owen Rambow , Kathleen McKeown

Attribution maps are popular tools for explaining neural networks predictions. By assigning an importance value to each input dimension that represents its impact towards the outcome, they give an intuitive explanation of the decision…

Machine Learning · Computer Science 2022-03-09 Adam Ivankay , Ivan Girardi , Chiara Marchiori , Pascal Frossard

Large language models (LLMs) exhibit remarkable capabilities, yet their reasoning remains opaque, raising safety and trust concerns. Attribution methods, which assign credit to input features, have proven effective for explaining the…

Artificial Intelligence · Computer Science 2025-12-18 Chase Walker , Rickard Ewetz

Explainable Artificial Intelligence (XAI) aims to make machine learning models transparent and trustworthy, yet most current approaches communicate explanations visually or through text. This paper introduces an information theoretic…

Human-Computer Interaction · Computer Science 2026-02-10 Mona Rajhans , Vishal Khawarey

Explainability of AI models is an important topic that can have a significant impact in all domains and applications from autonomous driving to healthcare. The existing approaches to explainable AI (XAI) are mainly limited to simple machine…

Machine Learning · Computer Science 2023-05-24 Poushali Sengupta , Yan Zhang , Sabita Maharjan , Frank Eliassen

Artificial intelligence-driven adaptive learning systems are reshaping education through data-driven adaptation of learning experiences. Yet many of these systems lack transparency, offering limited insight into how decisions are made. Most…

Artificial Intelligence · Computer Science 2025-08-04 Maryam Mosleh , Marie Devlin , Ellis Solaiman

Recent advances in artificial intelligence research have led to a profusion of studies that apply deep learning to problems in image analysis and natural language processing among others. Additionally, the availability of open-source…

As machine learning models grow more complex and their applications become more high-stakes, tools for explaining model predictions have become increasingly important. This has spurred a flurry of research in model explainability and has…

Machine Learning · Computer Science 2021-11-08 Yang Liu , Sujay Khandagale , Colin White , Willie Neiswanger

Algorithmic solutions have significant potential to improve decision-making across various domains, from healthcare to e-commerce. However, the widespread adoption of these solutions is hindered by a critical challenge: the lack of…

Machine Learning · Computer Science 2025-03-11 Zuzanna Bączek , Michał Bizoń , Aneta Pawelec , Piotr Sankowski

Deep learning models have achieved remarkable success in different areas of machine learning over the past decade; however, the size and complexity of these models make them difficult to understand. In an effort to make them more…

Computer Vision and Pattern Recognition · Computer Science 2022-06-20 Vikram V. Ramaswamy , Sunnie S. Y. Kim , Nicole Meister , Ruth Fong , Olga Russakovsky

The black box problem in machine learning has led to the introduction of an ever-increasing set of explanation methods for complex models. These explanations have different properties, which in turn has led to the problem of method…

Machine Learning · Computer Science 2024-12-19 Arne Gevaert , Yvan Saeys

The accelerated progress of artificial intelligence (AI) has popularized deep learning models across various domains, yet their inherent opacity poses challenges, particularly in critical fields like healthcare, medicine, and the…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Michail Mamalakis , Antonios Mamalakis , Ingrid Agartz , Lynn Egeland Mørch-Johnsen , Graham Murray , John Suckling , Pietro Lio

Post-hoc explainable AI (XAI) methods typically produce deterministic attribution maps, whereas Bayesian neural networks (BNNs) induce a distribution over explanations. Capturing the variability of this distribution is important for…

Machine Learning · Computer Science 2026-05-21 Yinsong Chen , Samson S. Yu , Zhong Li , Chee Peng Lim

Attribution methods are among the most prevalent techniques in Explainable Artificial Intelligence (XAI) and are usually evaluated and compared using Fidelity metrics, with Insertion and Deletion being the most popular. These metrics rely…

Artificial Intelligence · Computer Science 2025-12-15 Agustin Martin Picard , Thibaut Boissin , Varshini Subhash , Rémi Cadène , Thomas Fel