English
Related papers

Related papers: A Framework for Evaluating Post Hoc Feature-Additi…

200 papers

Using feature attributions for post-hoc explanations is a common practice to understand and verify the predictions of opaque machine learning models. Despite the numerous techniques available, individual methods often produce inconsistent…

Machine Learning · Computer Science 2024-06-10 Thomas Decker , Ananta R. Bhattarai , Jindong Gu , Volker Tresp , Florian Buettner

In many scenarios, the interpretability of machine learning models is a highly required but difficult task. To explain the individual predictions of such models, local model-agnostic approaches have been proposed. However, the process…

Machine Learning · Statistics 2025-10-22 Gianluigi Lopardo , Frederic Precioso , Damien Garreau

The widespread adoption of black-box models in Artificial Intelligence has enhanced the need for explanation methods to reveal how these obscure models reach specific decisions. Retrieving explanations is fundamental to unveil possible…

Artificial Intelligence · Computer Science 2021-02-26 Francesco Bodria , Fosca Giannotti , Riccardo Guidotti , Francesca Naretto , Dino Pedreschi , Salvatore Rinzivillo

Since the early days of the Explainable AI movement, post-hoc explanations have been praised for their potential to improve user understanding, promote trust, and reduce patient safety risks in black box medical AI systems. Recently,…

Human-Computer Interaction · Computer Science 2026-02-06 Joshua Hatherley , Lauritz Munch , Jens Christian Bjerring

The growing complexity of machine learning and deep learning models has led to an increased reliance on opaque "black box" systems, making it difficult to understand the rationale behind predictions. This lack of transparency is…

Machine Learning · Computer Science 2025-02-06 Pratinav Seth , Yashwardhan Rathore , Neeraj Kumar Singh , Chintan Chitroda , Vinay Kumar Sankarapu

Explainable AI (XAI) has been proposed as a valuable tool to assist in downstream tasks involving human and AI collaboration. Perhaps the most psychologically valid XAI techniques are case based approaches which display 'whole' exemplars to…

Artificial Intelligence · Computer Science 2023-11-07 Eoin Kenny , Eoin Delaney , Mark Keane

EXplainable AI has received significant attention in recent years. Machine learning models often operate as black boxes, lacking explainability and transparency while supporting decision-making processes. Local post-hoc explainability…

Artificial Intelligence · Computer Science 2024-05-24 Gianvincenzo Alfano , Sergio Greco , Domenico Mandaglio , Francesco Parisi , Reza Shahbazian , Irina Trubitsyna

Post-hoc importance attribution methods are a popular tool for "explaining" Deep Neural Networks (DNNs) and are inherently based on the assumption that the explanations can be applied independently of how the models were trained.…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Siddhartha Gairola , Moritz Böhle , Francesco Locatello , Bernt Schiele

Recent research in explainability has given rise to numerous post-hoc attribution methods aimed at enhancing our comprehension of the outputs of black-box machine learning models. However, evaluating the quality of explanations lacks a…

Machine Learning · Computer Science 2024-07-30 Samuel Sithakoul , Sara Meftah , Clément Feutry

Most existing interpretable methods explain a black-box model in a post-hoc manner, which uses simpler models or data analysis techniques to interpret the predictions after the model is learned. However, they (a) may derive contradictory…

Machine Learning · Computer Science 2020-01-22 Mengzhuo Guo , Qingpeng Zhang , Xiuwu Liao , Daniel Dajun Zeng

Previous work has highlighted that existing post-hoc explanation methods exhibit disparities in explanation fidelity (across 'race' and 'gender' as sensitive attributes), and while a large body of work focuses on mitigating these issues at…

Machine Learning · Computer Science 2024-01-29 Vishwali Mhasawade , Salman Rahman , Zoe Haskell-Craig , Rumi Chunara

Explanations in Machine Learning come in many forms, but a consensus regarding their desired properties is yet to emerge. In this paper we introduce a taxonomy and a set of descriptors that can be used to characterise and systematically…

Machine Learning · Computer Science 2019-12-12 Kacper Sokol , Peter Flach

Explainable artificial intelligence techniques are developed at breakneck speed, but suitable evaluation approaches lag behind. With explainers becoming increasingly complex and a lack of consensus on how to assess their utility, it is…

Human-Computer Interaction · Computer Science 2023-04-18 Edward Small , Yueqing Xuan , Danula Hettiachchi , Kacper Sokol

We often see the term explainable in the titles of papers that describe applications based on artificial intelligence (AI). However, the literature in explainable artificial intelligence (XAI) indicates that explanations in XAI are…

Artificial Intelligence · Computer Science 2023-08-30 Mallika Mainali , Rosina O Weber

The use of sophisticated machine learning models for critical decision making is faced with a challenge that these models are often applied as a "black-box". This has led to an increased interest in interpretable machine learning, where…

Artificial Intelligence · Computer Science 2020-07-22 Catarina Moreira , Yu-Liang Chou , Mythreyi Velmurugan , Chun Ouyang , Renuka Sindhgatta , Peter Bruza

The rise of AI methods to make predictions and decisions has led to a pressing need for more explainable artificial intelligence (XAI) methods. One common approach for XAI is to produce a post-hoc explanation, explaining why a black box ML…

Artificial Intelligence · Computer Science 2022-12-01 Jinqiang Yu , Alexey Ignatiev , Peter J. Stuckey , Nina Narodytska , Joao Marques-Silva

Machine learning algorithms are being used in high-stakes decisions, including those in criminal justice, healthcare, credit, and employment. The research community has responded with two largely independent research fields:…

Artificial Intelligence · Computer Science 2026-05-12 Gideon Popoola , John Sheppard

Predictive modeling is invaded by elastic, yet complex methods such as neural networks or ensembles (model stacking, boosting or bagging). Such methods are usually described by a large number of parameters or hyper parameters - a price that…

Machine Learning · Statistics 2019-03-01 Przemyslaw Biecek

The emergence of large-scale pretrained language models has posed unprecedented challenges in deriving explanations of why the model has made some predictions. Stemmed from the compositional nature of languages, spurious correlations have…

Computation and Language · Computer Science 2023-05-04 Ruochen Zhao , Shafiq Joty , Yongjie Wang , Tan Wang

Neural networks for NLP are becoming increasingly complex and widespread, and there is a growing concern if these models are responsible to use. Explaining models helps to address the safety and ethical concerns and is essential for…

Computation and Language · Computer Science 2023-11-29 Andreas Madsen , Siva Reddy , Sarath Chandar