English
Related papers

Related papers: Play MNIST For Me! User Studies on the Effects of …

200 papers

Previous work has highlighted that existing post-hoc explanation methods exhibit disparities in explanation fidelity (across 'race' and 'gender' as sensitive attributes), and while a large body of work focuses on mitigating these issues at…

Machine Learning · Computer Science 2024-01-29 Vishwali Mhasawade , Salman Rahman , Zoe Haskell-Craig , Rumi Chunara

Post-hoc explanation techniques refer to a posteriori methods that can be used to explain how black-box machine learning models produce their outcomes. Among post-hoc explanation techniques, counterfactual explanations are becoming one of…

Machine Learning · Computer Science 2020-09-07 Ulrich Aïvodji , Alexandre Bolot , Sébastien Gambs

EXplainable AI has received significant attention in recent years. Machine learning models often operate as black boxes, lacking explainability and transparency while supporting decision-making processes. Local post-hoc explainability…

Artificial Intelligence · Computer Science 2024-05-24 Gianvincenzo Alfano , Sergio Greco , Domenico Mandaglio , Francesco Parisi , Reza Shahbazian , Irina Trubitsyna

Predicting default is essential for banks to ensure profitability and financial stability. While modern machine learning methods often outperform traditional regression techniques, their lack of transparency limits their use in regulated…

Machine Learning · Computer Science 2025-09-16 Sagi Schwartz , Qinling Wang , Fang Fang

The field of explainable artificial intelligence (XAI) aims to explain how black-box machine learning models work. Much of the work centers around the holy grail of providing post-hoc feature attributions to any model architecture. While…

Machine Learning · Computer Science 2023-11-15 Brian Barr , Noah Fatsi , Leif Hancox-Li , Peter Richter , Daniel Proano , Caleb Mok

As machine learning black boxes are increasingly being deployed in domains such as healthcare and criminal justice, there is growing emphasis on building tools and techniques for explaining these black boxes in an interpretable manner. Such…

Machine Learning · Computer Science 2020-02-04 Dylan Slack , Sophie Hilgard , Emily Jia , Sameer Singh , Himabindu Lakkaraju

There have been several post-hoc explanation approaches developed to explain pre-trained black-box neural networks. However, there is still a gap in research efforts toward designing neural networks that are inherently explainable. In this…

Computer Vision and Pattern Recognition · Computer Science 2022-07-01 Subash Khanal , Benjamin Brodie , Xin Xing , Ai-Ling Lin , Nathan Jacobs

Counterfactual post-hoc interpretability approaches have been proven to be useful tools to generate explanations for the predictions of a trained blackbox classifier. However, the assumptions they make about the data and the classifier make…

Machine Learning · Computer Science 2019-06-13 Thibault Laugel , Marie-Jeanne Lesot , Christophe Marsala , Marcin Detyniecki

State-of-the-art recommender systems have the ability to generate high-quality recommendations, but usually cannot provide intuitive explanations to humans due to the usage of black-box prediction models. The lack of transparency has…

Information Retrieval · Computer Science 2021-02-24 Shuyuan Xu , Yunqi Li , Shuchang Liu , Zuohui Fu , Xu Chen , Yongfeng Zhang

Convolutional Neural Networks (CNNs) are frequently and successfully used in medical prediction tasks. They are often used in combination with transfer learning, leading to improved performance when training data for the task are scarce.…

Computer Vision and Pattern Recognition · Computer Science 2026-01-22 Marta Oliveira , Rick Wilming , Benedict Clark , Céline Budding , Fabian Eitel , Kerstin Ritter , Stefan Haufe

Post-hoc interpretability approaches have been proven to be powerful tools to generate explanations for the predictions made by a trained black-box model. However, they create the risk of having explanations that are a result of some…

Machine Learning · Computer Science 2021-04-14 Thibault Laugel , Marie-Jeanne Lesot , Christophe Marsala , Xavier Renard , Marcin Detyniecki

Intelligent systems that use Machine Learning classification algorithms are increasingly common in everyday society. However, many systems use black-box models that do not have characteristics that allow for self-explanation of their…

Explainable AI (XAI) methods are commonly evaluated with functional metrics such as correctness, which computationally estimate how accurately an explanation reflects the model's reasoning. Higher correctness is assumed to produce better…

Human-Computer Interaction · Computer Science 2026-03-27 Gregor Baer , Chao Zhang , Isel Grau , Pieter Van Gorp

This paper addresses the problem of selective classification for deep neural networks, where a model is allowed to abstain from low-confidence predictions to avoid potential errors. We focus on so-called post-hoc methods, which replace the…

Machine Learning · Computer Science 2025-06-23 Luís Felipe P. Cattelan , Danilo Silva

Experimental user studies evaluating the effectiveness of different subtypes of post-hoc explanations for black-box models are largely nonexistent. Therefore, the aim of this study was to investigate and evaluate how different types of…

Human-Computer Interaction · Computer Science 2026-04-14 Tabea E. Röber , Paul Festor , Rob Goedhart , S. İlker Birbil , Aldo Faisal

In various business settings, there is an interest in using more complex machine learning techniques for sales forecasting. It is difficult to convince analysts, along with their superiors, to adopt these techniques since the models are…

Human-Computer Interaction · Computer Science 2021-08-20 Ana Lucic , Hinda Haned , Maarten de Rijke

The use of complex machine learning models can make systems opaque to users. Machine learning research proposes the use of post-hoc explanations. However, it is unclear if they give users insights into otherwise uninterpretable models. One…

Human-Computer Interaction · Computer Science 2019-05-09 Martin Schuessler , Philipp Weiß

Confidence calibration is a major concern when applying artificial neural networks in safety-critical applications. Since most research in this area has focused on classification in the past, confidence calibration in the scope of object…

Computer Vision and Pattern Recognition · Computer Science 2021-01-11 Franziska Schwaiger , Maximilian Henne , Fabian Küppers , Felippe Schmoeller Roza , Karsten Roscher , Anselm Haselhoff

AI assistants will occasionally respond deceptively to user queries. Recently, linear classifiers (called "deception probes") have been trained to distinguish the internal activations of a language model during deceptive versus honest…

Artificial Intelligence · Computer Science 2026-01-21 Avi Parrack , Carlo Leonardo Attubato , Stefan Heimersheim

With the rapid development of eXplainable Artificial Intelligence (XAI), a long line of past work has shown concerns about the Out-of-Distribution (OOD) problem in perturbation-based post-hoc XAI models and explanations are socially…

Machine Learning · Computer Science 2022-06-23 Liu Zhendong , Wenyu Jiang , Yi Zhang , Chongjun Wang