English
Related papers

Related papers: Balanced background and explanation data are neede…

200 papers

Interpretable machine learning has been focusing on explaining final models that optimize performance. The current state-of-the-art is the Shapley additive explanations (SHAP) that locally explains variable impact on individual predictions,…

We examine counterfactual explanations for explaining the decisions made by model-based AI systems. The counterfactual approach we consider defines an explanation as a set of the system's data inputs that causally drives the decision (i.e.,…

Machine Learning · Computer Science 2021-10-14 Carlos Fernández-Loría , Foster Provost , Xintian Han

Model agnostic feature attribution algorithms (such as SHAP and LIME) are ubiquitous techniques for explaining the decisions of complex classification models, such as deep neural networks. However, since complex classification models…

Machine Learning · Computer Science 2022-11-29 Ron Bitton , Alon Malach , Amiel Meiseles , Satoru Momiyama , Toshinori Araki , Jun Furukawa , Yuval Elovici , Asaf Shabtai

Deep Neural Networks (DNNs) have demonstrated strong capacity in supporting a wide variety of applications. Shapley value has emerged as a prominent tool to analyze feature importance to help people understand the inference process of deep…

Machine Learning · Statistics 2025-02-19 Xiaolei Lu

Deep learning models are being increasingly applied to imbalanced data in high stakes fields such as medicine, autonomous driving, and intelligence analysis. Imbalanced data compounds the black-box nature of deep networks because the…

Machine Learning · Computer Science 2022-12-16 Damien A. Dablain , Colin Bellinger , Bartosz Krawczyk , David W. Aha , Nitesh V. Chawla

While SHAP (SHapley Additive exPlanations) and other feature attribution methods are commonly employed to explain model predictions, their application within information retrieval (IR), particularly for complex outputs such as ranked lists,…

Information Retrieval · Computer Science 2025-05-01 Maria Heuss , Maarten de Rijke , Avishek Anand

Explainable Artificial Intelligence (XAI) has become an increasingly important area of research, particularly as machine learning models are deployed in high-stakes domains. Among various XAI approaches, SHAP (SHapley Additive exPlanations)…

Artificial Intelligence · Computer Science 2026-04-15 Latifa Dwiyanti , Sergio Ryan Wibisono , Hidetaka Nambo

In the context of unsupervised learning, effective clustering plays a vital role in revealing patterns and insights from unlabeled data. However, the success of clustering algorithms often depends on the relevance and contribution of…

Machine Learning · Computer Science 2025-03-18 Fabian Galis , Darian Onchis

Post-hoc explainability methods aim to clarify predictions of black-box machine learning models. However, it is still largely unclear how well users comprehend the provided explanations and whether these increase the users ability to…

Machine Learning · Computer Science 2023-09-22 Anahid Jalali , Bernhard Haslhofer , Simone Kriglstein , Andreas Rauber

Post hoc explainers such as SHAP and LIME are used widely in business research to interpret complex machine learning models. Although they were designed to explain model predictions, there has been an increasing trend in which the…

Machine Learning · Computer Science 2026-03-10 Tong Wang , Ronilo Ragodos , Lu Feng , Yu , Hu

In Explainable AI (XAI), Shapley values are a popular model-agnostic framework for explaining predictions made by complex machine learning models. The computation of Shapley values requires estimating non-trivial contribution functions…

Machine Learning · Computer Science 2026-01-27 Lars Henry Berge Olsen , Martin Jullum

Machine learning (ML) for transient stability assessment has gained traction due to the significant increase in computational requirements as renewables connect to power systems. To achieve a high degree of accuracy; black-box ML models are…

Systems and Control · Electrical Eng. & Systems 2023-02-14 Robert I. Hamilton , Panagiotis N. Papadopoulos

In the domain of black-box model extraction, conventional methods reliant on soft labels or surrogate datasets struggle with scaling to high-dimensional input spaces and managing the complexity of an extensive array of interrelated classes.…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Somnath Sendhil Kumar , Yuvaraj Govindarajulu , Pavan Kulkarni , Manojkumar Parmar

Common approaches to explainable AI (XAI) for deep learning focus on analyzing the importance of input features on the classification task in a given model: saliency methods like SHAP and GradCAM are used to measure the impact of spatial…

Computer Vision and Pattern Recognition · Computer Science 2025-12-08 Anne Sielemann , Valentin Barner , Stefan Wolf , Masoud Roschani , Jens Ziehn , Juergen Beyerer

A number of techniques have been proposed to explain a machine learning model's prediction by attributing it to the corresponding input features. Popular among these are techniques that apply the Shapley value method from cooperative game…

Machine Learning · Computer Science 2020-06-29 Luke Merrick , Ankur Taly

Previous work has highlighted that existing post-hoc explanation methods exhibit disparities in explanation fidelity (across 'race' and 'gender' as sensitive attributes), and while a large body of work focuses on mitigating these issues at…

Machine Learning · Computer Science 2024-01-29 Vishwali Mhasawade , Salman Rahman , Zoe Haskell-Craig , Rumi Chunara

Machine Learning (ML) is becoming increasingly popular in fluid dynamics. Powerful ML algorithms such as neural networks or ensemble methods are notoriously difficult to interpret. Here, we introduce the novel Shapley Additive Explanations…

Fluid Dynamics · Physics 2022-05-20 Martin Lellep , Jonathan Prexl , Bruno Eckhardt , Moritz Linkmann

In recent years, the Shapley value and SHAP explanations have emerged as one of the most dominant paradigms for providing post-hoc explanations of black-box models. Despite their well-founded theoretical properties, many recent works have…

Machine Learning · Computer Science 2025-02-21 James Enouen , Yan Liu

In the past years, many new explanation methods have been proposed to achieve interpretability of machine learning predictions. However, the utility of these methods in practical applications has not been researched extensively. In this…

Machine Learning · Computer Science 2019-07-09 Hilde J. P. Weerts , Werner van Ipenburg , Mykola Pechenizkiy

Learning about underlying patterns in data using latent unobserved structures to improve the accuracy of predictive models has become an active avenue of deep learning research. Most approaches cluster the original features to capture…

Machine Learning · Computer Science 2025-04-09 Rishav Mukherjee , Jeffrey Ahearn Thompson