English
Related papers

Related papers: UbiQTree: Uncertainty Quantification in XAI with T…

200 papers

Nowadays, deep neural networks are widely used in a variety of fields that have a direct impact on society. Although those models typically show outstanding performance, they have been used for a long time as black boxes. To address this,…

Machine Learning · Computer Science 2022-10-11 Huawei Sun , Lorenzo Servadei , Hao Feng , Michael Stephan , Robert Wille , Avik Santra

In this work, we explore various topics that fall under the umbrella of Uncertainty in post-hoc Explainable AI (XAI) methods. We in particular focus on the class of additive feature attribution explanation methods. We first describe our…

Machine Learning · Computer Science 2023-11-30 Abhishek Madaan , Tanya Chowdhury , Neha Rana , James Allan , Tanmoy Chakraborty

Understanding predictions made by Machine Learning models is critical in many applications. In this work, we investigate the performance of two methods for explaining tree-based models- Tree Interpreter (TI) and SHapley Additive…

Artificial Intelligence · Computer Science 2020-10-15 Pulkit Sharma , Shezan Rohinton Mirzan , Apurva Bhandari , Anish Pimpley , Abhiram Eswaran , Soundar Srinivasan , Liqun Shao

Network security threats in embedded systems pose significant challenges to critical infrastructure protection. This paper presents a comprehensive framework combining ensemble learning methods with explainable artificial intelligence (XAI)…

Cryptography and Security · Computer Science 2026-04-20 Wanru Shao

Attribution scores reflect how important the feature values in an input entity are for the output of a machine learning model. One of the most popular attribution scores is the SHAP score, which is an instantiation of the general Shapley…

Artificial Intelligence · Computer Science 2024-08-14 Santiago Cifuentes , Leopoldo Bertossi , Nina Pardal , Sergio Abriola , Maria Vanina Martinez , Miguel Romero

Post-hoc explanation methods are widely used to interpret black-box predictions, but their generation is often computationally expensive and their reliability is not guaranteed. We propose epistemic uncertainty as a low-cost proxy for…

Artificial Intelligence · Computer Science 2026-04-01 Georgii Mikriukov , Grégoire Montavon , Marina M. -C. Höhne

Industrial processes generate complex data that challenge fault detection systems, often yielding opaque or underwhelming results despite advanced machine learning techniques. This study tackles such difficulties using the Tennessee Eastman…

Machine Learning · Computer Science 2025-10-29 Pedro Cortes dos Santos , Matheus Becali Rocha , Renato A Krohling

Explainable AI (XAI) is critical for ensuring transparency, accountability, and trust in machine learning systems as black-box models are increasingly deployed within high-stakes domains. Among XAI methods, Shapley values are widely used…

Machine Learning · Computer Science 2025-02-19 Jiaxin Xu , Hung Chau , Angela Burden

Recent work demonstrated the existence of critical flaws in the current use of Shapley values in explainable AI (XAI), i.e. the so-called SHAP scores. These flaws are significant in that the scores provided to a human decision-maker can be…

Artificial Intelligence · Computer Science 2025-02-18 Joao Marques-Silva , Xuanxiang Huang , Olivier Letoffe

SHAP (SHapley Additive exPlanations) values are a widely used method for local feature attribution in interpretable and explainable AI. We propose an efficient two-stage algorithm for computing SHAP values in both black-box setting and…

Machine Learning · Computer Science 2025-10-24 Ali Gorji , Andisheh Amrollahi , Andreas Krause

Understanding uncertainty in Explainable AI (XAI) is crucial for building trust and ensuring reliable decision-making in Machine Learning models. This paper introduces a unified framework for quantifying and interpreting Uncertainty in XAI…

Machine Learning · Computer Science 2025-04-08 Teodor Chiaburu , Felix Bießmann , Frank Haußer

This paper addresses a significant gap in explainable AI: the necessity of interpreting epistemic uncertainty in model explanations. Although current methods mainly focus on explaining predictions, with some including uncertainty, they fail…

Artificial Intelligence · Computer Science 2024-10-10 Helena Löfström , Tuwe Löfström , Johan Hallberg Szabadvary

The idea to distinguish and quantify two important types of uncertainty, often referred to as aleatoric and epistemic, has received increasing attention in machine learning research in the last couple of years. In this paper, we consider…

Machine Learning · Computer Science 2021-12-13 Mohammad Hossein Shaker , Eyke Hüllermeier

The trustworthiness of neural networks is often challenged because they lack the ability to express uncertainty and explain their skill. This can be problematic given the increasing use of neural networks in high stakes decision-making such…

Atmospheric and Oceanic Physics · Physics 2022-12-07 Mariana C. A. Clare , Maike Sonnewald , Redouane Lguensat , Julie Deshayes , Venkatramani Balaji

As data plays an increasingly pivotal role in decision-making, the emergence of data markets underscores the growing importance of data valuation. Within the machine learning landscape, Data Shapley stands out as a widely embraced method…

Machine Learning · Statistics 2024-07-30 Mengmeng Wu , Zhihong Liu , Xiang Li , Ruoxi Jia , Xiangyu Chang

Ensemble-based modifications of the well-known SHapley Additive exPlanations (SHAP) method for the local explanation of a black-box model are proposed. The modifications aim to simplify SHAP which is computationally expensive when there is…

Machine Learning · Computer Science 2021-03-08 Lev V. Utkin , Andrei V. Konstantinov

Various strategies for active learning have been proposed in the machine learning literature. In uncertainty sampling, which is among the most popular approaches, the active learner sequentially queries the label of those instances for…

Machine Learning · Computer Science 2019-09-04 Vu-Linh Nguyen , Sébastien Destercke , Eyke Hüllermeier

SHAP (SHapley Additive exPlanation) values are one of the leading tools for interpreting machine learning models, with strong theoretical guarantees (consistency, local accuracy) and a wide availability of implementations and use cases.…

Machine Learning · Computer Science 2022-07-28 Jilei Yang

As large language models (LLMs) are increasingly integrated into high-stakes decision-making, the ability to reliably quantify uncertainty has become a critical requirement for safety and trust. However, current uncertainty quantification…

Artificial Intelligence · Computer Science 2026-05-28 Seongjun Lee , Suwan Yoon , Changhee Lee

Explainable AI (xAI) interventions aim to improve interpretability for complex black-box models, not only to improve user trust but also as a means to extract scientific insights from high-performing predictive systems. In molecular…

Machine Learning · Computer Science 2025-04-04 Jonas Teufel , Annika Leinweber , Pascal Friederich