English
Related papers

Related papers: ONNXExplainer: an ONNX Based Generic Framework to …

200 papers

Reinforcement learning has achieved remarkable success in complex decision-making environments, yet its lack of transparency limits its deployment in practice, especially in safety-critical settings. Shapley values from cooperative game…

Machine Learning · Computer Science 2025-11-11 Daniel Beechey , Özgür Şimşek

The use of algorithm-agnostic approaches is an emerging area of research for explaining the contribution of individual features towards the predicted outcome. Whilst there is a focus on explaining the prediction itself, a little has been…

Machine Learning · Computer Science 2022-11-07 Guilherme Dean Pelegrina , Sajid Siraj

Recent advances in machine learning have led to a surge in adoption of neural networks for various tasks, but lack of interpretability remains an issue for many others in which an understanding of the features influencing the prediction is…

As modern complex neural networks keep breaking records and solving harder problems, their predictions also become less and less intelligible. The current lack of interpretability often undermines the deployment of accurate machine learning…

Computer Vision and Pattern Recognition · Computer Science 2022-07-15 Jacopo Teneggi , Alexandre Luster , Jeremias Sulam

This study proposes DeltaSHAP, a novel explainable artificial intelligence (XAI) algorithm specifically designed for online patient monitoring systems. In clinical environments, discovering the causes driving patient risk evolution is…

Machine Learning · Computer Science 2025-07-15 Changhun Kim , Yechan Mun , Sangchul Hahn , Eunho Yang

We propose a new interpretability method for neural networks, which is based on a novel mathematico-philosophical theory of reasons. Our method computes a vector for each neuron, called its reasons vector. We then can compute how strongly…

Machine Learning · Computer Science 2025-05-21 Levin Hornischer , Hannes Leitgeb

The proliferation of large models has intensified the need for efficient data valuation methods to quantify the contribution of individual data providers. Traditional approaches, such as game-theory-based Shapley value and…

Artificial Intelligence · Computer Science 2025-09-24 Le Ma , Shirao Yang , Zihao Wang , Yinggui Wang , Lei Wang , Tao Wei , Kejun Zhang

We study the use of binary activated neural networks as interpretable and explainable predictors in the context of regression tasks on tabular data; more specifically, we provide guarantees on their expressiveness, present an approach based…

Machine Learning · Computer Science 2024-06-11 Benjamin Leblanc , Pascal Germain

Predictive black-box models can exhibit high accuracy but their opaque nature hinders their uptake in safety-critical deployment environments. Explanation methods (XAI) can provide confidence for decision-making through increased…

Machine Learning · Statistics 2023-06-27 Lucile Ter-Minassian , Oscar Clivio , Karla Diaz-Ordaz , Robin J. Evans , Chris Holmes

Building explainable systems is a critical problem in the field of Natural Language Processing (NLP), since most machine learning models provide no explanations for the predictions. Existing approaches for explainable machine learning…

Computation and Language · Computer Science 2019-06-12 Hui Liu , Qingyu Yin , William Yang Wang

Feature attribution for kernel methods is often heuristic and not individualised for each prediction. To address this, we turn to the concept of Shapley values~(SV), a coalition game theoretical framework that has previously been applied to…

Machine Learning · Statistics 2022-05-27 Siu Lun Chau , Robert Hu , Javier Gonzalez , Dino Sejdinovic

Shapley value is a widely used tool in explainable artificial intelligence (XAI), as it provides a principled way to attribute contributions of input features to model outputs. However, estimation of Shapley value requires capturing…

Machine Learning · Computer Science 2025-11-05 Cheng Lu , Jiusun Zeng , Yu Xia , Jinhui Cai , Shihua Luo

While Explainable Artificial Intelligence (XAI) is increasingly expanding more areas of application, little has been applied to make deep Reinforcement Learning (RL) more comprehensible. As RL becomes ubiquitous and used in critical and…

Artificial Intelligence · Computer Science 2021-10-05 Alexandre Heuillet , Fabien Couthouis , Natalia Díaz-Rodríguez

Graph Neural Networks (GNNs) have become a powerful tool for modeling and analyzing data with graph structures. The wide adoption in numerous applications underscores the value of these models. However, the complexity of these methods often…

Artificial Intelligence · Computer Science 2025-12-10 Tien Cuong Bui

Explaining Graph Neural Networks (GNNs) has garnered significant attention due to the need for interpretability, enabling users to understand the behavior of these black-box models better and extract valuable insights from their…

Machine Learning · Computer Science 2025-06-03 Jiaxing Zhang , Xiaoou Liu , Dongsheng Luo , Hua Wei

Explainable Artificial Intelligence (xAI) has the potential to enhance the transparency and trust of AI-based systems. Although accurate predictions can be made using Deep Neural Networks (DNNs), the process used to arrive at such…

Computer Vision and Pattern Recognition · Computer Science 2024-08-09 Bhushan Atote , Victor Sanchez

We present a novel approach for explaining Gaussian processes (GPs) that can utilize the full analytical covariance structure present in GPs. Our method is based on the popular solution concept of Shapley values extended to stochastic…

Machine Learning · Statistics 2023-05-25 Siu Lun Chau , Krikamol Muandet , Dino Sejdinovic

This paper presents an approach integrating explainable artificial intelligence (XAI) techniques with adaptive learning to enhance energy consumption prediction models, with a focus on handling data distribution shifts. Leveraging SHAP…

Machine Learning · Computer Science 2024-02-08 Tobias Clement , Hung Truong Thanh Nguyen , Nils Kemmerzell , Mohamed Abdelaal , Davor Stjelja

Industrial Internet of Things environments increasingly rely on advanced Anomaly Detection and explanation techniques to rapidly detect and mitigate cyberincidents, thereby ensuring operational safety. The sequential nature of data…

Machine Learning · Computer Science 2025-06-03 Manuel Franco de la Peña , Ángel Luis Perales Gómez , Lorenzo Fernández Maimó

To enhance the reliability and credibility of graph neural networks (GNNs) and improve the transparency of their decision logic, a new field of explainability of GNNs (XGNN) has emerged. However, two major limitations severely degrade the…

Machine Learning · Computer Science 2025-05-26 Han Zhang , Yan Wang , Guanfeng Liu , Pengfei Ding , Huaxiong Wang , Kwok-Yan Lam