English
Related papers

Related papers: GAM(e) changer or not? An evaluation of interpreta…

200 papers

Explainable Artificial Intelligence (XAI) emerged to reveal the internal mechanism of machine learning models and how the features affect the prediction outcome. Collinearity is one of the big issues that XAI methods face when identifying…

Machine Learning · Computer Science 2024-11-05 Ahmed M Salih

Both humans and machine learning models learn from experience, particularly in safety- and reliability-critical domains. While psychology seeks to understand human cognition, the field of Explainable AI (XAI) develops methods to interpret…

Human-Computer Interaction · Computer Science 2025-11-25 Roussel Rahman , Aashwin Ananda Mishra , Wan-Lin Hu

Machine Learning (ML) has recently been demonstrated to rival expert-level human accuracy in prediction and detection tasks in a variety of domains, including medicine. Despite these impressive findings, however, a key barrier to the full…

Artificial Intelligence · Computer Science 2021-07-01 D. Fompeyrine , E. S. Vorm , N. Ricka , F. Rose , G. Pellegrin

Artificial intelligence methods are being increasingly applied across various domains, but their often opaque nature has raised concerns about accountability and trust. In response, the field of explainable AI (XAI) has emerged to address…

Neural and Evolutionary Computing · Computer Science 2024-10-18 Ryan Zhou , Jaume Bacardit , Alexander Brownlee , Stefano Cagnoni , Martin Fyvie , Giovanni Iacca , John McCall , Niki van Stein , David Walker , Ting Hu

Explainable AI (XAI) systems have been proposed to help people understand how AI systems produce outputs and behaviors. Explainable Reinforcement Learning (XRL) has an added complexity due to the temporal nature of sequential…

Artificial Intelligence · Computer Science 2025-08-19 Madhuri Singh , Amal Alabdulkarim , Gennie Mansi , Mark O. Riedl

The need for explainable AI (XAI) is well established but relatively little has been published outside of the supervised learning paradigm. This paper focuses on a principled approach to applying explainability and interpretability to the…

Machine Learning · Computer Science 2022-07-26 John Sipple , Abdou Youssef

Interpretable machine learning (IML) becomes increasingly important in highly regulated industry sectors related to the health and safety or fundamental rights of human beings. In general, the inherently IML models should be adopted because…

Machine Learning · Computer Science 2021-11-03 Agus Sudjianto , Aijun Zhang

Explainable AI (XAI) and interpretable machine learning methods help to build trust in model predictions and derived insights, yet also present a perverse incentive for analysts to manipulate XAI metrics to support pre-specified…

Machine Learning · Computer Science 2025-07-16 Rahul Sharma , Sergey Redyuk , Sumantrak Mukherjee , Andrea Šipka , Eyke Hüllermeier , Sebastian Vollmer , David Selby

Despite the fact that Artificial Intelligence (AI) has boosted the achievement of remarkable results across numerous data analysis tasks, however, this is typically accompanied by a significant shortcoming in the exhibited transparency and…

Explainable Artificial Intelligence (XAI) has aided machine learning (ML) researchers with the power of scrutinizing the decisions of the black-box models. XAI methods enable looking deep inside the models' behavior, eventually generating…

Cryptography and Security · Computer Science 2025-10-07 Maraz Mia , Mir Mehedi A. Pritom

Algorithmic approaches to interpreting machine learning models have proliferated in recent years. We carry out human subject tests that are the first of their kind to isolate the effect of algorithmic explanations on a key aspect of model…

Computation and Language · Computer Science 2020-05-06 Peter Hase , Mohit Bansal

Artificial Intelligence (AI) and its data-centric branch of machine learning (ML) have greatly evolved over the last few decades. However, as AI is used increasingly in real world use cases, the importance of the interpretability of and…

Machine Learning · Computer Science 2022-12-01 N. Ranasinghe , A. Ramanan , S. Fernando , P. N. Hameed , D. Herath , T. Malepathirana , P. Suganthan , M. Niranjan , S. Halgamuge

When the initial vision of Explainable (XAI) was articulated, the most popular framing was to open the (proverbial) "black-box" of AI so that we could understand the inner workings. With the advent of Large Language Models (LLMs), the very…

Human-Computer Interaction · Computer Science 2024-08-15 Upol Ehsan , Mark O. Riedl

Deep learning (DL) models have been popular due to their ability to learn directly from the raw data in an end-to-end paradigm, alleviating the concern of a separate error-prone feature extraction phase. Recent DL-based neuroimaging studies…

Machine Learning · Computer Science 2023-07-20 Md. Mahfuzur Rahman , Vince D. Calhoun , Sergey M. Plis

When developing AI systems that interact with humans, it is essential to design both a system that can understand humans, and a system that humans can understand. Most deep network based agent-modeling approaches are 1) not interpretable…

Machine Learning · Computer Science 2021-07-14 Ini Oguntola , Dana Hughes , Katia Sycara

Still under debate is the question of whether machine learning is capable of going beyond black-box modeling for complex physical systems. We investigate the generalizing and interpretability properties of learning algorithms. To this end,…

Statistical Mechanics · Physics 2019-02-18 C. Casert , T. Vieijra , J. Nys , J. Ryckebusch

This paper introduces the Actuarial Neural Additive Model, an inherently interpretable deep learning model for general insurance pricing that offers fully transparent and interpretable results while retaining the strong predictive power of…

Machine Learning · Computer Science 2025-09-11 Patrick J. Laub , Tu Pho , Bernard Wong

This paper discusses the limitations of machine learning (ML), particularly deep artificial neural networks (ANNs), which are effective at approximating complex functions but often lack transparency and explanatory power. It highlights the…

Machine Learning · Computer Science 2024-01-18 Udesh Habaraduwa

Advanced machine learning models have recently achieved high predictive accuracy for weather and climate prediction. However, these complex models often lack inherent transparency and interpretability, acting as "black boxes" that impede…

Atmospheric and Oceanic Physics · Physics 2024-03-29 Ruyi Yang , Jingyu Hu , Zihao Li , Jianli Mu , Tingzhao Yu , Jiangjiang Xia , Xuhong Li , Aritra Dasgupta , Haoyi Xiong

While Large Language Models (LLMs) have achieved strong performance across many NLP tasks, their opaque internal mechanisms hinder trustworthiness and safe deployment. Existing surveys in explainable AI largely focus on post-hoc explanation…

Computation and Language · Computer Science 2026-04-21 Yutong Gao , Qinglin Meng , Yuan Zhou , Liangming Pan