English
Related papers

Related papers: A comprehensive study on fidelity metrics for XAI

200 papers

Despite AI's significant growth, its "black box" nature creates challenges in generating adequate trust. Thus, it is seldom utilized as a standalone unit in IoT high-risk applications, such as critical industrial infrastructures, medical…

Artificial Intelligence · Computer Science 2022-05-04 Maede Zolanvari , Zebo Yang , Khaled Khan , Raj Jain , Nader Meskin

Motivations for methods in explainable artificial intelligence (XAI) often include detecting, quantifying and mitigating bias, and contributing to making machine learning models fairer. However, exactly how an XAI method can help in…

Computation and Language · Computer Science 2022-06-09 Esma Balkir , Svetlana Kiritchenko , Isar Nejadgholi , Kathleen C. Fraser

The field of "explainable artificial intelligence" (XAI) seemingly addresses the desire that decisions of machine learning systems should be human-understandable. However, in its current state, XAI itself needs scrutiny. Popular methods…

Machine Learning · Computer Science 2026-04-09 Stefan Haufe , Rick Wilming , Benedict Clark , Rustam Zhumagambetov , Ahcène Boubekki , Jörg Martin , Danny Panknin

Explainable AI (XAI) builds trust in complex systems through model attribution methods that reveal the decision rationale. However, due to the absence of a unified optimal explanation, existing XAI methods lack a ground truth for objective…

Machine Learning · Computer Science 2025-08-06 Yuhan Guo , Lizhong Ding , Shihan Jia , Yanyu Ren , Pengqi Li , Jiarun Fu , Changsheng Li , Ye yuan , Guoren Wang

We introduce a novel metric for measuring semantic continuity in Explainable AI methods and machine learning models. We posit that for models to be truly interpretable and trustworthy, similar inputs should yield similar explanations,…

Artificial Intelligence · Computer Science 2025-01-31 Qi Huang , Emanuele Mezzi , Osman Mutlu , Miltiadis Kofinas , Vidya Prasad , Shadnan Azwad Khan , Elena Ranguelova , Niki van Stein

Last years have been characterized by an upsurge of opaque automatic decision support systems, such as Deep Neural Networks (DNNs). Although they have great generalization and prediction skills, their functioning does not allow obtaining…

The field of 'explainable' artificial intelligence (XAI) has produced highly cited methods that seek to make the decisions of complex machine learning (ML) methods 'understandable' to humans, for example by attributing 'importance' scores…

Machine Learning · Computer Science 2023-12-08 Benedict Clark , Rick Wilming , Stefan Haufe

Explainable AI (XAI) has revolutionized the field of deep learning by empowering users to have more trust in neural network models. The field of XAI allows users to probe the inner workings of these algorithms to elucidate their…

Computer Vision and Pattern Recognition · Computer Science 2024-06-13 Prithwijit Chowdhury , Mohit Prabhushankar , Ghassan AlRegib , Mohamed Deriche

The lack of interpretability is a major barrier that limits the practical usage of AI models. Several eXplainable AI (XAI) techniques (e.g., SHAP, LIME) have been employed to interpret these models' performance. However, users often face…

Software Engineering · Computer Science 2025-04-21 Saumendu Roy , Saikat Mondal , Banani Roy , Chanchal Roy

With the increased usage of artificial intelligence (AI), it is imperative to understand how these models work internally. These needs have led to the development of a new field called eXplainable artificial intelligence (XAI). This field…

Computer Vision and Pattern Recognition · Computer Science 2023-10-05 Miquel Miró-Nicolau , Antoni Jaume-i-Capó , Gabriel Moyà-Alcover

The lack of ground truth explanation labels is a fundamental challenge for quantitative evaluation in explainable artificial intelligence (XAI). This challenge becomes especially problematic when evaluation methods have numerous…

Artificial Intelligence · Computer Science 2024-12-10 Kristoffer Wickstrøm , Marina Marie-Claire Höhne , Anna Hedström

Explainable artificial intelligence (XAI) is essential for enabling clinical users to get informed decision support from AI and comply with evidence-based medical practice. Applying XAI in clinical settings requires proper evaluation…

Machine Learning · Computer Science 2022-12-09 Weina Jin , Xiaoxiao Li , Mostafa Fatehi , Ghassan Hamarneh

The advancement of machine learning (ML) models has led to the development of ML-based approaches to improve numerous software engineering tasks in software maintenance and evolution. Nevertheless, research indicates that despite their…

Software Engineering · Computer Science 2024-07-22 Md Abdul Awal , Chanchal K. Roy

Explainable AI (XAI) helps users interpret model behavior and identify potential faults. Agentic XAI systems use Large Language Models (LLMs) to make explanations more accessible through natural-language interaction, but they can also…

Artificial Intelligence · Computer Science 2026-05-28 Jaechang Kim , Sunung Mun , Seungjoon Lee , Jaewoong Cho , Jungseul Ok

It has been long debated that eXplainable AI (XAI) is an important topic, but it lacks rigorous definition and fair metrics. In this paper, we briefly summarize the status quo of the metrics, along with an exhaustive experimental study…

Artificial Intelligence · Computer Science 2021-01-01 Xiao-Hui Li , Yuhan Shi , Haoyang Li , Wei Bai , Yuanwei Song , Caleb Chen Cao , Lei Chen

Recent legislative regulations have underlined the need for accountable and transparent artificial intelligence systems and have contributed to a growing interest in the Explainable Artificial Intelligence (XAI) field. Nonetheless, the lack…

Machine Learning · Computer Science 2025-10-14 Ilaria Vascotto , Alex Rodriguez , Alessandro Bonaita , Luca Bortolussi

Explanation methods and their evaluation have become a significant issue in explainable artificial intelligence (XAI) due to the recent surge of opaque AI models in decision support systems (DSS). Since the most accurate AI models are…

Artificial Intelligence · Computer Science 2023-08-30 Helena Löfström , Karl Hammar , Ulf Johansson

The advancement of deep learning in human activity recognition (HAR) using 3D skeleton data is critical for applications in healthcare, security, sports, and human-computer interaction. This paper tackles a well-known gap in the field,…

Machine Learning · Computer Science 2024-02-21 Kimji N. Pellano , Inga Strümke , Espen Alexander F. Ihlen

With the advances of AI research, AI has been increasingly adopted in numerous domains, ranging from low-stakes daily tasks such as movie recommendations to high-stakes tasks such as medicine, and criminal justice decision-making.…

Human-Computer Interaction · Computer Science 2024-10-29 Shuai Ma

Ensuring transparency and trust in artificial intelligence (AI) models is essential as they are increasingly deployed in safety-critical and high-stakes domains. Explainable AI (XAI) has emerged as a promising approach to address this…

Computer Vision and Pattern Recognition · Computer Science 2025-11-05 Reem Hammoud , Abdul Karim Gizzini , Ali J. Ghandour