English
Related papers

Related papers: Evaluation of Saliency-based Explainability Method

200 papers

Explaining machine learning (ML) models using eXplainable AI (XAI) techniques has become essential to make them more transparent and trustworthy. This is especially important in high-stakes domains like healthcare, where understanding model…

Machine Learning · Computer Science 2025-12-04 Felix Tempel , Daniel Groos , Espen Alexander F. Ihlen , Lars Adde , Inga Strümke

More recently, Explainable Artificial Intelligence (XAI) research has shifted to focus on a more pragmatic or naturalistic account of understanding, that is, whether the stakeholders understand the explanation. This point is especially…

Human-Computer Interaction · Computer Science 2021-08-05 Janet Hui-wen Hsiao , Hilary Hei Ting Ngai , Luyu Qiu , Yi Yang , Caleb Chen Cao

Explainable Artificial Intelligence (XAI) is a rising field in AI. It aims to produce a demonstrative factor of trust, which for human subjects is achieved through communicative means, which Machine Learning (ML) algorithms cannot solely…

Machine Learning · Computer Science 2021-03-09 Jamie Andrew Duell

Strategies based on Explainable Artificial Intelligence - XAI have emerged in computing to promote a better understanding of predictions made by black box models. Most XAI measures used today explain these types of models, generating…

Machine Learning · Computer Science 2021-11-18 José Ribeiro , Raíssa Silva , Lucas Cardoso , Ronnie Alves

Nowadays, deep neural networks are widely used in mission critical systems such as healthcare, self-driving vehicles, and military which have direct impact on human lives. However, the black-box nature of deep neural networks challenges its…

Computer Vision and Pattern Recognition · Computer Science 2020-06-24 Arun Das , Paul Rad

The lack of explainability of a decision from an Artificial Intelligence (AI) based "black box" system/model, despite its superiority in many real-world applications, is a key stumbling block for adopting AI in many high stakes applications…

Artificial Intelligence · Computer Science 2021-01-26 Sheikh Rabiul Islam , William Eberle , Sheikh Khaled Ghafoor , Mohiuddin Ahmed

There is a disconnect between explanatory artificial intelligence (XAI) methods and the types of explanations that are useful for and demanded by society (policy makers, government officials, etc.) Questions that experts in artificial…

Artificial Intelligence · Computer Science 2019-01-23 Leilani H. Gilpin , Cecilia Testart , Nathaniel Fruchter , Julius Adebayo

Computer Vision, and hence Artificial Intelligence-based extraction of information from images, has increasingly received attention over the last years, for instance in medical diagnostics. While the algorithms' complexity is a reason for…

Human-Computer Interaction · Computer Science 2020-07-14 Christian Meske , Enrico Bunde

Saliency maps have become one of the most widely used interpretability techniques for convolutional neural networks (CNN) due to their simplicity and the quality of the insights they provide. However, there are still some doubts about…

Artificial Intelligence · Computer Science 2023-09-25 Oscar Llorente , Jaime Boal , Eugenio F. Sánchez-Úbeda

Researchers have proposed various methods for visually interpreting the Convolutional Neural Network (CNN) via saliency maps, which include Class-Activation-Map (CAM) based approaches as a leading family. However, in terms of the internal…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Xiwei Xuan , Ziquan Deng , Hsuan-Tien Lin , Zhaodan Kong , Kwan-Liu Ma

Explainable AI (XAI) aims to improve user understanding and decisions when using AI models. However, despite innovations in XAI, recent user evaluations reveal that this goal remains elusive. Understanding human cognition can help explain…

Artificial Intelligence · Computer Science 2026-05-01 Louth Bin Rawshan , Zhuoyu Wang , Brian Y. Lim

Explainable AI(XAI)is a domain focused on providing interpretability and explainability of a decision-making process. In the domain of law, in addition to system and data transparency, it also requires the (legal-) decision-model…

Human-Computer Interaction · Computer Science 2020-12-18 Lukasz Gorski , Shashishekar Ramakrishna , Jedrzej M. Nowosielski

Explainable Artificial Intelligence (XAI) is essential for the transparency and clinical adoption of Clinical Decision Support Systems (CDSS). However, the real-world effectiveness of existing XAI methods remains limited and is…

Machine Learning · Computer Science 2026-01-26 Alessandro Gambetti , Qiwei Han , Hong Shen , Claudia Soares

The use of deep learning in computer vision tasks such as image classification has led to a rapid increase in the performance of such systems. Due to this substantial increment in the utility of these systems, the use of artificial…

Image and Video Processing · Electrical Eng. & Systems 2023-04-05 Vinay Jogani , Joy Purohit , Ishaan Shivhare , Seema C Shrawne

In recent years, deep learning has achieved unprecedented success in various computer vision tasks, particularly in object detection. However, the black-box nature and high complexity of deep neural networks pose significant challenges for…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 FatemehSadat Seyedmomeni , Mohammad Ali Keyvanrad

Saliency methods are widely used to interpret neural network predictions, but different variants of saliency methods often disagree even on the interpretations of the same prediction made by the same model. In these cases, how do we…

Computation and Language · Computer Science 2021-04-14 Shuoyang Ding , Philipp Koehn

We propose a novel segmentation-based explainable artificial intelligence (XAI) method for neural networks working on point cloud classification. As one building block of this method, we propose a novel point-shifting mechanism to introduce…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Raju Ningappa Mulawade , Christoph Garth , Alexander Wiebel

Many explainable AI (XAI) techniques strive for interpretability by providing concise salient information, such as sparse linear factors. However, users either only see inaccurate global explanations, or highly-varying local explanations.…

Human-Computer Interaction · Computer Science 2024-04-11 Jessica Y. Bo , Pan Hao , Brian Y. Lim

As Machine Learning models are considered for autonomous decisions with significant social impact, the need for understanding how these models work rises rapidly. Explainable Artificial Intelligence (XAI) aims to provide interpretations for…

Machine Learning · Computer Science 2023-05-05 Jaime Pizarroso , David Alfaya , José Portela , Antonio Muñoz

Deep neural networks (DNNs) are increasingly being used as controllers in reactive systems. However, DNNs are highly opaque, which renders it difficult to explain and justify their actions. To mitigate this issue, there has been a surge of…

Artificial Intelligence · Computer Science 2023-10-06 Shahaf Bassan , Guy Amir , Davide Corsi , Idan Refaeli , Guy Katz