English
Related papers

Related papers: Evaluation of Saliency-based Explainability Method

200 papers

Saliency methods can aid understanding of deep neural networks. Recent years have witnessed many improvements to saliency methods, as well as new ways for evaluating them. In this paper, we 1) present a novel region-based attribution…

Computer Vision and Pattern Recognition · Computer Science 2019-08-22 Andrei Kapishnikov , Tolga Bolukbasi , Fernanda Viégas , Michael Terry

To advance the transparency of learning machines such as Deep Neural Networks (DNNs), the field of Explainable AI (XAI) was established to provide interpretations of DNNs' predictions. While different explanation techniques exist, a popular…

In recent years, several advances have been observed in Deep Learning with surprising results. Models in this area have been increasingly used in numerous applications, including those sensitive to human life, which require clear…

Machine Learning · Computer Science 2026-05-05 Daniel da Silva Costa , Pedro Nuno de Souza Moura , Adriana C. F. Alvim

Explainable artificial intelligence (XAI) plays an indispensable role in demystifying the decision-making processes of AI, especially within the healthcare industry. Clinicians rely heavily on detailed reasoning when making a diagnosis,…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Anna Stubbin , Thompson Chyrikov , Jim Zhao , Christina Chajo

Explainable Artificial Intelligence (XAI) has emerged as a critical tool for interpreting the predictions of complex deep learning models. While XAI has been increasingly applied in various domains within acoustics, its use in bioacoustics,…

Sound · Computer Science 2025-09-11 Zubair Faruqui , Mackenzie S. McIntire , Rahul Dubey , Jay McEntee

The performance of convolutional neural networks has continued to improve over the last decade. At the same time, as model complexity grows, it becomes increasingly more difficult to explain model decisions. Such explanations may be of…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Colton Crum , Patrick Tinsley , Aidan Boyd , Jacob Piland , Christopher Sweet , Timothy Kelley , Kevin Bowyer , Adam Czajka

Explainable artificial intelligence (XAI) methods shed light on the predictions of machine learning algorithms. Several different approaches exist and have already been applied in climate science. However, usually missing ground truth…

Machine Learning · Computer Science 2024-03-25 Philine Bommer , Marlene Kretschmer , Anna Hedström , Dilyara Bareeva , Marina M. -C. Höhne

Deep learning methods exhibit outstanding performance in synthetic aperture radar (SAR) image interpretation tasks. However, these are black box models that limit the comprehension of their predictions. Therefore, to meet this challenge, we…

Computer Vision and Pattern Recognition · Computer Science 2022-04-15 Shenghan Su , Ziteng Cui , Weiwei Guo , Zenghui Zhang , Wenxian Yu

The surge in black-box AI models has prompted the need to explain the internal mechanism and justify their reliability, especially in high-stakes applications, such as healthcare and autonomous driving. Due to the lack of a rigorous…

Artificial Intelligence · Computer Science 2024-03-18 Yongjie Wang , Tong Zhang , Xu Guo , Zhiqi Shen

There has been a significant surge of interest recently around the concept of explainable artificial intelligence (XAI), where the goal is to produce an interpretation for a decision made by a machine learning algorithm. Of particular…

Machine Learning · Computer Science 2019-10-31 Zhong Qiu Lin , Mohammad Javad Shafiee , Stanislav Bochkarev , Michael St. Jules , Xiao Yu Wang , Alexander Wong

Explainable AI (XAI) is a promising means of supporting human-AI collaborations for high-stakes visual detection tasks, such as damage detection tasks from satellite imageries, as fully-automated approaches are unlikely to be perfectly safe…

Human-Computer Interaction · Computer Science 2021-11-05 Donghoon Shin , Sachin Grover , Kenneth Holstein , Adam Perer

Explainable AI (XAI) is widely viewed as a sine qua non for ever-expanding AI research. A better understanding of the needs of XAI users, as well as human-centered evaluations of explainable models are both a necessity and a challenge. In…

Artificial Intelligence · Computer Science 2024-10-17 Yao Rong , Tobias Leemann , Thai-trang Nguyen , Lisa Fiedler , Peizhu Qian , Vaibhav Unhelkar , Tina Seidel , Gjergji Kasneci , Enkelejda Kasneci

Explainable Artificial Intelligence (XAI) is essential for building advanced machine learning-powered applications, especially in critical domains such as medical diagnostics or autonomous driving. Legal, business, and ethical requirements…

Human-Computer Interaction · Computer Science 2024-10-17 Tobias Labarta , Elizaveta Kulicheva , Ronja Froelian , Christian Geißler , Xenia Melman , Julian von Klitzing

Explainable artificial intelligence (XAI) aims to develop transparent explanatory approaches for "black-box" deep learning models. However,it remains difficult for existing methods to achieve the trade-off of the three key criteria in…

Computer Vision and Pattern Recognition · Computer Science 2023-12-27 Changqi Sun , Hao Xu , Yuntian Chen , Dongxiao Zhang

Both humans and machine learning models learn from experience, particularly in safety- and reliability-critical domains. While psychology seeks to understand human cognition, the field of Explainable AI (XAI) develops methods to interpret…

Human-Computer Interaction · Computer Science 2025-11-25 Roussel Rahman , Aashwin Ananda Mishra , Wan-Lin Hu

Given the complexity and lack of transparency in deep neural networks (DNNs), extensive efforts have been made to make these systems more interpretable or explain their behaviors in accessible terms. Unlike most reviews, which focus on…

Artificial Intelligence · Computer Science 2024-01-17 Haoyi Xiong , Xuhong Li , Xiaofei Zhang , Jiamin Chen , Xinhao Sun , Yuchen Li , Zeyi Sun , Mengnan Du

Explainable AI (XAI) methods are frequently applied to obtain qualitative insights about deep models' predictions. However, such insights need to be interpreted by a human observer to be useful. In this paper, we aim to use explanations…

Computer Vision and Pattern Recognition · Computer Science 2022-10-24 Sunsheng Gu , Vahdat Abdelzad , Krzysztof Czarnecki

eXplainable artificial intelligence (XAI) methods have emerged to convert the black box of machine learning (ML) models into a more digestible form. These methods help to communicate how the model works with the aim of making ML models more…

Explainable artificial intelligence (XAI) methods lack ground truth. In its place, method developers have relied on axioms to determine desirable properties for their explanations' behavior. For high stakes uses of machine learning that…

Machine Learning · Computer Science 2022-09-02 Isha Hameed , Samuel Sharpe , Daniel Barcklow , Justin Au-Yeung , Sahil Verma , Jocelyn Huang , Brian Barr , C. Bayan Bruss

Explainable Artificial Intelligence (XAI) emerged to reveal the internal mechanism of machine learning models and how the features affect the prediction outcome. Collinearity is one of the big issues that XAI methods face when identifying…

Machine Learning · Computer Science 2024-11-05 Ahmed M Salih