English
Related papers

Related papers: Evaluation of Saliency-based Explainability Method

200 papers

Concept-based XAI (C-XAI) approaches to explaining neural vision models are a promising field of research, since explanations that refer to concepts (i.e., semantically meaningful parts in an image) are intuitive to understand and go beyond…

Computer Vision and Pattern Recognition · Computer Science 2024-09-23 Jae Hee Lee , Georgii Mikriukov , Gesina Schwalbe , Stefan Wermter , Diedrich Wolter

As the manufacturing industry advances with sensor integration and automation, the opaque nature of deep learning models in machine learning poses a significant challenge for fault detection and diagnosis. And despite the related predictive…

Artificial Intelligence · Computer Science 2024-06-11 Ahmed Maged , Salah Haridy , Herman Shen

Explainable Artificial Intelligence (XAI) techniques are frequently required by users in many AI systems with the goal of understanding complex models, their associated predictions, and gaining trust. While suitable for some specific tasks…

Human-Computer Interaction · Computer Science 2023-03-22 Savio Rozario , George Čevora

Saliency methods compute heat maps that highlight portions of an input that were most {\em important} for the label assigned to it by a deep net. Evaluations of saliency methods convert this heat map into a new {\em masked input} by…

Machine Learning · Statistics 2022-11-08 Arushi Gupta , Nikunj Saunshi , Dingli Yu , Kaifeng Lyu , Sanjeev Arora

Although deep neural networks hold the state-of-the-art in several remote sensing tasks, their black-box operation hinders the understanding of their decisions, concealing any bias and other shortcomings in datasets and model performance.…

Machine Learning · Computer Science 2021-09-21 Ioannis Kakogeorgiou , Konstantinos Karantzalos

This chapter discusses the opportunities of eXplainable Artificial Intelligence (XAI) within the realm of spatial analysis. A key objective in spatial analysis is to model spatial relationships and infer spatial processes to generate…

Machine Learning · Computer Science 2025-05-02 Ziqi Li

Explainable AI (XAI) has been investigated for decades and, together with AI itself, has witnessed unprecedented growth in recent years. Among various approaches to XAI, argumentative models have been advocated in both the AI and social…

Artificial Intelligence · Computer Science 2021-05-25 Kristijonas Čyras , Antonio Rago , Emanuele Albini , Pietro Baroni , Francesca Toni

Deep learning models have performed well on many NLP tasks. However, their internal mechanisms are typically difficult for humans to understand. The development of methods to explain models has become a key issue in the reliability of deep…

Human-Computer Interaction · Computer Science 2024-05-20 Xiaotian Lu , Jiyi Li , Zhen Wan , Xiaofeng Lin , Koh Takeuchi , Hisashi Kashima

Explainable Artificial Intelligence (XAI), i.e., the development of more transparent and interpretable AI models, has gained increased traction over the last few years. This is due to the fact that, in conjunction with their growth into…

Machine Learning · Computer Science 2020-05-14 Erika Puiutta , Eric MSP Veith

Explainable AI (XAI) is widely used to analyze AI systems' decision-making, such as providing counterfactual explanations for recourse. When unexpected explanations occur, users may want to understand the training data properties shaping…

Machine Learning · Computer Science 2025-03-26 André Artelt , Barbara Hammer

The field of 'explainable' artificial intelligence (XAI) has produced highly cited methods that seek to make the decisions of complex machine learning (ML) methods 'understandable' to humans, for example by attributing 'importance' scores…

Machine Learning · Computer Science 2023-12-08 Benedict Clark , Rick Wilming , Stefan Haufe

Although modern machine learning and deep learning methods allow for complex and in-depth data analytics, the predictive models generated by these methods are often highly complex, and lack transparency. Explainable AI (XAI) methods are…

Machine Learning · Computer Science 2021-06-17 Mythreyi Velmurugan , Chun Ouyang , Catarina Moreira , Renuka Sindhgatta

Explainable AI (XAI) is an increasingly important area of machine learning research, which aims to make black-box models transparent and interpretable. In this paper, we propose a novel approach to XAI that uses the so-called counterfactual…

Artificial Intelligence · Computer Science 2023-08-02 Bastian Pfeifer , Mateusz Krzyzinski , Hubert Baniecki , Anna Saranti , Andreas Holzinger , Przemyslaw Biecek

Explainable AI (XAI) methods are commonly evaluated with functional metrics such as correctness, which computationally estimate how accurately an explanation reflects the model's reasoning. Higher correctness is assumed to produce better…

Human-Computer Interaction · Computer Science 2026-03-27 Gregor Baer , Chao Zhang , Isel Grau , Pieter Van Gorp

Explainable AI (XAI) has become increasingly important with the rise of large transformer models, yet many explanation methods designed for CNNs transfer poorly to Vision Transformers (ViTs). Existing ViT explanations often rely on…

Computer Vision and Pattern Recognition · Computer Science 2025-10-08 Meghna P Ayyar , Jenny Benois-Pineau , Akka Zemmari

This study explores the integration of multiple Explainable AI (XAI) techniques to enhance the interpretability of deep learning models for brain tumour detection. A custom Convolutional Neural Network (CNN) was developed and trained on the…

Artificial Intelligence · Computer Science 2026-02-06 Patrick McGonagle , William Farrelly , Kevin Curran

Artificial intelligence models encounter significant challenges due to their black-box nature, particularly in safety-critical domains such as healthcare, finance, and autonomous vehicles. Explainable Artificial Intelligence (XAI) addresses…

Artificial Intelligence · Computer Science 2025-03-14 Melkamu Mersha , Khang Lam , Joseph Wood , Ali AlShami , Jugal Kalita

The field of Explainable Artificial Intelligence (XAI) aims to build explainable and interpretable machine learning (or deep learning) methods without sacrificing prediction performance. Convolutional Neural Networks (CNNs) have been…

Computer Vision and Pattern Recognition · Computer Science 2021-11-23 Shaw-Hwa Lo , Yiqiao Yin

Deep learning has become the de facto standard and dominant paradigm in image analysis tasks, achieving state-of-the-art performance. However, this approach often results in "black-box" models, whose decision-making processes are difficult…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Nguyen Van Tu , Pham Nguyen Hai Long , Vo Hoai Viet

Explainable artificial intelligence (XAI) seeks to produce explanations for those machine learning methods which are deemed opaque. However, there is considerable disagreement about what this means and how to achieve it. Authors disagree on…

Artificial Intelligence · Computer Science 2022-08-10 Oliver Buchholz