English
Related papers

Related papers: Ground Truth Evaluation of Neural Network Explanat…

200 papers

Explainable artificial intelligence (XAI) methods are currently evaluated with approaches mostly originated in interpretable machine learning (IML) research that focus on understanding models such as comparison against existing attribution…

Machine Learning · Computer Science 2020-11-20 Shideh Shams Amiri , Rosina O. Weber , Prateek Goel , Owen Brooks , Archer Gandley , Brian Kitchell , Aaron Zehm

Explainable AI (XAI) techniques are increasingly important for the validation and responsible use of modern deep learning models, but are difficult to evaluate due to the lack of good ground-truth to compare against. We propose a framework…

Artificial Intelligence · Computer Science 2026-05-19 Amritpal Singh , Andrey Barsky , Mohamed Ali Souibgui , Ernest Valveny , Dimosthenis Karatzas

The rationale behind a deep learning model's output is often difficult to understand by humans. EXplainable AI (XAI) aims at solving this by developing methods that improve interpretability and explainability of machine learning models.…

Artificial Intelligence · Computer Science 2023-08-08 Rafaël Brandt , Daan Raatjens , Georgi Gaydadjiev

The evaluation of the fidelity of eXplainable Artificial Intelligence (XAI) methods to their underlying models is a challenging task, primarily due to the absence of a ground truth for explanations. However, assessing fidelity is a…

Computer Vision and Pattern Recognition · Computer Science 2023-11-06 M. Miró-Nicolau , A. Jaume-i-Capó , G. Moyà-Alcover

With the increased usage of artificial intelligence (AI), it is imperative to understand how these models work internally. These needs have led to the development of a new field called eXplainable artificial intelligence (XAI). This field…

Computer Vision and Pattern Recognition · Computer Science 2023-10-05 Miquel Miró-Nicolau , Antoni Jaume-i-Capó , Gabriel Moyà-Alcover

The field of 'explainable' artificial intelligence (XAI) has produced highly cited methods that seek to make the decisions of complex machine learning (ML) methods 'understandable' to humans, for example by attributing 'importance' scores…

Machine Learning · Computer Science 2023-12-08 Benedict Clark , Rick Wilming , Stefan Haufe

Explainable artificial intelligence (XAI) methods shed light on the predictions of machine learning algorithms. Several different approaches exist and have already been applied in climate science. However, usually missing ground truth…

Machine Learning · Computer Science 2024-03-25 Philine Bommer , Marlene Kretschmer , Anna Hedström , Dilyara Bareeva , Marina M. -C. Höhne

Decision explanations of machine learning black-box models are often generated by applying Explainable AI (XAI) techniques. However, many proposed XAI methods produce unverified outputs. Evaluation and verification are usually achieved with…

Machine Learning · Computer Science 2020-12-09 Udo Schlegel , Daniela Oelke , Daniel A. Keim , Mennatallah El-Assady

Convolutional neural networks (CNNs) have recently attracted great attention in geoscience due to their ability to capture non-linear system behavior and extract predictive spatiotemporal patterns. Given their black-box nature however, and…

Geophysics · Physics 2022-09-07 Antonios Mamalakis , Elizabeth A. Barnes , Imme Ebert-Uphoff

Modern AI systems frequently rely on opaque black-box models, most notably Deep Neural Networks, whose performance stems from complex architectures with millions of learned parameters. While powerful, their complexity poses a major…

Machine Learning · Computer Science 2026-02-23 David Dembinsky , Adriano Lucieri , Stanislav Frolov , Hiba Najjar , Ko Watanabe , Andreas Dengel

This paper quantifies the quality of heatmap-based eXplainable AI (XAI) methods w.r.t image classification problem. Here, a heatmap is considered desirable if it improves the probability of predicting the correct classes. Different XAI…

Machine Learning · Computer Science 2023-01-24 Erico Tjoa , Hong Jing Khok , Tushar Chouhan , Guan Cuntai

Explainable AI (XAI) aims to provide interpretations for predictions made by learning machines, such as deep neural networks, in order to make the machines more transparent for the user and furthermore trustworthy also for applications in…

Machine Learning · Computer Science 2020-06-17 Kirill Bykov , Marina M. -C. Höhne , Klaus-Robert Müller , Shinichi Nakajima , Marius Kloft

Nowadays, deep neural networks are widely used in mission critical systems such as healthcare, self-driving vehicles, and military which have direct impact on human lives. However, the black-box nature of deep neural networks challenges its…

Computer Vision and Pattern Recognition · Computer Science 2020-06-24 Arun Das , Paul Rad

Explainable Artificial Intelligence (XAI) techniques are used to provide transparency to complex, opaque predictive models. However, these techniques are often designed for image and text data, and it is unclear how fit-for-purpose they are…

Computers and Society · Computer Science 2024-10-18 Mythreyi Velmurugan , Chun Ouyang , Yue Xu , Renuka Sindhgatta , Bemali Wickramanayake , Catarina Moreira

The evolving landscape of explainable artificial intelligence (XAI) aims to improve the interpretability of intricate machine learning (ML) models, yet faces challenges in formalisation and empirical validation, being an inherently…

This paper proposes a set of criteria to evaluate the objectiveness of explanation methods of neural networks, which is crucial for the development of explainable AI, but it also presents significant challenges. The core challenge is that…

Machine Learning · Computer Science 2019-11-21 Hao Zhang , Jiayi Chen , Haotian Xue , Quanshi Zhang

Deep neural networks have become increasingly popular for analyzing ECG data because of their ability to accurately identify cardiac conditions and hidden clinical factors. However, the lack of transparency due to the black box nature of…

Signal Processing · Electrical Eng. & Systems 2024-07-03 Patrick Wagner , Temesgen Mehari , Wilhelm Haverkamp , Nils Strodthoff

EXplainable AI (XAI) methods have been proposed to interpret how a deep neural network predicts inputs through model saliency explanations that highlight the parts of the inputs deemed important to arrive a decision at a specific target.…

Computer Vision and Pattern Recognition · Computer Science 2020-09-23 Yi-Shan Lin , Wen-Chuan Lee , Z. Berkay Celik

The main objective of eXplainable Artificial Intelligence (XAI) is to provide effective explanations for black-box classifiers. The existing literature lists many desirable properties for explanations to be useful, but there is no consensus…

Artificial Intelligence · Computer Science 2021-06-02 Elvio G. Amparore , Alan Perotti , Paolo Bajardi

Explainable AI (XAI) techniques have been widely used to help explain and understand the output of deep learning models in fields such as image classification and Natural Language Processing. Interest in using XAI techniques to explain deep…

Computation and Language · Computer Science 2023-05-30 Xiaoliang Wu , Peter Bell , Ajitha Rajan
‹ Prev 1 2 3 10 Next ›