English
Related papers

Related papers: Classification Metrics for Image Explanations: Tow…

200 papers

Deep learning techniques have revolutionized image classification by mimicking human cognition and automating complex decision-making processes. However, the deployment of AI systems in the wild, especially in high-security domains such as…

Computer Vision and Pattern Recognition · Computer Science 2024-09-24 Purushothaman Natarajan , Athira Nambiar

Saliency maps can explain a neural model's predictions by identifying important input features. They are difficult to interpret for laypeople, especially for instances with many features. In order to make them more accessible, we formalize…

Computation and Language · Computer Science 2023-06-08 Nils Feldhus , Leonhard Hennig , Maximilian Dustin Nasert , Christopher Ebert , Robert Schwarzenberg , Sebastian Möller

The evaluation of explainable artificial intelligence is challenging, because automated and human-centred metrics of explanation quality may diverge. To clarify their relationship, we investigated whether human and artificial image…

Human-Computer Interaction · Computer Science 2024-08-20 Romy Müller , Marius Thoß , Julian Ullrich , Steffen Seitz , Carsten Knoll

Saliency methods are widely used to interpret neural network predictions, but different variants of saliency methods often disagree even on the interpretations of the same prediction made by the same model. In these cases, how do we…

Computation and Language · Computer Science 2021-04-14 Shuoyang Ding , Philipp Koehn

Explainable artificially intelligent (XAI) systems form part of sociotechnical systems, e.g., human+AI teams tasked with making decisions. Yet, current XAI systems are rarely evaluated by measuring the performance of human+AI teams on…

Artificial Intelligence · Computer Science 2020-01-24 Zana Buçinca , Phoebe Lin , Krzysztof Z. Gajos , Elena L. Glassman

Visual saliency models have enjoyed a big leap in performance in recent years, thanks to advances in deep learning and large scale annotated data. Despite enormous effort and huge breakthroughs, however, models still fall short in reaching…

Computer Vision and Pattern Recognition · Computer Science 2019-05-28 Ali Borji

eXplainable artificial intelligence (XAI) methods have emerged to convert the black box of machine learning (ML) models into a more digestible form. These methods help to communicate how the model works with the aim of making ML models more…

Saliency maps that identify the most informative regions of an image for a classifier are valuable for model interpretability. A common approach to creating saliency maps involves generating input masks that mask out portions of an image to…

Computer Vision and Pattern Recognition · Computer Science 2020-10-21 Jason Phang , Jungkyu Park , Krzysztof J. Geras

With an increase in deep learning-based methods, the call for explainability of such methods grows, especially in high-stakes decision making areas such as medical image analysis. This survey presents an overview of eXplainable Artificial…

Image and Video Processing · Electrical Eng. & Systems 2022-05-06 Bas H. M. van der Velden , Hugo J. Kuijf , Kenneth G. A. Gilhuijs , Max A. Viergever

We recently developed a deep learning method that can determine the critical peak stress of a material by looking at scanning electron microscope (SEM) images of the material's crystals. However, it has been somewhat unclear what kind of…

Image and Video Processing · Electrical Eng. & Systems 2021-11-09 Ian A. Palmer , T. Nathan Mundhenk , Brian Gallagher , Yong Han

Neural network visualization techniques mark image locations by their relevancy to the network's classification. Existing methods are effective in highlighting the regions that affect the resulting classification the most. However, as we…

Computer Vision and Pattern Recognition · Computer Science 2020-12-04 Shir Gur , Ameen Ali , Lior Wolf

This paper addresses the visualisation of image classification models, learnt using deep Convolutional Networks (ConvNets). We consider two visualisation techniques, based on computing the gradient of the class score with respect to the…

Computer Vision and Pattern Recognition · Computer Science 2014-04-22 Karen Simonyan , Andrea Vedaldi , Andrew Zisserman

Concept-based XAI (C-XAI) approaches to explaining neural vision models are a promising field of research, since explanations that refer to concepts (i.e., semantically meaningful parts in an image) are intuitive to understand and go beyond…

Computer Vision and Pattern Recognition · Computer Science 2024-09-23 Jae Hee Lee , Georgii Mikriukov , Gesina Schwalbe , Stefan Wermter , Diedrich Wolter

The different families of saliency methods, either based on contrastive signals, closed-form formulas mixing gradients with activations or on perturbation masks, all focus on which parts of an image are responsible for the model's…

Computer Vision and Pattern Recognition · Computer Science 2019-10-22 Sylvestre-Alvise Rebuffi , Ruth Fong , Xu Ji , Hakan Bilen , Andrea Vedaldi

More recently, Explainable Artificial Intelligence (XAI) research has shifted to focus on a more pragmatic or naturalistic account of understanding, that is, whether the stakeholders understand the explanation. This point is especially…

Human-Computer Interaction · Computer Science 2021-08-05 Janet Hui-wen Hsiao , Hilary Hei Ting Ngai , Luyu Qiu , Yi Yang , Caleb Chen Cao

The interest in complex deep neural networks for computer vision applications is increasing. This leads to the need for improving the interpretable capabilities of these models. Recent explanation methods present visualizations of the…

Machine Learning · Computer Science 2020-04-24 Dan Valle , Tiago Pimentel , Adriano Veloso

Explaining deep convolutional neural networks has been recently drawing increasing attention since it helps to understand the networks' internal operations and why they make certain decisions. Saliency maps, which emphasize salient regions…

Computer Vision and Pattern Recognition · Computer Science 2022-08-10 Quan Zheng , Ziwei Wang , Jie Zhou , Jiwen Lu

In recent years, the deep learning techniques have been applied to the estimation of saliency maps, which represent probability density functions of fixations when people look at the images. Although the methods of saliency-map estimation…

Computer Vision and Pattern Recognition · Computer Science 2018-07-18 Tatsuya Suzuki , Takao Yamanaka

A fundamental bottleneck in utilising complex machine learning systems for critical applications has been not knowing why they do and what they do, thus preventing the development of any crucial safety protocols. To date, no method exist…

Machine Learning · Computer Science 2023-01-18 Jan Rosenzweig , Zoran Cvetkovic , Ivana Rosenzweig

Explainable AI (XAI) is a rapidly growing domain with a myriad of proposed methods as well as metrics aiming to evaluate their efficacy. However, current studies are often of limited scope, examining only a handful of XAI methods and…

Computer Vision and Pattern Recognition · Computer Science 2025-01-03 Lukas Klein , Carsten T. Lüth , Udo Schlegel , Till J. Bungert , Mennatallah El-Assady , Paul F. Jäger