English
Related papers

Related papers: Feature CAM: Interpretable AI in Image Classificat…

200 papers

As AI-based medical devices are becoming more common in imaging fields like radiology and histology, interpretability of the underlying predictive models is crucial to expand their use in clinical practice. Existing heatmap-based…

Image and Video Processing · Electrical Eng. & Systems 2021-01-20 Kathryn Schutte , Olivier Moindrot , Paul Hérent , Jean-Baptiste Schiratti , Simon Jégou

Multivariate techniques and machine learning models have found numerous applications in High Energy Physics (HEP) research over many years. In recent times, AI models based on deep neural networks are becoming increasingly popular for many…

High Energy Physics - Experiment · Physics 2022-11-24 Avik Roy , Mark S. Neubauer

Deep learning methods, in particular convolutional neural networks, have emerged as a powerful tool in medical image computing tasks. While these complex models provide excellent performance, their black-box nature may hinder real-world…

Image and Video Processing · Electrical Eng. & Systems 2022-10-18 Yuzhe Lu , Adam Perer

The classification of internet traffic has become increasingly important due to the rapid growth of today's networks and applications. The number of connections and the addition of new applications in our networks causes a vast amount of…

Machine Learning · Computer Science 2022-11-23 Igor Cherepanov , Alex Ulmer , Jonathan Geraldi Joewono , Jörn Kohlhammer

Neural networks are often described as black boxes, reflecting the significant challenge of understanding their internal workings and interactions. We propose a different perspective that challenges the prevailing view: rather than being…

Machine Learning · Computer Science 2025-10-23 Shuchen Wu , Stephan Alaniz , Shyamgopal Karthik , Peter Dayan , Eric Schulz , Zeynep Akata

Building generalizable AI models is one of the primary challenges in the healthcare domain. While radiologists rely on generalizable descriptive rules of abnormality, Neural Network (NN) models suffer even with a slight shift in input…

Computer Vision and Pattern Recognition · Computer Science 2023-07-12 Shantanu Ghosh , Ke Yu , Kayhan Batmanghelich

In this paper two new learning-based eXplainable AI (XAI) methods for deep convolutional neural network (DCNN) image classifiers, called L-CAM-Fm and L-CAM-Img, are proposed. Both methods use an attention mechanism that is inserted in the…

Computer Vision and Pattern Recognition · Computer Science 2022-09-23 Ioanna Gkartzonika , Nikolaos Gkalelis , Vasileios Mezaris

This paper presents a tutorial of an explainable approach using Convolutional Neural Network (CNN) and Gradient-weighted Class Activation Mapping (Grad-CAM) to classify four progressive dementia stages based on open MRI brain images. The…

Image and Video Processing · Electrical Eng. & Systems 2024-08-21 Kevin Kam Fung Yuen

The deep neural networks (DNNs) have achieved great success in learning complex patterns with strong predictive power, but they are often thought of as "black box" models without a sufficient level of transparency and interpretability. It…

Machine Learning · Computer Science 2020-11-10 Agus Sudjianto , William Knauth , Rahul Singh , Zebin Yang , Aijun Zhang

Explainable AI (XAI) methods focus on explaining what a neural network has learned - in other words, identifying the features that are the most influential to the prediction. In this paper, we call them "distinguishing features". However,…

Computer Vision and Pattern Recognition · Computer Science 2021-04-19 Kaili Wang , Jose Oramas , Tinne Tuytelaars

Neural networks are commonly regarded as black boxes performing incomprehensible functions. For classification problems networks provide maps from high dimensional feature space to K-dimensional image space. Images of training vector are…

Neural and Evolutionary Computing · Computer Science 2018-02-26 Wlodzislaw Duch

Convolutional neural network (CNN) models for computer vision are powerful but lack explainability in their most basic form. This deficiency remains a key challenge when applying CNNs in important domains. Recent work on explanations…

Computer Vision and Pattern Recognition · Computer Science 2021-06-18 Ruihan Zhang , Prashan Madumal , Tim Miller , Krista A. Ehinger , Benjamin I. P. Rubinstein

Deep learning is currently playing a crucial role toward higher levels of artificial intelligence. This paradigm allows neural networks to learn complex and abstract representations, that are progressively obtained by combining simpler…

Audio and Speech Processing · Electrical Eng. & Systems 2019-08-12 Mirco Ravanelli , Yoshua Bengio

Interpretability of learning-to-rank models is a crucial yet relatively under-examined research area. Recent progress on interpretable ranking models largely focuses on generating post-hoc explanations for existing black-box ranking models,…

The integration of Artificial Intelligence (AI) in medical diagnostics is often hindered by model opacity, where high-accuracy systems function as "black boxes" without transparent reasoning. This limitation is critical in clinical…

Image and Video Processing · Electrical Eng. & Systems 2024-09-23 Pascal Passigan , Vayd Ramkumar

An important line of research attempts to explain CNN image classifier predictions and intermediate layer representations in terms of human-understandable concepts. Previous work supports that deep representations are linearly separable…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Alexandros Doumanoglou , Stylianos Asteriadis , Dimitrios Zarpalas

We propose a general framework called Network Dissection for quantifying the interpretability of latent representations of CNNs by evaluating the alignment between individual hidden units and a set of semantic concepts. Given any CNN model,…

Computer Vision and Pattern Recognition · Computer Science 2017-04-20 David Bau , Bolei Zhou , Aditya Khosla , Aude Oliva , Antonio Torralba

Artificial neural networks have long been understood as "black boxes": though we know their computation graphs and learned parameters, the knowledge encoded by these weights and functions they perform are not inherently interpretable. As…

Artificial Intelligence · Computer Science 2024-08-13 Adam Davies , Ashkan Khakzar

The multimodal deep neural networks, represented by CLIP, have generated rich downstream applications owing to their excellent performance, thus making understanding the decision-making process of CLIP an essential research topic. Due to…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Chenming Shang , Hengyuan Zhang , Hao Wen , Yujiu Yang

Many Machine Learning algorithms, such as deep neural networks, have long been criticized for being "black-boxes"-a kind of models unable to provide how it arrive at a decision without further efforts to interpret. This problem has raised…

Machine Learning · Statistics 2019-07-04 Yihuang Kang , I-Ling Cheng , Wenjui Mao , Bowen Kuo , Pei-Ju Lee