English
Related papers

Related papers: Feature CAM: Interpretable AI in Image Classificat…

200 papers

A main issue preventing the use of Convolutional Neural Networks (CNN) in end user applications is the low level of transparency in the decision process. Previous work on CNN interpretability has mostly focused either on localizing the…

Computer Vision and Pattern Recognition · Computer Science 2019-09-19 Diego Marcos , Sylvain Lobry , Devis Tuia

When we deploy machine learning models in high-stakes medical settings, we must ensure these models make accurate predictions that are consistent with known medical science. Inherently interpretable networks address this need by explaining…

Computer Vision and Pattern Recognition · Computer Science 2021-10-06 Alina Jade Barnett , Fides Regina Schwartz , Chaofan Tao , Chaofan Chen , Yinhao Ren , Joseph Y. Lo , Cynthia Rudin

Convolutional neural networks (CNN) are known for their excellent feature extraction capabilities to enable the learning of models from data, yet are used as black boxes. An interpretation of the convolutional filtres and associated…

Machine Learning · Computer Science 2022-07-27 Shagufta Henna , Juan Miguel Lopez Alcaraz

The rapid evolution of machine learning (ML) has led to the widespread adoption of complex "black box" models, such as deep neural networks and ensemble methods. These models exhibit exceptional predictive performance, making them…

Machine Learning · Computer Science 2025-03-28 Moncef Garouani , Josiane Mothe , Ayah Barhrhouj , Julien Aligon

Recent research in deep learning methodology has led to a variety of complex modelling techniques in computer vision (CV) that reach or even outperform human performance. Although these black-box deep learning models have obtained…

Computer Vision and Pattern Recognition · Computer Science 2023-09-26 Anh Pham Thi Minh

Interpretability has become an essential topic for artificial intelligence in some high-risk domains such as healthcare, bank and security. For commonly-used tabular data, traditional methods trained end-to-end machine learning models with…

Artificial Intelligence · Computer Science 2022-08-18 Haixiao Chi , Dawei Wang , Gaojie Cui , Feng Mao , Beishui Liao

Although deep learning models are powerful among various applications, most deep learning models are still a black box, lacking verifiability and interpretability, which means the decision-making process that human beings cannot understand.…

Computer Vision and Pattern Recognition · Computer Science 2021-09-29 Qianmengke Zhao , Ye Wang , Qun Liu

Deep neural networks (DNNs) have shown exceptional performances in a wide range of tasks and have become the go-to method for problems requiring high-level predictive power. There has been extensive research on how DNNs arrive at their…

Machine Learning · Computer Science 2023-02-21 Mattias Luber , Anton Thielmann , Benjamin Säfken

Deep learning methods based on Convolutional Neural Networks (CNNs) have shown great potential to improve early and accurate diagnosis of Alzheimer's disease (AD) dementia based on imaging data. However, these methods have yet to be widely…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Wenjie Kang , Lize Jiskoot , Peter De Deyn , Geert Biessels , Huiberdina Koek , Jurgen Claassen , Huub Middelkoop , Wiesje Flier , Willemijn J. Jansen , Stefan Klein , Esther Bron

Interpretability of deep neural networks (DNNs) is essential since it enables users to understand the overall strengths and weaknesses of the models, conveys an understanding of how the models will behave in the future, and how to diagnose…

Computer Vision and Pattern Recognition · Computer Science 2017-03-31 Yinpeng Dong , Hang Su , Jun Zhu , Bo Zhang

Recently, interpretable machine learning has re-explored concept bottleneck models (CBM). An advantage of this model class is the user's ability to intervene on predicted concept values, affecting the downstream output. In this work, we…

Machine Learning · Computer Science 2024-10-29 Sonia Laguna , Ričards Marcinkevičs , Moritz Vandenhirtz , Julia E. Vogt

In recent years, deep learning has become prevalent to solve applications from multiple domains. Convolutional Neural Networks (CNNs) particularly have demonstrated state of the art performance for the task of image classification. However,…

Computer Vision and Pattern Recognition · Computer Science 2021-12-01 Meghna P Ayyar , Jenny Benois-Pineau , Akka Zemmari

As the request for deep learning solutions increases, the need for explainability is even more fundamental. In this setting, particular attention has been given to visualization techniques, that try to attribute the right relevance to each…

Computer Vision and Pattern Recognition · Computer Science 2021-04-22 Samuele Poppi , Marcella Cornia , Lorenzo Baraldi , Rita Cucchiara

This paper reviews recent studies in understanding neural-network representations and learning neural networks with interpretable/disentangled middle-layer representations. Although deep neural networks have exhibited superior performance…

Computer Vision and Pattern Recognition · Computer Science 2018-02-08 Quanshi Zhang , Song-Chun Zhu

Explainability is a vital aspect of modern AI for real-world impact and usability. The main objective of this paper is to emphasise the need to understand the predictions of Computer Vision models, specifically Convolutional Neural Network…

Computer Vision and Pattern Recognition · Computer Science 2026-05-18 Ravidu Suien Rammuni Silva , Jordan J. Bird

Deep CNNs have been pushing the frontier of visual recognition over past years. Besides recognition accuracy, strong demands in understanding deep CNNs in the research community motivate developments of tools to dissect pre-trained models…

Computer Vision and Pattern Recognition · Computer Science 2019-08-20 Bangjie Yin , Luan Tran , Haoxiang Li , Xiaohui Shen , Xiaoming Liu

Deep Learning has revolutionized machine learning, reaching unprecedented levels of accuracy, but at the cost of reduced interpretability. Especially in image processing systems, deep networks transform local pixel information into more…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Xinyi Zhang , Manuel Günther

Due to the widespread use of complex machine learning models in real-world applications, it is becoming critical to explain model predictions. However, these models are typically black-box deep neural networks, explained post-hoc via…

Machine Learning · Computer Science 2022-10-20 Filip Radenovic , Abhimanyu Dubey , Dhruv Mahajan

In machine learning algorithm design, there exists a trade-off between the interpretability and performance of the algorithm. In general, algorithms which are simpler and easier for humans to comprehend tend to show worse performance than…

Machine Learning · Computer Science 2024-07-15 Eric M. Vernon , Naoki Masuyama , Yusuke Nojima

The use of deep learning in computer vision tasks such as image classification has led to a rapid increase in the performance of such systems. Due to this substantial increment in the utility of these systems, the use of artificial…

Image and Video Processing · Electrical Eng. & Systems 2023-04-05 Vinay Jogani , Joy Purohit , Ishaan Shivhare , Seema C Shrawne