English
Related papers

Related papers: Interpretable Network Visualizations: A Human-in-t…

200 papers

Convolutional neural networks (CNNs) have achieved superior accuracy in many visual related tasks. However, the inference process through intermediate layers is opaque, making it difficult to interpret such networks or develop trust in…

Computer Vision and Pattern Recognition · Computer Science 2021-10-22 Yael Konforti , Alon Shpigler , Boaz Lernerand Aharon Bar-Hillel

Explainability is a vital aspect of modern AI for real-world impact and usability. The main objective of this paper is to emphasise the need to understand the predictions of Computer Vision models, specifically Convolutional Neural Network…

Computer Vision and Pattern Recognition · Computer Science 2026-05-18 Ravidu Suien Rammuni Silva , Jordan J. Bird

Although standard Convolutional Neural Networks (CNNs) can be mathematically reinterpreted as Self-Explainable Models (SEMs), their built-in prototypes do not on their own accurately represent the data. Replacing the final linear layer with…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Ahcène Boubekki , Line H. Clemmensen

Visual interpretability of Convolutional Neural Networks (CNNs) has gained significant popularity because of the great challenges that CNN complexity imposes to understanding their inner workings. Although many techniques have been proposed…

Computer Vision and Pattern Recognition · Computer Science 2021-02-01 Alexandros Stergiou

Interpretability is a critical factor in applying complex deep learning models to advance the understanding of brain disorders in neuroimaging studies. To interpret the decision process of a trained classifier, existing techniques typically…

Image and Video Processing · Electrical Eng. & Systems 2021-06-29 Zixuan Liu , Ehsan Adeli , Kilian M. Pohl , Qingyu Zhao

This paper proposes a generic method to learn interpretable convolutional filters in a deep convolutional neural network (CNN) for object classification, where each interpretable filter encodes features of a specific object part. Our method…

Machine Learning · Computer Science 2020-03-13 Quanshi Zhang , Xin Wang , Ying Nian Wu , Huilin Zhou , Song-Chun Zhu

The reasonable definition of semantic interpretability presents the core challenge in explainable AI. This paper proposes a method to modify a traditional convolutional neural network (CNN) into an interpretable compositional CNN, in order…

Computer Vision and Pattern Recognition · Computer Science 2021-07-12 Wen Shen , Zhihua Wei , Shikun Huang , Binbin Zhang , Jiaqi Fan , Ping Zhao , Quanshi Zhang

Classifying images with an interpretable decision-making process is a long-standing problem in computer vision. In recent years, Prototypical Part Networks has gained traction as an approach for self-explainable neural networks, due to…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Zhijie Zhu , Lei Fan , Maurice Pagnucco , Yang Song

Interpretability is crucial for machine learning algorithms in high-stakes medical applications. However, high-performing neural networks typically cannot explain their predictions. Post-hoc explanation methods provide a way to understand…

Computer Vision and Pattern Recognition · Computer Science 2025-11-14 Susu Sun , Stefano Woerner , Andreas Maier , Lisa M. Koch , Christian F. Baumgartner

While Transformers have rapidly gained popularity in various computer vision applications, post-hoc explanations of their internal mechanisms remain largely unexplored. Vision Transformers extract visual information by representing image…

Computer Vision and Pattern Recognition · Computer Science 2024-03-22 Junyi Wu , Bin Duan , Weitai Kang , Hao Tang , Yan Yan

We propose a technique for making Convolutional Neural Network (CNN)-based models more transparent by visualizing input regions that are 'important' for predictions -- or visual explanations. Our approach, called Gradient-weighted Class…

Currently available methods for extracting saliency maps identify parts of the input which are the most important to a specific fixed classifier. We show that this strong dependence on a given classifier hinders their performance. To…

Machine Learning · Computer Science 2020-07-21 Konrad Zolna , Krzysztof J. Geras , Kyunghyun Cho

When we deploy machine learning models in high-stakes medical settings, we must ensure these models make accurate predictions that are consistent with known medical science. Inherently interpretable networks address this need by explaining…

Computer Vision and Pattern Recognition · Computer Science 2021-10-06 Alina Jade Barnett , Fides Regina Schwartz , Chaofan Tao , Chaofan Chen , Yinhao Ren , Joseph Y. Lo , Cynthia Rudin

Recently, many methods to interpret and visualize deep neural network predictions have been proposed and significant progress has been made. However, a more class-discriminative and visually pleasing explanation is required. Thus, this…

Computer Vision and Pattern Recognition · Computer Science 2020-01-06 Dasom Seo , Kanghan Oh , Il-Seok Oh

Feature extraction with convolutional neural networks (CNNs) is a popular method to represent images for machine learning tasks. These representations seek to capture global image content, and ideally should be independent of geometric…

Machine Learning · Computer Science 2022-03-03 Jake Lee , Junfeng Yang , Zhangyang Wang

With the intervention of machine vision in our crucial day to day necessities including healthcare and automated power plants, attention has been drawn to the internal mechanisms of convolutional neural networks, and the reason why the…

Computer Vision and Pattern Recognition · Computer Science 2025-07-15 Ram S Iyer , Narayan S Iyer , Rugmini Ammal P

Over the past decade deep learning has revolutionized the field of computer vision, with convolutional neural network models proving to be very effective for image classification benchmarks. However, a fundamental theoretical questions…

Computer Vision and Pattern Recognition · Computer Science 2023-07-04 Vinoth Nandakumar , Arush Tagade , Tongliang Liu

Despite the tremendous achievements of deep convolutional neural networks (CNNs) in many computer vision tasks, understanding how they actually work remains a significant challenge. In this paper, we propose a novel two-step understanding…

Computer Vision and Pattern Recognition · Computer Science 2019-04-02 Heyi Li , Yunke Tian , Klaus Mueller , Xin Chen

Image classification is an essential part of computer vision which assigns a given input image to a specific category based on the similarity evaluation within given criteria. While promising classifiers can be obtained through deep…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Emma Andrews , Prabhat Mishra

Neural network visualization techniques mark image locations by their relevancy to the network's classification. Existing methods are effective in highlighting the regions that affect the resulting classification the most. However, as we…

Computer Vision and Pattern Recognition · Computer Science 2020-12-04 Shir Gur , Ameen Ali , Lior Wolf