English
Related papers

Related papers: Invertible Concept-based Explanations for CNN Mode…

200 papers

Deep learning models have shown their superior performance in various vision tasks. However, the lack of precisely interpreting kernels in convolutional neural networks (CNNs) is becoming one main obstacle to wide applications of deep…

Computer Vision and Pattern Recognition · Computer Science 2021-08-26 Jia-Xin Zhuang , Wanying Tao , Jianfei Xing , Wei Shi , Ruixuan Wang , Wei-shi Zheng

Analysis of how semantic concepts are represented within Convolutional Neural Networks (CNNs) is a widely used approach in Explainable Artificial Intelligence (XAI) for interpreting CNNs. A motivation is the need for transparency in…

Artificial Intelligence · Computer Science 2024-04-23 Georgii Mikriukov , Gesina Schwalbe , Christian Hellert , Korinna Bade

The rapid adoption of transformer-based models in computational pathology has enabled prediction of molecular and clinical biomarkers from H&E whole-slide images, yet interpretability has not kept pace with model complexity. While…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Marco Gustav , Fabian Wolf , Christina Glasner , Nic G. Reitsam , Stefan Schulz , Kira Aschenbroich , Bruno Märkl , Sebastian Foersch , Jakob Nikolas Kather

Convolutional Neural Networks (CNN) has been widely applied in the realm of computer vision. However, given the fact that CNN models are translation invariant, they are not aware of the coordinate information of each pixel. Thus the…

Computer Vision and Pattern Recognition · Computer Science 2020-03-25 Liliang Ren , Zhuonan Hao

Recent brain tumor classification methods often report high accuracy but rely on deep, over-parameterized architectures with limited interpretability, making it difficult to determine whether predictions are driven by tumor-relevant…

Image and Video Processing · Electrical Eng. & Systems 2026-03-24 Rajan Das Gupta , Md Imrul Hasan Showmick , Lei Wei , Mushfiqur Rahman Abir , Shanjida Akter , Md. Yeasin Rahat , Md. Jakir Hossen

Concept Activation Vectors (CAVs) are a fundamental tool for concept-based explainability in deep learning, yet their practical utility is limited by statistical instability. We analyze the stochastic nature of CAVs and the Testing with…

Machine Learning · Statistics 2026-05-18 Ekkehard Schnoor , Jawher Said , Malik Tiomoko , Wojciech Samek , Alexander Jung

Multimodal Emotion Recognition refers to the classification of input video sequences into emotion labels based on multiple input modalities (usually video, audio and text). In recent years, Deep Neural networks have shown remarkable…

Machine Learning · Computer Science 2024-10-28 Ashish Ramayee Asokan , Nidarshan Kumar , Anirudh Venkata Ragam , Shylaja S Sharath

A major prerequisite for the application of machine learning models in clinical decision making is trust and interpretability. Current explainability studies in the neuroimaging community have mostly focused on explaining individual…

Computer Vision and Pattern Recognition · Computer Science 2022-03-25 Fabian Eitel , Anna Melkonyan , Kerstin Ritter

A variety of methods exist to explain image classification models. However, whether they provide any benefit to users over simply comparing various inputs and the model's respective predictions remains unclear. We conducted a user study…

Machine Learning · Computer Science 2022-04-26 Leon Sixt , Martin Schuessler , Oana-Iuliana Popescu , Philipp Weiß , Tim Landgraf

Most image instance retrieval pipelines are based on comparison of vectors known as global image descriptors between a query image and the database images. Due to their success in large scale image classification, representations extracted…

Computer Vision and Pattern Recognition · Computer Science 2016-01-14 Olivier Morère , Antoine Veillard , Jie Lin , Julie Petta , Vijay Chandrasekhar , Tomaso Poggio

The interest in complex deep neural networks for computer vision applications is increasing. This leads to the need for improving the interpretable capabilities of these models. Recent explanation methods present visualizations of the…

Machine Learning · Computer Science 2020-04-24 Dan Valle , Tiago Pimentel , Adriano Veloso

In the field of eXplainable AI (XAI) in language models, the progression from local explanations of individual decisions to global explanations with high-level concepts has laid the groundwork for mechanistic interpretability, which aims to…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Yearim Kim , Sangyu Han , Sangbum Han , Nojun Kwak

Discovering and exploiting the causality in deep neural networks (DNNs) are crucial challenges for understanding and reasoning causal effects (CE) on an explainable visual model. "Intervention" has been widely used for recognizing a causal…

Computer Vision and Pattern Recognition · Computer Science 2021-10-11 Chao-Han Huck Yang , Yi-Chieh Liu , Pin-Yu Chen , Xiaoli Ma , Yi-Chang James Tsai

Convolutional Neural Networks have been known as black-box models as humans cannot interpret their inner functionalities. With an attempt to make CNNs more interpretable and trustworthy, we propose IS-CAM (Integrated Score-CAM), where we…

Computer Vision and Pattern Recognition · Computer Science 2020-10-08 Rakshit Naidu , Ankita Ghosh , Yash Maurya , Shamanth R Nayak K , Soumya Snigdha Kundu

We explore the interpretability of 3D geometric deep learning models in the context of Computer-Aided Design (CAD). The field of parametric CAD can be limited by the difficulty of expressing high-level design concepts in terms of a few…

Computer Vision and Pattern Recognition · Computer Science 2022-05-05 Stefan Druc , Aditya Balu , Peter Wooldridge , Adarsh Krishnamurthy , Soumik Sarkar

Due to the high stakes in medical decision-making, there is a compelling demand for interpretable deep learning methods in medical image analysis. Concept Bottleneck Models (CBM) have emerged as an active interpretable framework…

Computer Vision and Pattern Recognition · Computer Science 2024-06-28 Yibo Gao , Zheyao Gao , Xin Gao , Yuanye Liu , Bomin Wang , Xiahai Zhuang

Concept-based interpretability methods offer a lens into the internals of foundation models by decomposing their embeddings into high-level concepts. These concept representations are most useful when they are compositional, meaning that…

Computation and Language · Computer Science 2024-06-27 Adam Stein , Aaditya Naik , Yinjun Wu , Mayur Naik , Eric Wong

Learning useful representations of complex data has been the subject of extensive research for many years. With the diffusion of Deep Neural Networks, Variational Autoencoders have gained lots of attention since they provide an explicit…

Machine Learning · Computer Science 2020-09-15 Marco Maggipinto , Matteo Terzi , Gian Antonio Susto

Advancements in deep learning techniques have given a boost to the performance of anomaly detection. However, real-world and safety-critical applications demand a level of transparency and reasoning beyond accuracy. The task of anomaly…

Machine Learning · Computer Science 2023-11-03 Laya Rafiee Sevyeri , Ivaxi Sheth , Farhood Farahnak , Samira Ebrahimi Kahou , Shirin Abbasinejad Enger

The rapid development of Convolutional Neural Networks (CNNs) in recent years has triggered significant breakthroughs in many machine learning (ML) applications. The ability to understand and compare various CNN models available is thus…

Machine Learning · Computer Science 2022-01-19 Xiwei Xuan , Xiaoyu Zhang , Oh-Hyun Kwon , Kwan-Liu Ma