English
Related papers

Related papers: Beyond Patches: Mining Interpretable Part-Prototyp…

200 papers

We propose a novel interpretable deep neural network for text classification, called ProtoryNet, based on a new concept of prototype trajectories. Motivated by the prototype theory in modern linguistics, ProtoryNet makes a prediction by…

Machine Learning · Computer Science 2023-11-07 Dat Hong , Tong Wang , Stephen S. Baek

Explainability remains a critical challenge in artificial intelligence (AI) systems, particularly in high stakes domains such as healthcare, finance, and decision support, where users must understand and trust automated reasoning.…

Human-Computer Interaction · Computer Science 2025-08-05 Rukshani Somarathna , Madhawa Perera , Tom Gedeon , Matt Adcock

Concept-based Models are a class of inherently explainable networks that improve upon standard Deep Neural Networks by providing a rationale behind their predictions using human-understandable `concepts'. With these models being highly…

Machine Learning · Computer Science 2025-06-06 Sanchit Sinha , Aidong Zhang

Concept Bottleneck Models (CBMs) improve the explainability of black-box Deep Learning (DL) by introducing intermediate semantic concepts. However, standard CBMs often overlook domain-specific relationships and causal mechanisms, and their…

Machine Learning · Computer Science 2026-01-16 Reza M. Asiyabi , SEOSAW Partnership , Steven Hancock , Casey Ryan

Prototype-based classification learning methods are known to be inherently interpretable. However, this paradigm suffers from major limitations compared to deep models, such as lower performance. This led to the development of the so-called…

Machine Learning · Computer Science 2025-04-18 Sascha Saralajew , Ashish Rana , Thomas Villmann , Ammar Shaker

This paper presents Discriminative Part Network (DP-Net), a deep architecture with strong interpretation capabilities, which exploits a pretrained Convolutional Neural Network (CNN) combined with a part-based recognition module. This system…

Computer Vision and Pattern Recognition · Computer Science 2024-04-24 Ronan Sicre , Hanwei Zhang , Julien Dejasmin , Chiheb Daaloul , Stéphane Ayache , Thierry Artières

Humans are able to explain their reasoning. On the contrary, deep neural networks are not. This paper attempts to bridge this gap by introducing a new way to design interpretable neural networks for classification, inspired by physiological…

Machine Learning · Statistics 2017-11-20 Shane Barratt

With the broader and highly successful usage of machine learning in industry and the sciences, there has been a growing demand for Explainable AI. Interpretability and explanation methods for gaining a better understanding about the problem…

Machine Learning · Computer Science 2021-02-26 Wojciech Samek , Grégoire Montavon , Sebastian Lapuschkin , Christopher J. Anders , Klaus-Robert Müller

We introduce Discovering Conceptual Network Explanations (DCNE), a new approach for generating human-comprehensible visual explanations to enhance the interpretability of deep neural image classifiers. Our method automatically finds visual…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Neehar Kondapaneni , Markus Marks , Oisin Mac Aodha , Pietro Perona

Convolutional Neural Networks (CNNs) have exhibited great performance in discriminative feature learning for complex visual tasks. Besides discrimination power, interpretability is another important yet under-explored property for CNNs. One…

Computer Vision and Pattern Recognition · Computer Science 2023-12-20 Wengang Guo , Jiayi Yang , Huilin Yin , Qijun Chen , Wei Ye

Deep learning models have achieved strong performance in medical image analysis, but their internal decision processes remain difficult to interpret. Concept Bottleneck Models (CBMs) partially address this limitation by structuring…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Getamesay Dagnaw , Xuefei Yin , Muhammad Hassan Maqsood , Yanming Zhu , Alan Wee-Chung Liew

Interpretability of deep neural networks (DNNs) is essential since it enables users to understand the overall strengths and weaknesses of the models, conveys an understanding of how the models will behave in the future, and how to diagnose…

Computer Vision and Pattern Recognition · Computer Science 2017-03-31 Yinpeng Dong , Hang Su , Jun Zhu , Bo Zhang

Models based on human-understandable concepts have received extensive attention to improve model interpretability for trustworthy artificial intelligence in the field of medical image analysis. These methods can provide convincing…

Computer Vision and Pattern Recognition · Computer Science 2024-12-25 Hongmei Wang , Junlin Hou , Hao Chen

Interpretability of artificial intelligence (AI) methods, particularly deep neural networks, is of great interest. This heightened focus stems from the widespread use of AI-backed systems. These systems, often relying on intricate neural…

Quantum Physics · Physics 2024-11-11 Lirandë Pira , Chris Ferrie

Interpretable deep learning models have received widespread attention in the field of image recognition. Due to the unique multi-instance learning of medical images and the difficulty in identifying decision-making regions, many…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Yitao Peng , Lianghua He , Die Hu , Yihang Liu , Longzhen Yang , Shaohua Shang

Concept Bottleneck Models (CBMs) provide a basis for semantic abstractions within a neural network architecture. Such models have primarily been seen through the lens of interpretability so far, wherein they offer transparency by inferring…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Deepika SN Vemuri , Gautham Bellamkonda , Aditya Pola , Vineeth N Balasubramanian

Despite the recent progress in Graph Neural Networks (GNNs), it remains challenging to explain the predictions made by GNNs. Existing explanation methods mainly focus on post-hoc explanations where another explanatory model is employed to…

Machine Learning · Computer Science 2021-12-03 Zaixi Zhang , Qi Liu , Hao Wang , Chengqiang Lu , Cheekong Lee

Deep convolutional neural networks (CNN) always depend on wider receptive field (RF) and more complex non-linearity to achieve state-of-the-art performance, while suffering the increased difficult to interpret how relevant patches…

Computer Vision and Pattern Recognition · Computer Science 2020-04-20 Chuanguang Yang , Zhulin An , Xiaolong Hu , Hui Zhu , Yongjun Xu

With the continue development of Convolutional Neural Networks (CNNs), there is a growing concern regarding representations that they encode internally. Analyzing these internal representations is referred to as model interpretation. While…

Computer Vision and Pattern Recognition · Computer Science 2023-05-18 Hamed Behzadi-Khormouji , José Oramas

Concept Bottleneck Models (CBMs) enhance the interpretability of neural networks by basing predictions on human-understandable concepts. However, current CBMs typically rely on concept sets extracted from large language models or extensive…

Computer Vision and Pattern Recognition · Computer Science 2025-07-03 Katharina Prasse , Patrick Knab , Sascha Marton , Christian Bartelt , Margret Keuper