English
Related papers

Related papers: ProtoSolo: Interpretable Image Classification via …

200 papers

We present a novel usage of Transformers to make image classification interpretable. Unlike mainstream classifiers that wait until the last fully connected layer to incorporate class information to make predictions, we investigate a…

Prototypical part network (ProtoPNet) has drawn wide attention and boosted many follow-up studies due to its self-explanatory property for explainable artificial intelligence (XAI). However, when directly applying ProtoPNet on vision…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Mengqi Xue , Qihan Huang , Haofei Zhang , Jingwen Hu , Jie Song , Mingli Song , Canghong Jin

Deep Neural Networks use thousands of mostly incomprehensible features to identify a single class, a decision no human can follow. We propose an interpretable sparse and low dimensional final decision layer in a deep neural network with…

Computer Vision and Pattern Recognition · Computer Science 2023-08-08 Thomas Norrenbrock , Marco Rudolph , Bodo Rosenhahn

Prototypical parts-based models offer a "this looks like that" paradigm for intrinsic interpretability, yet they typically struggle with ImageNet-scale generalization and often require computationally expensive backbone finetuning.…

Computer Vision and Pattern Recognition · Computer Science 2026-02-09 Mikołaj Janusz , Adam Wróbel , Bartosz Zieliński , Dawid Rymarczyk

We combine concept-based neural networks with generative, flow-based classifiers into a novel, intrinsically explainable, exactly invertible approach to supervised learning. Prototypical neural networks, a type of concept-based neural…

Machine Learning · Computer Science 2024-07-18 Zachariah Carmichael , Timothy Redgrave , Daniel Gonzalez Cedre , Walter J. Scheirer

Deep neural networks that yield human interpretable decisions by architectural design have lately become an increasingly popular alternative to post hoc interpretation of traditional black-box models. Among these networks, the arguably most…

Computer Vision and Pattern Recognition · Computer Science 2021-06-24 Adrian Hoffmann , Claudio Fanconi , Rahul Rade , Jonas Kohler

Interpretability is a key requirement for the use of machine learning models in high-stakes applications, including medical diagnosis. Explaining black-box models mostly relies on post-hoc methods that do not faithfully reflect the model's…

Artificial Intelligence · Computer Science 2024-06-25 Kerol Djoumessi , Bubacarr Bah , Laura Kühlewein , Philipp Berens , Lisa Koch

Interpreting and explaining the behavior of deep neural networks is critical for many tasks. Explainable AI provides a way to address this challenge, mostly by providing per-pixel relevance to the decision. Yet, interpreting such…

Computer Vision and Pattern Recognition · Computer Science 2023-04-21 Bowen Wang , Liangzhi Li , Yuta Nakashima , Hajime Nagahara

We propose a novel perspective to understand deep neural networks in an interpretable disentanglement form. For each semantic class, we extract a class-specific functional subnetwork from the original full model, with compressed structure…

Machine Learning · Computer Science 2019-10-08 Yulong Wang , Xiaolin Hu , Hang Su

Recent applications of deep convolutional neural networks in medical imaging raise concerns about their interpretability. While most explainable deep learning applications use post hoc methods (such as GradCAM) to generate feature…

Computer Vision and Pattern Recognition · Computer Science 2023-04-17 Yuanyuan Wei , Roger Tam , Xiaoying Tang

In this paper, we introduce ProtoPShare, a self-explained method that incorporates the paradigm of prototypical parts to explain its predictions. The main novelty of the ProtoPShare is its ability to efficiently share prototypical parts…

Computer Vision and Pattern Recognition · Computer Science 2022-09-20 Dawid Rymarczyk , Łukasz Struski , Jacek Tabor , Bartosz Zieliński

We introduce Prototype Generation, a stricter and more robust form of feature visualisation for model-agnostic, data-independent interpretability of image classification models. We demonstrate its ability to generate inputs that result in…

Computer Vision and Pattern Recognition · Computer Science 2023-10-02 Arush Tagade , Jessica Rumbelow

Despite the success of deep learning in dermoscopy image analysis, its inherent black-box nature hinders clinical trust, motivating the use of prototypical networks for case-based visual transparency. However, inevitable selection bias in…

Image and Video Processing · Electrical Eng. & Systems 2026-03-02 Junhao Jia , Yueyi Wu , Huangwei Chen , Haodong Jing , Haishuai Wang , Jiajun Bu , Lei Wu

Prototype-based methods are of the particular interest for domain specialists and practitioners as they summarize a dataset by a small set of representatives. Therefore, in a classification setting, interpretability of the prototypes is as…

Machine Learning · Computer Science 2019-11-12 Babak Hosseini , Barbara Hammer

Purpose: Detailed surgical recognition is critical for advancing AI-assisted surgery, yet progress is hampered by high annotation costs, data scarcity, and a lack of interpretable models. While scene graphs offer a structured abstraction of…

Computer Vision and Pattern Recognition · Computer Science 2025-12-17 Felix Holm , Ghazal Ghazaei , Nassir Navab

State of the art algorithms for many pattern recognition problems rely on deep network models. Training these models requires a large labeled dataset and considerable computational resources. Also, it is difficult to understand the working…

Artificial Intelligence · Computer Science 2019-09-25 Heather Riley , Mohan Sridharan

Interpretability is often an essential requirement in medical imaging. Advanced deep learning methods are required to address this need for explainability and high performance. In this work, we investigate whether additional information…

Computer Vision and Pattern Recognition · Computer Science 2026-02-25 Luisa Gallee , Meinrad Beer , Michael Goetz

Many interpretable AI approaches have been proposed to provide plausible explanations for a model's decision-making. However, configuring an explainable model that effectively communicates among computational modules has received less…

Machine Learning · Computer Science 2023-11-09 Jinyung Hong , Keun Hee Park , Theodore P. Pavlic

Part-prototype networks (e.g., ProtoPNet, ProtoTree, and ProtoPool) have attracted broad research interest for their intrinsic interpretability and comparable accuracy to non-interpretable counterparts. However, recent works find that the…

Computer Vision and Pattern Recognition · Computer Science 2023-10-26 Qihan Huang , Mengqi Xue , Wenqi Huang , Haofei Zhang , Jie Song , Yongcheng Jing , Mingli Song

Multimodal molecular representation learning, which jointly models molecular graphs and their textual descriptions, enhances predictive accuracy and interpretability by enabling more robust and reliable predictions of drug toxicity,…

Machine Learning · Computer Science 2025-10-21 Yingxu Wang , Kunyu Zhang , Jiaxin Huang , Nan Yin , Siwei Liu , Eran Segal