English
Related papers

Related papers: ProtoPShare: Prototype Sharing for Interpretable I…

200 papers

Prototypical-part methods, e.g., ProtoPNet, enhance interpretability in image recognition by linking predictions to training prototypes, thereby offering intuitive insights into their decision-making. Existing methods, which rely on a…

Computer Vision and Pattern Recognition · Computer Science 2025-04-14 Chong Wang , Yuanhong Chen , Fengbei Liu , Yuyuan Liu , Davis James McCarthy , Helen Frazer , Gustavo Carneiro

Prototypical part neural networks (ProtoPartNNs), namely PROTOPNET and its derivatives, are an intrinsically interpretable approach to machine learning. Their prototype learning scheme enables intuitive explanations of the form, this…

Computer Vision and Pattern Recognition · Computer Science 2023-09-27 Zachariah Carmichael , Suhas Lohit , Anoop Cherian , Michael Jones , Walter Scheirer

In this work, we introduce InfoDisent, a hybrid approach to explainability based on the information bottleneck principle. InfoDisent enables the disentanglement of information in the final layer of any pretrained model into atomic concepts,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-07 Łukasz Struski , Dawid Rymarczyk , Jacek Tabor

Prototype-based interpretability methods provide intuitive explanations of model prediction by comparing samples to a reference set of memorized exemplars or typical representatives in terms of similarity. In the field of sequential data…

Machine Learning · Computer Science 2023-03-20 Yifei Zhang , Neng Gao , Cunqing Ma

Interpretable part-prototype models are computer vision models that are explainable by design. The models learn prototypical parts and recognise these components in an image, thereby combining classification and explanation. Despite the…

Computer Vision and Pattern Recognition · Computer Science 2023-07-28 Meike Nauta , Christin Seifert

Many interpretable AI approaches have been proposed to provide plausible explanations for a model's decision-making. However, configuring an explainable model that effectively communicates among computational modules has received less…

Machine Learning · Computer Science 2023-11-09 Jinyung Hong , Keun Hee Park , Theodore P. Pavlic

Prototypical Learning is based on the idea that there is a point (which we call prototype) around which the embeddings of a class are clustered. It has shown promising results in scenarios with little labeled data or to design explainable…

Machine Learning · Computer Science 2024-06-25 Antonio Almudévar , Théo Mariotte , Alfonso Ortega , Marie Tahon , Luis Vicente , Antonio Miguel , Eduardo Lleida

Explainable Artificial Intelligence (xAI) has the potential to enhance the transparency and trust of AI-based systems. Although accurate predictions can be made using Deep Neural Networks (DNNs), the process used to arrive at such…

Computer Vision and Pattern Recognition · Computer Science 2024-08-09 Bhushan Atote , Victor Sanchez

Prototypical part network (ProtoPNet) has drawn wide attention and boosted many follow-up studies due to its self-explanatory property for explainable artificial intelligence (XAI). However, when directly applying ProtoPNet on vision…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Mengqi Xue , Qihan Huang , Haofei Zhang , Jingwen Hu , Jie Song , Mingli Song , Canghong Jin

The lack of transparency of Deep Neural Networks continues to be a limitation that severely undermines their reliability and usage in high-stakes applications. Promising approaches to overcome such limitations are Prototype-Based…

Machine Learning · Computer Science 2025-07-21 Jon Vadillo , Roberto Santana , Jose A. Lozano , Marta Kwiatkowska

Aligning machine representations with human understanding is key to improving interpretability of machine learning (ML) models. When classifying a new image, humans often explain their decisions by decomposing the image into concepts and…

Machine Learning · Computer Science 2025-01-13 Sarath Sivaprasad , Dmitry Kangin , Plamen Angelov , Mario Fritz

This work aims for image categorization using a representation of distinctive parts. Different from existing part-based work, we argue that parts are naturally shared between image categories and should be modeled as such. We motivate our…

Computer Vision and Pattern Recognition · Computer Science 2016-07-13 Pascal Mettes , Jan C. van Gemert , Cees G. M. Snoek

The goal of self-supervised visual representation learning is to learn strong, transferable image representations, with the majority of research focusing on object or scene level. On the other hand, representation learning at part level has…

Computer Vision and Pattern Recognition · Computer Science 2022-03-22 Subhabrata Choudhury , Iro Laina , Christian Rupprecht , Andrea Vedaldi

Prototype learning, a popular machine learning method designed for inherently interpretable decisions, leverages similarities to learned prototypes for classifying new data. While it is mainly applied in computer vision, in this work, we…

Computation and Language · Computer Science 2023-12-14 Claudio Fanconi , Moritz Vandenhirtz , Severin Husmann , Julia E. Vogt

Dataset summarisation is a fruitful approach to dataset inspection. However, when applied to a single dataset the discovery of visual concepts is restricted to those most prominent. We argue that a comparative approach can expand upon this…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Nanne van Noord

Due to the high inter-class similarity caused by the complex composition and the co-existing objects across scenes, numerous studies have explored object semantic knowledge within scenes to improve scene recognition. However, a resulting…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Chuanxin Song , Hanbo Wu , Xin Ma , Yibin Li

Part-prototype Networks (ProtoPNets) are concept-based classifiers designed to achieve the same performance as black-box models without compromising transparency. ProtoPNets compute predictions based on similarity to class-specific…

Machine Learning · Computer Science 2023-01-24 Andrea Bontempelli , Stefano Teso , Katya Tentori , Fausto Giunchiglia , Andrea Passerini

We combine concept-based neural networks with generative, flow-based classifiers into a novel, intrinsically explainable, exactly invertible approach to supervised learning. Prototypical neural networks, a type of concept-based neural…

Machine Learning · Computer Science 2024-07-18 Zachariah Carmichael , Timothy Redgrave , Daniel Gonzalez Cedre , Walter J. Scheirer

Interpretation and visualization of the behavior of detection transformers tends to highlight the locations in the image that the model attends to, but it provides limited insight into the \emph{semantics} that the model is focusing on.…

Computer Vision and Pattern Recognition · Computer Science 2025-12-08 Pavlos Rath-Manakidis , Frederik Strothmann , Tobias Glasmachers , Laurenz Wiskott

XAI gained considerable importance in recent years. Methods based on prototypical case-based reasoning have shown a promising improvement in explainability. However, these methods typically rely on additional post-hoc saliency techniques to…

Computer Vision and Pattern Recognition · Computer Science 2025-10-02 Steffen Meinert , Philipp Schlinge , Nils Strodthoff , Martin Atzmueller