English
Related papers

Related papers: This Looks Like Those: Illuminating Prototypical C…

200 papers

Image recognition with prototypes is considered an interpretable alternative for black box deep learning models. Classification depends on the extent to which a test image "looks like" a prototype. However, perceptual similarity for humans…

Computer Vision and Pattern Recognition · Computer Science 2022-08-18 Meike Nauta , Annemarie Jutte , Jesper Provoost , Christin Seifert

When we are faced with challenging image classification tasks, we often explain our reasoning by dissecting the image, and pointing out prototypical aspects of one class or another. The mounting evidence for each of the classes helps us…

Machine Learning · Computer Science 2020-01-01 Chaofan Chen , Oscar Li , Chaofan Tao , Alina Jade Barnett , Jonathan Su , Cynthia Rudin

We present a deformable prototypical part network (Deformable ProtoPNet), an interpretable image classifier that integrates the power of deep learning and the interpretability of case-based reasoning. This model classifies input images by…

Computer Vision and Pattern Recognition · Computer Science 2024-05-06 Jon Donnelly , Alina Jade Barnett , Chaofan Chen

Deep neural networks that yield human interpretable decisions by architectural design have lately become an increasingly popular alternative to post hoc interpretation of traditional black-box models. Among these networks, the arguably most…

Computer Vision and Pattern Recognition · Computer Science 2021-06-24 Adrian Hoffmann , Claudio Fanconi , Rahul Rade , Jonas Kohler

We present ProtoViT, a method for interpretable image classification combining deep learning and case-based reasoning. This method classifies an image by comparing it to a set of learned prototypes, providing explanations of the form ``this…

Computer Vision and Pattern Recognition · Computer Science 2025-09-11 Chiyu Ma , Jon Donnelly , Wenjun Liu , Soroush Vosoughi , Cynthia Rudin , Chaofan Chen

Classifying images with an interpretable decision-making process is a long-standing problem in computer vision. In recent years, Prototypical Part Networks has gained traction as an approach for self-explainable neural networks, due to…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Zhijie Zhu , Lei Fan , Maurice Pagnucco , Yang Song

We propose ProtoArgNet, a novel interpretable deep neural architecture for image classification in the spirit of prototypical-part-learning as found, e.g., in ProtoPNet. While earlier approaches associate every class with multiple…

Computer Vision and Pattern Recognition · Computer Science 2025-04-16 Hamed Ayoobi , Nico Potyka , Francesca Toni

Prototypical parts networks combine the power of deep learning with the explainability of case-based reasoning to make accurate, interpretable decisions. They follow the this looks like that reasoning, representing each prototypical part…

Computer Vision and Pattern Recognition · Computer Science 2024-05-24 Mateusz Pach , Dawid Rymarczyk , Koryna Lewandowska , Jacek Tabor , Bartosz Zieliński

Prototypical parts-based models offer a "this looks like that" paradigm for intrinsic interpretability, yet they typically struggle with ImageNet-scale generalization and often require computationally expensive backbone finetuning.…

Computer Vision and Pattern Recognition · Computer Science 2026-02-09 Mikołaj Janusz , Adam Wróbel , Bartosz Zieliński , Dawid Rymarczyk

Prototype learning, a popular machine learning method designed for inherently interpretable decisions, leverages similarities to learned prototypes for classifying new data. While it is mainly applied in computer vision, in this work, we…

Computation and Language · Computer Science 2023-12-14 Claudio Fanconi , Moritz Vandenhirtz , Severin Husmann , Julia E. Vogt

Although interpretable prototype networks have improved the transparency of deep learning image classification, the need for multiple prototypes in collaborative decision-making increases cognitive complexity and hinders user understanding.…

Computer Vision and Pattern Recognition · Computer Science 2025-08-04 Yitao Peng , Lianghua He , Hongzhou Chen

The use of deep neural models for diagnosis prediction from clinical text has shown promising results. However, in clinical practice such models must not only be accurate, but provide doctors with interpretable and helpful results. We…

We combine concept-based neural networks with generative, flow-based classifiers into a novel, intrinsically explainable, exactly invertible approach to supervised learning. Prototypical neural networks, a type of concept-based neural…

Machine Learning · Computer Science 2024-07-18 Zachariah Carmichael , Timothy Redgrave , Daniel Gonzalez Cedre , Walter J. Scheirer

Prototypical-part models are a popular interpretable alternative to black-box deep learning models for computer vision. However, they are difficult to train, with high sensitivity to hyperparameter tuning, inhibiting their application to…

Computer Vision and Pattern Recognition · Computer Science 2024-06-24 Frank Willard , Luke Moffett , Emmanuel Mokel , Jon Donnelly , Stark Guo , Julia Yang , Giyoung Kim , Alina Jade Barnett , Cynthia Rudin

Prototypical networks aim to build intrinsically explainable models based on the linear summation of concepts. Concepts are coherent entities that we, as humans, can recognize and associate with a certain object or entity. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Hugues Turbé , Mina Bjelogrlic , Gianmarco Mengaldo , Christian Lovis

Explaining black-box Artificial Intelligence (AI) models is a cornerstone for trustworthy AI and a prerequisite for its use in safety critical applications such that AI models can reliably assist humans in critical decisions. However,…

Computer Vision and Pattern Recognition · Computer Science 2023-03-10 Poulami Sinhamahapatra , Lena Heidemann , Maureen Monnet , Karsten Roscher

Prototype-based methods use interpretable representations to address the black-box nature of deep learning models, in contrast to post-hoc explanation methods that only approximate such models. We propose the Neural Prototype Tree…

Computer Vision and Pattern Recognition · Computer Science 2021-04-16 Meike Nauta , Ron van Bree , Christin Seifert

We introduce ProtoSeg, a novel model for interpretable semantic image segmentation, which constructs its predictions using similar patches from the training set. To achieve accuracy comparable to baseline methods, we adapt the mechanism of…

Computer Vision and Pattern Recognition · Computer Science 2025-06-30 Mikołaj Sacha , Dawid Rymarczyk , Łukasz Struski , Jacek Tabor , Bartosz Zieliński

Aligning machine representations with human understanding is key to improving interpretability of machine learning (ML) models. When classifying a new image, humans often explain their decisions by decomposing the image into concepts and…

Machine Learning · Computer Science 2025-01-13 Sarath Sivaprasad , Dmitry Kangin , Plamen Angelov , Mario Fritz

Vision models are interpretable when they classify objects on the basis of features that a person can directly understand. Recently, methods relying on visual feature prototypes have been developed for this purpose. However, in contrast to…

Computer Vision and Pattern Recognition · Computer Science 2019-08-27 Peter Hase , Chaofan Chen , Oscar Li , Cynthia Rudin
‹ Prev 1 2 3 10 Next ›