English
Related papers

Related papers: AutoProtoNet: Interpretability for Prototypical Ne…

200 papers

Visual prompt tuning offers significant advantages for adapting pre-trained visual foundation models to specific tasks. However, current research provides limited insight into the interpretability of this approach, which is essential for…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Yubin Wang , Xinyang Jiang , De Cheng , Xiangqian Zhao , Zilong Wang , Dongsheng Li , Cairong Zhao

Explainable Artificial Intelligence (xAI) has the potential to enhance the transparency and trust of AI-based systems. Although accurate predictions can be made using Deep Neural Networks (DNNs), the process used to arrive at such…

Computer Vision and Pattern Recognition · Computer Science 2024-08-09 Bhushan Atote , Victor Sanchez

Many text classification applications require models with satisfying performance as well as good interpretability. Traditional machine learning methods are easy to interpret but have low accuracies. The development of deep learning models…

Computation and Language · Computer Science 2020-06-02 Zhengyang Wang , Xia Hu , Shuiwang Ji

Although interpretable prototype networks have improved the transparency of deep learning image classification, the need for multiple prototypes in collaborative decision-making increases cognitive complexity and hinders user understanding.…

Computer Vision and Pattern Recognition · Computer Science 2025-08-04 Yitao Peng , Lianghua He , Hongzhou Chen

Prototypical part network (ProtoPNet) methods have been designed to achieve interpretable classification by associating predictions with a set of training prototypes, which we refer to as trivial prototypes because they are trained to lie…

Computer Vision and Pattern Recognition · Computer Science 2023-10-24 Chong Wang , Yuyuan Liu , Yuanhong Chen , Fengbei Liu , Yu Tian , Davis J. McCarthy , Helen Frazer , Gustavo Carneiro

Part-prototype networks (e.g., ProtoPNet, ProtoTree, and ProtoPool) have attracted broad research interest for their intrinsic interpretability and comparable accuracy to non-interpretable counterparts. However, recent works find that the…

Computer Vision and Pattern Recognition · Computer Science 2023-10-26 Qihan Huang , Mengqi Xue , Wenqi Huang , Haofei Zhang , Jie Song , Yongcheng Jing , Mingli Song

Part-prototype models are explainable-by-design image classifiers, and a promising alternative to black box AI. This paper explores the applicability and potential of interpretable machine learning, in particular PIP-Net, for automated…

Computer Vision and Pattern Recognition · Computer Science 2023-09-12 Meike Nauta , Johannes H. Hegeman , Jeroen Geerdink , Jörg Schlötterer , Maurice van Keulen , Christin Seifert

Prototypical-part models are a popular interpretable alternative to black-box deep learning models for computer vision. However, they are difficult to train, with high sensitivity to hyperparameter tuning, inhibiting their application to…

Computer Vision and Pattern Recognition · Computer Science 2024-06-24 Frank Willard , Luke Moffett , Emmanuel Mokel , Jon Donnelly , Stark Guo , Julia Yang , Giyoung Kim , Alina Jade Barnett , Cynthia Rudin

Embedding is a common technique for analyzing multi-dimensional data. However, the embedding projection cannot always form significant and interpretable visual structures that foreshadow underlying data patterns. We propose an approach that…

Human-Computer Interaction · Computer Science 2022-09-26 Jie Li , Chun-qi Zhou

As AI systems grow more capable, it becomes increasingly important that their decisions remain understandable and aligned with human expectations. A key challenge is the limited interpretability of deep models. Post-hoc methods like GradCAM…

Computer Vision and Pattern Recognition · Computer Science 2025-11-21 Mahdi Alehdaghi , Rajarshi Bhattacharya , Pourya Shamsolmoali , Rafael M. O. Cruz , Maguelonne Heritier , Eric Granger

Interpretability is critical for machine learning models in high-stakes settings because it allows users to verify the model's reasoning. In computer vision, prototypical part models (ProtoPNets) have become the dominant model type to meet…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Jon Donnelly , Zhicheng Guo , Alina Jade Barnett , Hayden McTavish , Chaofan Chen , Cynthia Rudin

Continual learning constrains models to learn new tasks over time without forgetting what they have already learned. A key challenge in this setting is catastrophic forgetting, where learning new information causes the model to lose its…

Machine Learning · Computer Science 2025-12-10 Federico Di Valerio , Michela Proietti , Alessio Ragno , Roberto Capobianco

Transformers have been widely applied in text classification. Unfortunately, real-world data contain anomalies and noisy labels that cause challenges for state-of-art Transformers. This paper proposes Protoformer, a novel self-learning…

Computation and Language · Computer Science 2022-06-28 Ashkan Farhangi , Ning Sui , Nan Hua , Haiyan Bai , Arthur Huang , Zhishan Guo

We introduce ProtoSeg, a novel model for interpretable semantic image segmentation, which constructs its predictions using similar patches from the training set. To achieve accuracy comparable to baseline methods, we adapt the mechanism of…

Computer Vision and Pattern Recognition · Computer Science 2025-06-30 Mikołaj Sacha , Dawid Rymarczyk , Łukasz Struski , Jacek Tabor , Bartosz Zieliński

Image recognition with prototypes is considered an interpretable alternative for black box deep learning models. Classification depends on the extent to which a test image "looks like" a prototype. However, perceptual similarity for humans…

Computer Vision and Pattern Recognition · Computer Science 2022-08-18 Meike Nauta , Annemarie Jutte , Jesper Provoost , Christin Seifert

Prototypical parts-based models offer a "this looks like that" paradigm for intrinsic interpretability, yet they typically struggle with ImageNet-scale generalization and often require computationally expensive backbone finetuning.…

Computer Vision and Pattern Recognition · Computer Science 2026-02-09 Mikołaj Janusz , Adam Wróbel , Bartosz Zieliński , Dawid Rymarczyk

Convolutional Neural Networks (CNNs) do not have a predictable recognition behavior with respect to the input resolution change. This prevents the feasibility of deployment on different input image resolutions for a specific model. To…

Computer Vision and Pattern Recognition · Computer Science 2020-07-14 Duo Li , Anbang Yao , Qifeng Chen

The last decade has seen huge progress in the development of advanced machine learning models; however, those models are powerless unless human users can interpret them. Here we show how the mind's construction of concepts and meaning can…

Machine Learning · Statistics 2016-07-04 Nick Condry

Prototypical network for Few shot learning tries to learn an embedding function in the encoder that embeds images with similar features close to one another in the embedding space. However, in this process, the support set samples for a…

Computer Vision and Pattern Recognition · Computer Science 2022-11-23 Manas Gogoi , Sambhavi Tiwari , Shekhar Verma

Deep Learning shows very good performance when trained on large labeled data sets. The problem of training a deep net on a few or one sample per class requires a different learning approach which can generalize to unseen classes using only…

Machine Learning · Computer Science 2018-08-23 Jinchao Liu , Stuart J. Gibson , Margarita Osadchy