English
Related papers

Related papers: ProtoSeg: Interpretable Semantic Segmentation with…

200 papers

Sketch semantic segmentation is a well-explored and pivotal problem in computer vision involving the assignment of pre-defined part labels to individual strokes. This paper presents ContextSeg - a simple yet highly effective approach to…

Computer Vision and Pattern Recognition · Computer Science 2024-03-27 Jiawei Wang , Changjian Li

In previous deep-learning-based methods, semantic segmentation has been regarded as a static or dynamic per-pixel classification task, \textit{i.e.,} classify each pixel representation to a specific category. However, these methods only…

Computer Vision and Pattern Recognition · Computer Science 2023-04-03 Fangjian Lin , Zhanhao Liang , Sitong Wu , Junjun He , Kai Chen , Shengwei Tian

Understanding the decision-making process of machine learning models provides valuable insights into the task, the data, and the reasons behind a model's failures. In this work, we propose a method that performs inherently interpretable…

Computer Vision and Pattern Recognition · Computer Science 2025-05-19 Moritz Vandenhirtz , Julia E. Vogt

Semantic segmentation plays a crucial role in enabling machines to understand and interpret visual scenes at a pixel level. While traditional segmentation methods have achieved remarkable success, their generalization to diverse scenes and…

Computer Vision and Pattern Recognition · Computer Science 2025-01-29 Philip Hughes , Larry Burns , Luke Adams

In the semantic segmentation of remote sensing images, acquiring complete ground objects is critical for achieving precise analysis. However, this task is severely hindered by two major challenges: high intra-class variance and high…

Computer Vision and Pattern Recognition · Computer Science 2025-08-07 Junyi Wang , Jinjiang Li , Guodong Fan , Yakun Ju , Xiang Fang , Alex C. Kot

We propose a novel perspective to understand deep neural networks in an interpretable disentanglement form. For each semantic class, we extract a class-specific functional subnetwork from the original full model, with compressed structure…

Machine Learning · Computer Science 2019-10-08 Yulong Wang , Xiaolin Hu , Hang Su

Semantic segmentation is fundamental to vision systems requiring pixel-level scene understanding, yet deploying it on resource-constrained devices demands efficient architectures. Although existing methods achieve real-time inference…

Computer Vision and Pattern Recognition · Computer Science 2025-08-13 Shi-Chen Zhang , Yunheng Li , Yu-Huan Wu , Qibin Hou , Ming-Ming Cheng

Prototypical part network (ProtoPNet) has drawn wide attention and boosted many follow-up studies due to its self-explanatory property for explainable artificial intelligence (XAI). However, when directly applying ProtoPNet on vision…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Mengqi Xue , Qihan Huang , Haofei Zhang , Jingwen Hu , Jie Song , Mingli Song , Canghong Jin

Interpretability is a key requirement for the use of machine learning models in high-stakes applications, including medical diagnosis. Explaining black-box models mostly relies on post-hoc methods that do not faithfully reflect the model's…

Artificial Intelligence · Computer Science 2024-06-25 Kerol Djoumessi , Bubacarr Bah , Laura Kühlewein , Philipp Berens , Lisa Koch

Prototypical part networks offer interpretable alternatives to black-box deep learning models by learning visual prototypes for classification. This work provides a comprehensive analysis of prototype formulations, comparing point-based and…

Machine Learning · Computer Science 2026-01-08 Maximilian Xiling Li , Korbinian Franz Rudolf , Paul Mattes , Nils Blank , Rudolf Lioutikov

Interpretability is often an essential requirement in medical imaging. Advanced deep learning methods are required to address this need for explainability and high performance. In this work, we investigate whether additional information…

Computer Vision and Pattern Recognition · Computer Science 2026-02-25 Luisa Gallee , Meinrad Beer , Michael Goetz

While deep learning has achieved impressive performance in time series forecasting, it becomes increasingly crucial to understand its decision-making process for building trust in high-stakes scenarios. Existing interpretable models often…

Machine Learning · Computer Science 2026-03-02 Ziheng Peng , Shijie Ren , Xinyue Gu , Linxiao Yang , Xiting Wang , Liang Sun

Due to the high inter-class similarity caused by the complex composition and the co-existing objects across scenes, numerous studies have explored object semantic knowledge within scenes to improve scene recognition. However, a resulting…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Chuanxin Song , Hanbo Wu , Xin Ma , Yibin Li

Image recognition with prototypes is considered an interpretable alternative for black box deep learning models. Classification depends on the extent to which a test image "looks like" a prototype. However, perceptual similarity for humans…

Computer Vision and Pattern Recognition · Computer Science 2022-08-18 Meike Nauta , Annemarie Jutte , Jesper Provoost , Christin Seifert

Existing semantic segmentation approaches either aim to improve the object's inner consistency by modeling the global context, or refine objects detail along their boundaries by multi-scale feature fusion. In this paper, a new paradigm for…

Computer Vision and Pattern Recognition · Computer Science 2020-08-19 Xiangtai Li , Xia Li , Li Zhang , Guangliang Cheng , Jianping Shi , Zhouchen Lin , Shaohua Tan , Yunhai Tong

Interpretability is critical for machine learning models in high-stakes settings because it allows users to verify the model's reasoning. In computer vision, prototypical part models (ProtoPNets) have become the dominant model type to meet…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Jon Donnelly , Zhicheng Guo , Alina Jade Barnett , Hayden McTavish , Chaofan Chen , Cynthia Rudin

Vertebral fracture grading classifies the severity of vertebral fractures, which is a challenging task in medical imaging and has recently attracted Deep Learning (DL) models. Only a few works attempted to make such models…

We present FasterSeg, an automatically designed semantic segmentation network with not only state-of-the-art performance but also faster speed than current methods. Utilizing neural architecture search (NAS), FasterSeg is discovered from a…

Computer Vision and Pattern Recognition · Computer Science 2020-01-20 Wuyang Chen , Xinyu Gong , Xianming Liu , Qian Zhang , Yuan Li , Zhangyang Wang

Interpretation and visualization of the behavior of detection transformers tends to highlight the locations in the image that the model attends to, but it provides limited insight into the \emph{semantics} that the model is focusing on.…

Computer Vision and Pattern Recognition · Computer Science 2025-12-08 Pavlos Rath-Manakidis , Frederik Strothmann , Tobias Glasmachers , Laurenz Wiskott

Time series data is one of the most popular data modalities in critical domains such as industry and medicine. The demand for algorithms that not only exhibit high accuracy but also offer interpretability is crucial in such fields, as…

Machine Learning · Computer Science 2025-11-05 Bartłomiej Małkus , Szymon Bobek , Grzegorz J. Nalepa