English
Related papers

Related papers: Hierarchical Vision Transformer with Prototypes fo…

200 papers

Despite the widespread adoption of transformers in medical applications, the exploration of multi-scale learning through transformers remains limited, while hierarchical representations are considered advantageous for computer-aided medical…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Xiaoya Tang , Bodong Zhang , Man Minh Ho , Beatrice S. Knudsen , Tolga Tasdizen

Interpretability is often an essential requirement in medical imaging. Advanced deep learning methods are required to address this need for explainability and high performance. In this work, we investigate whether additional information…

Computer Vision and Pattern Recognition · Computer Science 2026-02-25 Luisa Gallee , Meinrad Beer , Michael Goetz

Interpretability is crucial to enhance trust in machine learning models for medical diagnostics. However, most state-of-the-art image classifiers based on neural networks are not interpretable. As a result, clinicians often resort to known…

Developing robust and interpretable vision systems is a crucial step towards trustworthy artificial intelligence. In this regard, a promising paradigm considers embedding task-required invariant structures, e.g., geometric invariance, in…

Computer Vision and Pattern Recognition · Computer Science 2024-04-12 Shuren Qi , Yushu Zhang , Chao Wang , Zhihua Xia , Xiaochun Cao , Jian Weng

Human vision possesses a special type of visual processing systems called peripheral vision. Partitioning the entire visual field into multiple contour regions based on the distance to the center of our gaze, the peripheral vision provides…

Computer Vision and Pattern Recognition · Computer Science 2022-10-14 Juhong Min , Yucheng Zhao , Chong Luo , Minsu Cho

The emergence of vision transformers (ViTs) in image classification has shifted the methodologies for visual representation learning. In particular, ViTs learn visual representation at full receptive field per layer across all the image…

Computer Vision and Pattern Recognition · Computer Science 2024-08-05 Li Zhang , Jiachen Lu , Sixiao Zheng , Xinxuan Zhao , Xiatian Zhu , Yanwei Fu , Tao Xiang , Jianfeng Feng , Philip H. S. Torr

Survival prediction based on whole slide images (WSIs) is a challenging task for patient-level multiple instance learning (MIL). Due to the vast amount of data for a patient (one or multiple gigapixels WSIs) and the irregularly shaped…

Computer Vision and Pattern Recognition · Computer Science 2023-07-03 Zhuchen Shao , Yang Chen , Hao Bian , Jian Zhang , Guojun Liu , Yongbing Zhang

The task of multi-label image classification involves recognizing multiple objects within a single image. Considering both valuable semantic information contained in the labels and essential visual features presented in the image, tight…

Computer Vision and Pattern Recognition · Computer Science 2024-07-24 Shuyi Ouyang , Hongyi Wang , Ziwei Niu , Zhenjia Bai , Shiao Xie , Yingying Xu , Ruofeng Tong , Yen-Wei Chen , Lanfen Lin

Vision Transformer (ViT) has brought new breakthroughs to the field of image classification by introducing the self-attention mechanism and Graph Convolutional Networks(GCN) have been proposed and successfully applied in data representation…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Haibin Jiao

The proliferation of high-dimensional datasets in fields such as genomics, healthcare, and finance has created an urgent need for machine learning models that are both highly accurate and inherently interpretable. While traditional deep…

Machine Learning · Computer Science 2025-10-28 Rekha R Nair , Tina Babu , Alavikunhu Panthakkan , Hussain Al-Ahmad , Balamurugan Balusamy

Although Vision Transformers (ViTs) have recently demonstrated superior performance in medical imaging problems, they face explainability issues similar to previous architectures such as convolutional neural networks. Recent research…

Computer Vision and Pattern Recognition · Computer Science 2025-03-13 Minjae Chung , Jong Bum Won , Ganghyun Kim , Yujin Kim , Utku Ozbulak

Vision Transformers (ViTs) have ushered in a new era in computer vision, showcasing unparalleled performance in many challenging tasks. However, their practical deployment in computational pathology has largely been constrained by the sheer…

Computer Vision and Pattern Recognition · Computer Science 2023-12-21 Clément Grisi , Geert Litjens , Jeroen van der Laak

We design a family of image classification architectures that optimize the trade-off between accuracy and efficiency in a high-speed regime. Our work exploits recent findings in attention-based architectures, which are competitive on highly…

Computer Vision and Pattern Recognition · Computer Science 2021-05-07 Ben Graham , Alaaeldin El-Nouby , Hugo Touvron , Pierre Stock , Armand Joulin , Hervé Jégou , Matthijs Douze

The reconstruction of visual information from brain activity fosters interdisciplinary integration between neuroscience and computer vision. However, existing methods still face challenges in accurately recovering highly complex visual…

Computer Vision and Pattern Recognition · Computer Science 2026-02-05 Shiyi Zhang , Dong Liang , Hairong Zheng , Yihang Zhou

Although researchers' attention is more focused on the performance of Transformer models, the interpretation of Transformer can never be ignored. Gradient is widely utilized in Transformer interpretation. From the perspective of attention…

Artificial Intelligence · Computer Science 2026-05-13 Yongjin Cui , Xiaohui Fan , Huajun Chen

Interpretability is essential for deploying object detection systems in critical applications, especially under low-quality imaging conditions that degrade visual information and increase prediction uncertainty. Existing methods either…

Computer Vision and Pattern Recognition · Computer Science 2026-04-16 Jianlin Xiang , Linhui Dai , Xue Yang , Chaolei Yang , Yanshan Li

Explainable AI (XAI) methods focus on explaining what a neural network has learned - in other words, identifying the features that are the most influential to the prediction. In this paper, we call them "distinguishing features". However,…

Computer Vision and Pattern Recognition · Computer Science 2021-04-19 Kaili Wang , Jose Oramas , Tinne Tuytelaars

Recent state-of-the-art performances of Vision Transformers (ViT) in computer vision tasks demonstrate that a general-purpose architecture, which implements long-range self-attention, could replace the local feature learning operations of…

Chest X-ray is an essential diagnostic tool in the identification of chest diseases given its high sensitivity to pathological abnormalities in the lungs. However, image-driven diagnosis is still challenging due to heterogeneity in size and…

Image and Video Processing · Electrical Eng. & Systems 2023-10-11 Şaban Öztürk , M. Yiğit Turalı , Tolga Çukur

As AI technology is increasingly applied to high-impact, high-risk domains, there have been a number of new methods aimed at making AI models more human interpretable. Despite the recent growth of interpretability work, there is a lack of…

Computer Vision and Pattern Recognition · Computer Science 2022-07-22 Sunnie S. Y. Kim , Nicole Meister , Vikram V. Ramaswamy , Ruth Fong , Olga Russakovsky