中文
相关论文

相关论文: Evaluating Visual Explanations of Attention Maps f…

200 篇论文

Medical image segmentation plays a crucial role in various healthcare applications, enabling accurate diagnosis, treatment planning, and disease monitoring. Traditionally, convolutional neural networks (CNNs) dominated this domain,…

The attention mechanism is a core component of the Transformer architecture. Beyond improving performance, attention has been proposed as a mechanism for explainability via attention weights, which are associated with input features (e.g.,…

Importance estimators are explainability methods that quantify feature importance for deep neural networks (DNN). In vision transformers (ViT), the self-attention mechanism naturally leads to attention maps, which are sometimes interpreted…

计算机视觉与模式识别 · 计算机科学 2024-10-28 Lennart Brocki , Jakub Binda , Neo Christopher Chung

Intrigued by the inherent ability of the human visual system to identify salient regions in complex scenes, attention mechanisms have been seamlessly integrated into various Computer Vision (CV) tasks. Building upon this paradigm, Vision…

Vision transformer (ViT) expands the success of transformer models from sequential data to images. The model decomposes an image into many smaller patches and arranges them into a sequence. Multi-head self-attentions are then applied to the…

机器学习 · 计算机科学 2023-03-27 Yiran Li , Junpeng Wang , Xin Dai , Liang Wang , Chin-Chia Michael Yeh , Yan Zheng , Wei Zhang , Kwan-Liu Ma

Radiographs are a versatile diagnostic tool for the detection and assessment of pathologies, for treatment planning or for navigation and localization purposes in clinical interventions. However, their interpretation and assessment by…

计算机视觉与模式识别 · 计算机科学 2022-08-18 Finn Behrendt , Debayan Bhattacharya , Julia Krüger , Roland Opfer , Alexander Schlaefer

Vision Transformers (ViTs) have achieved state-of-the-art results on various computer vision tasks, including 3D object detection. However, their end-to-end implementation also makes ViTs less explainable, which can be a challenge for…

计算机视觉与模式识别 · 计算机科学 2023-12-25 Till Beemelmanns , Wassim Zahr , Lutz Eckstein

Vision transformers (ViTs) have rapidly gained prominence in medical imaging tasks such as disease classification, segmentation, and detection due to their superior accuracy compared to conventional deep learning models. However, due to…

计算机视觉与模式识别 · 计算机科学 2025-07-11 Montasir Shams , Chashi Mahiul Islam , Shaeke Salman , Phat Tran , Xiuwen Liu

Vision Transformers, ViTs, have emerged as a powerful alternative to convolutional neural networks, CNNs, in a variety of image-based tasks. While CNNs have previously been evaluated for their ability to perform graphical perception tasks,…

计算机视觉与模式识别 · 计算机科学 2026-02-23 Poonam Poonam , Pere-Pau Vázquez , Timo Ropinski

As the number of fine tuning of pretrained models increased, understanding the bias of pretrained model is essential. However, there is little tool to analyse transformer architecture and the interpretation of the attention maps is still…

计算机视觉与模式识别 · 计算机科学 2022-11-29 Bumjin Park , Jaesik Choi

Vision Transformers (ViTs) have become prominent models for solving various vision tasks. However, the interpretability of ViTs has not kept pace with their promising performance. While there has been a surge of interest in developing {\it…

计算机视觉与模式识别 · 计算机科学 2025-05-02 Yao Qiang , Chengyin Li , Prashant Khanduri , Dongxiao Zhu

Recent escalation in the field of computer vision underpins a huddle of algorithms with the magnificent potential to unravel the information contained within images. These computer vision algorithms are being practised in medical image…

图像与视频处理 · 电气工程与系统科学 2022-03-30 Arshi Parvaiz , Muhammad Anwaar Khalid , Rukhsana Zafar , Huma Ameer , Muhammad Ali , Muhammad Moazam Fraz

Explainable AI (XAI) has become increasingly important with the rise of large transformer models, yet many explanation methods designed for CNNs transfer poorly to Vision Transformers (ViTs). Existing ViT explanations often rely on…

计算机视觉与模式识别 · 计算机科学 2025-10-08 Meghna P Ayyar , Jenny Benois-Pineau , Akka Zemmari

Recent advancements in medical image analysis have predominantly relied on Convolutional Neural Networks (CNNs), achieving impressive performance in chest X-ray classification tasks, such as the 92% AUC reported by AutoThorax-Net and the…

图像与视频处理 · 电气工程与系统科学 2024-11-19 Baljinnyam Dayan

Medical images exhibit latent anatomical groupings, such as organs, tissues, and pathological regions, that standard Vision Transformers (ViTs) fail to exploit. While recent work like SBM-Transformer attempts to incorporate such structures…

计算机视觉与模式识别 · 计算机科学 2025-11-18 Huimin Cheng , Xiaowei Yu , Shushan Wu , Luyang Fang , Chao Cao , Jing Zhang , Tianming Liu , Dajiang Zhu , Wenxuan Zhong , Ping Ma

We present a novel method that extends the self-attention mechanism of a vision transformer (ViT) for more accurate object detection across diverse datasets. ViTs show strong capability for image understanding tasks such as object…

计算机视觉与模式识别 · 计算机科学 2024-12-30 Tan Nguyen , Coy D. Heldermon , Corey Toler-Franklin

Vision Transformers (ViTs) have shown strong empirical performance on high-dimensional medical imaging data, yet their behavior under survival objectives and the interpretability of their attention mechanisms remain poorly understood. Under…

医学物理 · 物理学 2026-04-24 Qiyuan Shi , Yi Li

Vision Transformers (ViTs) are becoming more popular and dominating technique for various vision tasks, compare to Convolutional Neural Networks (CNNs). As a demanding technique in computer vision, ViTs have been successfully solved various…

计算机视觉与模式识别 · 计算机科学 2023-10-18 Khawar Islam

Medical ultrasound (US) imaging has become a prominent modality for breast cancer imaging due to its ease-of-use, low-cost and safety. In the past decade, convolutional neural networks (CNNs) have emerged as the method of choice in vision…

计算机视觉与模式识别 · 计算机科学 2025-02-13 Behnaz Gheflati , Hassan Rivaz

Vision Transformers (ViTs) have demonstrated exceptional performance in various vision tasks. However, they tend to underperform on smaller datasets due to their inherent lack of inductive biases. Current approaches address this limitation…

计算机视觉与模式识别 · 计算机科学 2026-02-20 Alan Luo , Kaiwen Yuan