English
Related papers

Related papers: Explainable Transformer Prototypes for Medical Dia…

200 papers

Transformers have recently shown promise for medical image applications, leading to an increasing interest in developing such models for medical image registration. Recent advancements in designing registration Transformers have focused on…

Image and Video Processing · Electrical Eng. & Systems 2023-03-14 Junyu Chen , Yihao Liu , Yufan He , Yong Du

While the Self-Attention mechanism in the Transformer model has proven to be effective in many domains, we observe that it is less effective in more diverse settings (e.g. multimodality) due to the varying granularity of each token and the…

Computer Vision and Pattern Recognition · Computer Science 2024-06-06 Wayner Barrios , SouYoung Jin

Medical image segmentation remains particularly challenging for complex and low-contrast anatomical structures. In this paper, we introduce the U-Transformer network, which combines a U-shaped architecture for image segmentation with self-…

Image and Video Processing · Electrical Eng. & Systems 2021-03-15 Olivier Petit , Nicolas Thome , Clément Rambour , Luc Soler

Artificial Intelligence has emerged as a useful aid in numerous clinical applications for diagnosis and treatment decisions. Deep neural networks have shown same or better performance than clinicians in many tasks owing to the rapid…

Image and Video Processing · Electrical Eng. & Systems 2021-11-05 Zohaib Salahuddin , Henry C Woodruff , Avishek Chatterjee , Philippe Lambin

Deep learning shows promise for medical image analysis but lacks interpretability, hindering adoption in healthcare. Attribution techniques that explain model reasoning may increase trust in deep learning among clinical stakeholders. This…

Machine Learning · Computer Science 2023-08-08 Yusuf Brima , Marcellin Atemkeng

Deep learning has driven significant advances in medical image analysis, yet its adoption in clinical practice remains constrained by the large size and lack of transparency in modern models. Advances in interpretability techniques such as…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Nikita Malik , Pratinav Seth , Neeraj Kumar Singh , Chintan Chitroda , Vinay Kumar Sankarapu

Fast MRI aims to reconstruct a high fidelity image from partially observed measurements. Exuberant development in fast MRI using deep learning has been witnessed recently. Meanwhile, novel deep learning paradigms, e.g., Transformer based…

Computer Vision and Pattern Recognition · Computer Science 2022-07-07 Jiahao Huang , Xiaodan Xing , Zhifan Gao , Guang Yang

Recent research has supported that system explainability improves user trust and willingness to use medical AI for diagnostic support. In this paper, we use chest disease diagnosis based on X-Ray images as a case study to investigate user…

Human-Computer Interaction · Computer Science 2022-04-27 Yao Rong , Nora Castner , Efe Bozkir , Enkelejda Kasneci

Artificial intelligence (AI) has huge potential to improve the health and well-being of people, but adoption in clinical practice is still limited. Lack of transparency is identified as one of the main barriers to implementation, as…

Artificial Intelligence · Computer Science 2021-01-06 Aniek F. Markus , Jan A. Kors , Peter R. Rijnbeek

Histopathology remains the gold standard for cancer diagnosis because it provides detailed cellular-level assessment of tissue morphology. However, manual histopathological examination is time-consuming, labour-intensive, and subject to…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 Ravi Mosalpuri , Mohammed Abdelsamea , Ahmed Karam Eldaly

In medical image diagnosis, identifying the attention region, i.e., the region of interest for which the diagnosis is made, is an important task. Various methods have been developed to automatically identify target regions from given…

Image and Video Processing · Electrical Eng. & Systems 2023-01-30 Yusuke Takagi , Noriaki Hashimoto , Hiroki Masuda , Hiroaki Miyoshi , Koichi Ohshima , Hidekata Hontani , Ichiro Takeuchi

The Transformer is a sequence model that forgoes traditional recurrent architectures in favor of a fully attention-based approach. Besides improving performance, an advantage of using attention is that it can also help to interpret a model…

Human-Computer Interaction · Computer Science 2019-06-14 Jesse Vig

Deep learning has become a powerful tool for medical image analysis; however, conventional Convolutional Neural Networks (CNNs) often fail to capture the fine-grained and complex features critical for accurate diagnosis. To address this…

Computer Vision and Pattern Recognition · Computer Science 2025-09-09 Zahid Ullah , Minki Hong , Tahir Mahmood , Jihie Kim

Transformers have achieved remarkable success in medical image analysis owing to their powerful capability to use flexible self-attention mechanism. However, due to lacking intrinsic inductive bias in modeling visual structural information,…

Image and Video Processing · Electrical Eng. & Systems 2022-11-18 Yiyue Hu , Lei Zhang , Nan Mu , Lei Liu

Artificial Intelligence in Medicine has made significant progress with emerging applications in medical imaging, patient care, and other areas. While these applications have proven successful in retrospective studies, very few of them were…

Artificial Intelligence · Computer Science 2023-08-11 Nicoletta Prentzas , Antonis Kakas , Constantinos S. Pattichis

Objective skill assessment in high-stakes procedural environments requires models that not only decode underlying cognitive and motor processes but also generalize across tasks, individuals, and experimental contexts. While prior work has…

Signal Processing · Electrical Eng. & Systems 2025-07-01 A. Subedi , S. De , L. Cavuoto , S. Schwaitzberg , M. Hackett , J. Norfleet

Transformer-based models have emerged as a leading architecture for natural language processing, natural language generation, and image generation tasks. A fundamental element of the transformer architecture is self-attention, which allows…

Machine Learning · Computer Science 2025-07-01 Venmugil Elango

The current trend of automating inspections at substations has sparked a surge in interest in the field of transformer image recognition. However, due to restrictions in the number of parameters in existing models, high-resolution images…

Computer Vision and Pattern Recognition · Computer Science 2023-12-08 Siyi Zhang , Cheng Liu , Xiang Li , Xin Zhai , Zhen Wei , Sizhe Li , Xun Ma

The integration of artificial intelligence (AI) into medicine is remarkable, offering advanced diagnostic and therapeutic possibilities. However, the inherent opacity of complex AI models presents significant challenges to their clinical…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Binbin Wen , Yihang Wu , Tareef Daqqaq , Ahmad Chaddad

To ensure safe clinical integration, deep learning models must provide more than just high accuracy; they require dependable uncertainty quantification. While current Medical Vision Transformers perform well, they frequently struggle with…

Image and Video Processing · Electrical Eng. & Systems 2026-04-13 Mohammed Maaz Sibhai , Abedalrhman Alkhateeb , Saad B. Ahmed