English
Related papers

Related papers: A Recent Survey of Vision Transformers for Medical…

200 papers

Transformers are very powerful tools for a variety of tasks across domains, from text generation to image captioning. However, transformers require substantial amounts of training data, which is often a challenge in biomedical settings,…

Computer Vision and Pattern Recognition · Computer Science 2023-07-04 Andrew Kean Gao

The Vision Transformer (ViT) leverages the Transformer's encoder to capture global information by dividing images into patches and achieves superior performance across various computer vision tasks. However, the self-attention mechanism of…

Computer Vision and Pattern Recognition · Computer Science 2025-01-17 Tianxiao Zhang , Wenju Xu , Bo Luo , Guanghui Wang

The CNN-based methods have achieved impressive results in medical image segmentation, but they failed to capture the long-range dependencies due to the inherent locality of the convolution operation. Transformer-based methods are recently…

Computer Vision and Pattern Recognition · Computer Science 2021-12-21 Xiaohong Huang , Zhifang Deng , Dandan Li , Xueguang Yuan

Vision transformers (ViTs) are quickly becoming the de-facto architecture for computer vision, yet we understand very little about why they work and what they learn. While existing studies visually analyze the mechanisms of convolutional…

Computer Vision and Pattern Recognition · Computer Science 2022-12-14 Amin Ghiasi , Hamid Kazemi , Eitan Borgnia , Steven Reich , Manli Shu , Micah Goldblum , Andrew Gordon Wilson , Tom Goldstein

Medical imaging is essential in healthcare to provide key insights into patient anatomy and pathology, aiding in diagnosis and treatment. Non-invasive techniques such as X-ray, Magnetic Resonance Imaging (MRI), Computed Tomography (CT), and…

Image and Video Processing · Electrical Eng. & Systems 2024-12-04 Fnu Neha , Deepshikha Bhati , Deepak Kumar Shukla , Sonavi Makarand Dalvi , Nikolaos Mantzou , Safa Shubbar

Medical image segmentation is pivotal in healthcare, enhancing diagnostic accuracy, informing treatment strategies, and tracking disease progression. This process allows clinicians to extract critical information from visual data, enabling…

Image and Video Processing · Electrical Eng. & Systems 2024-10-31 Ovais Iqbal Shah , Danish Raza Rizvi , Aqib Nazir Mir

Deep learning technology can be used as an assistive technology to help doctors quickly and accurately identify COVID-19 infections. Recently, Vision Transformer (ViT) has shown great potential towards image classification due to its global…

Image and Video Processing · Electrical Eng. & Systems 2022-07-06 Hongyan Xu , Xiu Su , Dadong Wang

Medical image segmentation has advanced rapidly over the past two decades, largely driven by deep learning, which has enabled accurate and efficient delineation of cells, tissues, organs, and pathologies across diverse imaging modalities.…

Image and Video Processing · Electrical Eng. & Systems 2025-08-29 Guoping Xu , Jayaram K. Udupa , Jax Luo , Songlin Zhao , Yajun Yu , Scott B. Raymond , Hao Peng , Lipeng Ning , Yogesh Rathi , Wei Liu , You Zhang

Convolutional Neural Networks (CNNs) have been recently employed to solve problems from both the computer vision and medical image analysis fields. Despite their popularity, most approaches are only able to process 2D images while most…

Computer Vision and Pattern Recognition · Computer Science 2016-06-16 Fausto Milletari , Nassir Navab , Seyed-Ahmad Ahmadi

Neuroimaging of large populations is valuable to identify factors that promote or resist brain disease, and to assist diagnosis, subtyping, and prognosis. Data-driven models such as convolutional neural networks (CNNs) have increasingly…

Image and Video Processing · Electrical Eng. & Systems 2023-03-16 Nikhil J. Dhinagar , Sophia I. Thomopoulos , Emily Laltoo , Paul M. Thompson

Deep neural networks have been widely used in medical image analysis and medical image segmentation is one of the most important tasks. U-shaped neural networks with encoder-decoder are prevailing and have succeeded greatly in various…

Image and Video Processing · Electrical Eng. & Systems 2023-06-09 Juntao Jiang , Xiyu Chen , Guanzhong Tian , Yong Liu

Casting semantic segmentation of outdoor LiDAR point clouds as a 2D problem, e.g., via range projection, is an effective and popular approach. These projection-based methods usually benefit from fast computations and, when combined with…

Computer Vision and Pattern Recognition · Computer Science 2023-04-26 Angelika Ando , Spyros Gidaris , Andrei Bursuc , Gilles Puy , Alexandre Boulch , Renaud Marlet

This paper presents a comparison of the performance of Convolutional Neural Networks (CNNs) and Vision Transformers (ViTs) in the task of multi-classifying images containing lesions of psoriasis and diseases similar to it. Models…

Computer Vision and Pattern Recognition · Computer Science 2025-06-13 Natanael Lucena , Fábio S. da Silva , Ricardo Rios

Convolutional neural networks (CNNs) have been the de facto standard for nowadays 3D medical image segmentation. The convolutional operations used in these networks, however, inevitably have limitations in modeling the long-range dependency…

Computer Vision and Pattern Recognition · Computer Science 2021-03-05 Yutong Xie , Jianpeng Zhang , Chunhua Shen , Yong Xia

Vision Transformer (ViT) extends the application range of transformers from language processing to computer vision tasks as being an alternative architecture against the existing convolutional neural networks (CNN). Since the…

Computer Vision and Pattern Recognition · Computer Science 2021-08-19 Byeongho Heo , Sangdoo Yun , Dongyoon Han , Sanghyuk Chun , Junsuk Choe , Seong Joon Oh

The application of 3D ViTs to medical image segmentation has seen remarkable strides, somewhat overshadowing the budding advancements in Convolutional Neural Network (CNN)-based models. Large kernel depthwise convolution has emerged as a…

Computer Vision and Pattern Recognition · Computer Science 2023-10-05 Ho Hin Lee , Quan Liu , Qi Yang , Xin Yu , Shunxing Bao , Yuankai Huo , Bennett A. Landman

Vision Transformers (ViTs) have recently garnered considerable attention, emerging as a promising alternative to convolutional neural networks (CNNs) in several vision-related applications. However, their large model sizes and high…

Machine Learning · Computer Science 2024-05-02 Dayou Du , Gu Gong , Xiaowen Chu

Following unprecedented success on the natural language tasks, Transformers have been successfully applied to several computer vision problems, achieving state-of-the-art results and prompting researchers to reconsider the supremacy of…

Image and Video Processing · Electrical Eng. & Systems 2022-01-25 Fahad Shamshad , Salman Khan , Syed Waqas Zamir , Muhammad Haris Khan , Munawar Hayat , Fahad Shahbaz Khan , Huazhu Fu

Land Use Scene Classification (LUSC) from remote sensing imagery plays a critical role in environmental monitoring, urban planning, and sustainable resource management. In recent years, deep learning methods have significantly advanced the…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Arun D. Kulkarni

Accurate segmentation of organs or lesions from medical images is crucial for reliable diagnosis of diseases and organ morphometry. In recent years, convolutional encoder-decoder solutions have achieved substantial progress in the field of…

Image and Video Processing · Electrical Eng. & Systems 2022-07-12 Bingzhi Chen , Yishu Liu , Zheng Zhang , Guangming Lu , Adams Wai Kin Kong