English
Related papers

Related papers: A Data-scalable Transformer for Medical Image Segm…

200 papers

Segmenting biomarkers in medical images is crucial for various biotech applications. Despite advances, Transformer and CNN based methods often struggle with variations in staining and morphology, limiting feature extraction. In medical…

Image and Video Processing · Electrical Eng. & Systems 2025-06-25 Saad Wazir , Daeyoung Kim

The success of Transformer in computer vision has attracted increasing attention in the medical imaging community. Especially for medical image segmentation, many excellent hybrid architectures based on convolutional neural networks (CNNs)…

Image and Video Processing · Electrical Eng. & Systems 2022-07-26 Wentao Liu , Tong Tian , Weijin Xu , Huihua Yang , Xipeng Pan , Songlin Yan , Lemeng Wang

Direct automatic segmentation of objects from 3D medical imaging, such as magnetic resonance (MR) imaging, is challenging as it often involves accurately identifying a number of individual objects with complex geometries within a large…

Image and Video Processing · Electrical Eng. & Systems 2021-09-23 Wei Dai , Boyeong Woo , Siyu Liu , Matthew Marques , Craig B. Engstrom , Peter B. Greer , Stuart Crozier , Jason A. Dowling , Shekhar S. Chandra

Vision transformers have recently set off a new wave in the field of medical image analysis due to their remarkable performance on various computer vision tasks. However, recent hybrid-/transformer-based approaches mainly focus on the…

Computer Vision and Pattern Recognition · Computer Science 2022-07-13 Xian Lin , Li Yu , Kwang-Ting Cheng , Zengqiang Yan

It is well believed that Transformer performs better in semantic segmentation compared to convolutional neural networks. Nevertheless, the original Vision Transformer may lack of inductive biases of local neighborhoods and possess a high…

Computer Vision and Pattern Recognition · Computer Science 2022-08-04 Wentao Shi , Jing Xu , Pan Gao

There has been exploding interest in embracing Transformer-based architectures for medical image segmentation. However, the lack of large-scale annotated medical datasets make achieving performances equivalent to those in natural images…

Image and Video Processing · Electrical Eng. & Systems 2024-06-04 Saikat Roy , Gregor Koehler , Constantin Ulrich , Michael Baumgartner , Jens Petersen , Fabian Isensee , Paul F. Jaeger , Klaus Maier-Hein

We present a transformer-based multimodal framework for generating clinically relevant captions for MRI scans. Our system combines a DEiT-Small vision transformer as an image encoder, MediCareBERT for caption embedding, and a custom…

Image and Video Processing · Electrical Eng. & Systems 2025-11-03 Yogesh Thakku Suresh , Vishwajeet Shivaji Hogale , Luca-Alexandru Zamfira , Anandavardhana Hegde

Promptable segmentation foundation models have emerged as a transformative approach to addressing the diverse needs in medical images, but most existing models require expensive computing, posing a big barrier to their adoption in clinical…

Semantic segmentation of remotely sensed urban scene images is required in a wide range of practical applications, such as land cover mapping, urban change detection, environmental protection, and economic assessment.Driven by rapid…

Computer Vision and Pattern Recognition · Computer Science 2022-06-28 Libo Wang , Rui Li , Ce Zhang , Shenghui Fang , Chenxi Duan , Xiaoliang Meng , Peter M. Atkinson

Vision transformer based models bring significant improvements for image segmentation tasks. Although these architectures offer powerful capabilities irrespective of specific segmentation tasks, their use of computational resources can be…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Manyi Yao , Abhishek Aich , Yumin Suh , Amit Roy-Chowdhury , Christian Shelton , Manmohan Chandraker

We propose a Transformer architecture for volumetric segmentation, a challenging task that requires keeping a complex balance in encoding local and global spatial cues, and preserving information along all axes of the volume. Encoder of the…

Image and Video Processing · Electrical Eng. & Systems 2022-07-04 Himashi Peiris , Munawar Hayat , Zhaolin Chen , Gary Egan , Mehrtash Harandi

Inspired by the recent success of Transformers for Natural Language Processing and vision Transformer for Computer Vision, many researchers in the medical imaging community have flocked to Transformer-based networks for various main stream…

Image and Video Processing · Electrical Eng. & Systems 2022-12-22 Ye Li , Junyu Chen , Se-in Jang , Kuang Gong , Quanzheng Li

Referring image segmentation aims to segment an object referred to by natural language expression from an image. The primary challenge lies in the efficient propagation of fine-grained semantic information from textual features to visual…

Computer Vision and Pattern Recognition · Computer Science 2024-04-15 Yichen Yan , Xingjian He , Sihan Chen , Jing Liu

Medical image segmentation is crucial for computer-aided diagnosis, yet privacy constraints hinder data sharing across institutions. Federated learning addresses this limitation, but existing approaches often rely on lightweight…

Computer Vision and Pattern Recognition · Computer Science 2025-09-22 Tong Wang , Xingyue Zhao , Linghao Zhuang , Haoyu Zhao , Jiayi Yin , Yuyang He , Gang Yu , Bo Lin

Surgical scene segmentation is a fundamental task for robotic-assisted laparoscopic surgery understanding. It often contains various anatomical structures and surgical instruments, where similar local textures and fine-grained structures…

Computer Vision and Pattern Recognition · Computer Science 2024-10-24 Cheng Yuan , Yutong Ban

Semantic segmentation involves assigning a specific category to each pixel in an image. While Vision Transformer-based models have made significant progress, current semantic segmentation methods often struggle with precise predictions in…

Computer Vision and Pattern Recognition · Computer Science 2024-08-13 Guoan Xu , Wenfeng Huang , Tao Wu , Ligeng Chen , Wenjing Jia , Guangwei Gao , Xiatian Zhu , Stuart Perry

Recent advancements in large-scale Vision Transformers have made significant strides in improving pre-trained models for medical image segmentation. However, these methods face a notable challenge in acquiring a substantial amount of…

Computer Vision and Pattern Recognition · Computer Science 2023-07-25 Yiqing Wang , Zihan Li , Jieru Mei , Zihao Wei , Li Liu , Chen Wang , Shengtian Sang , Alan Yuille , Cihang Xie , Yuyin Zhou

Multi-organ segmentation of 3D medical images is fundamental with meaningful applications in various clinical automation pipelines. Although deep learning has achieved superior performance, the time and memory consumption of segmenting the…

Computer Vision and Pattern Recognition · Computer Science 2025-11-12 Xueqi Guo , Halid Ziya Yerebakan , Yoshihisa Shinagawa , Kritika Iyer , Gerardo Hermosillo Valadez

Accurate segmentation of organs and tumors in CT and MRI scans is essential for diagnosis, treatment planning, and disease monitoring. While deep learning has advanced automated segmentation, most models remain task-specific, lacking…

Computer Vision and Pattern Recognition · Computer Science 2025-10-16 Yuheng Li , Yizhou Wu , Yuxiang Lai , Mingzhe Hu , Xiaofeng Yang

The accurate segmentation of medical images is crucial for diagnosing and treating diseases. Recent studies demonstrate that vision transformer-based methods have significantly improved performance in medical image segmentation, primarily…

Computer Vision and Pattern Recognition · Computer Science 2024-05-22 Wentao Wang , Xi Xiao , Mingjie Liu , Qing Tian , Xuanyao Huang , Qizhen Lan , Swalpa Kumar Roy , Tianyang Wang