English
Related papers

Related papers: SegFormer3D: an Efficient Transformer for 3D Medic…

200 papers

Convolutional neural network (CNN) based methods have achieved great successes in medical image segmentation, but their capability to learn global representations is still limited due to using small effective receptive fields of convolution…

Computer Vision and Pattern Recognition · Computer Science 2022-11-17 Pengfei Gu , Yejia Zhang , Chaoli Wang , Danny Z. Chen

In clinical practice, medical image analysis often requires efficient execution on resource-constrained mobile devices. However, existing mobile models-primarily optimized for natural images-tend to perform poorly on medical tasks due to…

Image and Video Processing · Electrical Eng. & Systems 2025-08-05 Fenghe Tang , Bingkun Nian , Jianrui Ding , Wenxin Ma , Quan Quan , Chengqi Dong , Jie Yang , Wei Liu , S. Kevin Zhou

This paper presents a novel framework for processing volumetric medical information using Visual Transformers (ViTs). First, We extend the state-of-the-art Swin Transformer model to the 3D medical domain. Second, we propose a new approach…

Image and Video Processing · Electrical Eng. & Systems 2024-06-06 Cristhian Forigua , Maria Escobar , Pablo Arbelaez

While convolutional neural networks (CNNs) and vision transformers (ViTs) have advanced medical image segmentation, they face inherent limitations such as local receptive fields in CNNs and high computational complexity in ViTs. This paper…

Image and Video Processing · Electrical Eng. & Systems 2025-04-02 Pooya Ashtari , Shahryar Noei , Fateme Nateghi Haredasht , Jonathan H. Chen , Giuseppe Jurman , Aleksandra Pizurica , Sabine Van Huffel

Semantic segmentation assigns labels to pixels in images, a critical yet challenging task in computer vision. Convolutional methods, although capturing local dependencies well, struggle with long-range relationships. Vision Transformers…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Mian Muhammad Naeem Abid , Nancy Mehta , Zongwei Wu , Radu Timofte

Deep learning has been widely applied to 3D medical image segmentation tasks. However, due to the diversity of imaging modalities, the high-dimensional nature of the data, and the heterogeneity of anatomical structures, achieving both…

Computer Vision and Pattern Recognition · Computer Science 2026-04-09 Chung-Ming Lo , I-Yun Liu , Wei-Yang Lin

The accurate analysis of medical images is vital for diagnosing and predicting medical conditions. Traditional approaches relying on radiologists and clinicians suffer from inconsistencies and missed diagnoses. Computer-aided diagnosis…

Computer Vision and Pattern Recognition · Computer Science 2024-03-21 Yulong Shisu , Susano Mingwin , Yongshuai Wanwag , Zengqiang Chenso , Sunshin Huing

Convolutional neural networks (CNNs) have been the de facto standard in a diverse set of computer vision tasks for many years. Especially, deep neural networks based on seminal architectures such as U-shaped models with skip-connections or…

Image and Video Processing · Electrical Eng. & Systems 2022-08-02 Reza Azad , Moein Heidari , Moein Shariatnia , Ehsan Khodapanah Aghdam , Sanaz Karimijafarbigloo , Ehsan Adeli , Dorit Merhof

The emergence of vision transformers (ViTs) in image classification has shifted the methodologies for visual representation learning. In particular, ViTs learn visual representation at full receptive field per layer across all the image…

Computer Vision and Pattern Recognition · Computer Science 2024-08-05 Li Zhang , Jiachen Lu , Sixiao Zheng , Xinxuan Zhao , Xiatian Zhu , Yanwei Fu , Tao Xiang , Jianfeng Feng , Philip H. S. Torr

Large Language Models (LLMs), known for their versatility in textual data, are increasingly being explored for their potential to enhance medical image segmentation, a crucial task for accurate diagnostic imaging. This study explores…

Image and Video Processing · Electrical Eng. & Systems 2025-08-20 Gurucharan Marthi Krishna Kumar , Aman Chadha , Janine Mendola , Amir Shmuel

This paper investigates the capability of plain Vision Transformers (ViTs) for semantic segmentation using the encoder-decoder framework and introduces \textbf{SegViTv2}. In this study, we introduce a novel Attention-to-Mask (\atm) module…

Computer Vision and Pattern Recognition · Computer Science 2023-08-31 Bowen Zhang , Liyang Liu , Minh Hieu Phan , Zhi Tian , Chunhua Shen , Yifan Liu

Convolutional neural networks (CNNs) have been the de facto standard for nowadays 3D medical image segmentation. The convolutional operations used in these networks, however, inevitably have limitations in modeling the long-range dependency…

Computer Vision and Pattern Recognition · Computer Science 2021-03-05 Yutong Xie , Jianpeng Zhang , Chunhua Shen , Yong Xia

Accurate and efficient brain tumor segmentation remains a critical challenge in neuroimaging due to the heterogeneous nature of tumor subregions and the high computational cost of volumetric inference. In this paper, we propose…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Fatemeh Ziaeetabar

We introduce VistaFormer, a lightweight Transformer-based model architecture for the semantic segmentation of remote-sensing images. This model uses a multi-scale Transformer-based encoder with a lightweight decoder that aggregates global…

Computer Vision and Pattern Recognition · Computer Science 2024-09-16 Ezra MacDonald , Derek Jacoby , Yvonne Coady

Medical image segmentation is important for computer-aided diagnosis. Good segmentation demands the model to see the big picture and fine details simultaneously, i.e., to learn image features that incorporate large context while keep high…

Image and Video Processing · Electrical Eng. & Systems 2021-06-03 Shaohua Li , Xiuchao Sui , Xiangde Luo , Xinxing Xu , Yong Liu , Rick Goh

Image segmentation is often ambiguous at the level of individual image patches and requires contextual information to reach label consensus. In this paper we introduce Segmenter, a transformer model for semantic segmentation. In contrast to…

Computer Vision and Pattern Recognition · Computer Science 2021-09-03 Robin Strudel , Ricardo Garcia , Ivan Laptev , Cordelia Schmid

Automated medical image segmentation is becoming increasingly crucial to modern clinical practice, driven by the growing demand for precise diagnosis, the push towards personalized treatment plans, and the advancements in machine learning…

Image and Video Processing · Electrical Eng. & Systems 2023-11-13 Tan-Hanh Pham , Xianqi Li , Kim-Doang Nguyen

In medical image segmentation, specialized computer vision techniques, notably transformers grounded in attention mechanisms and residual networks employing skip connections, have been instrumental in advancing performance. Nonetheless,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Fuchen Zheng , Xuhang Chen , Weihuang Liu , Haolun Li , Yingtie Lei , Jiahui He , Chi-Man Pun , Shounjun Zhou

Semantic segmentation has a broad range of applications in a variety of domains including land coverage analysis, autonomous driving, and medical image analysis. Convolutional neural networks (CNN) and Vision Transformers (ViTs) provide the…

Computer Vision and Pattern Recognition · Computer Science 2023-05-08 Hans Thisanke , Chamli Deshan , Kavindu Chamith , Sachith Seneviratne , Rajith Vidanaarachchi , Damayanthi Herath

Transformers have made remarkable progress towards modeling long-range dependencies within the medical image analysis domain. However, current transformer-based models suffer from several disadvantages: (1) existing methods fail to capture…

Computer Vision and Pattern Recognition · Computer Science 2022-12-16 Chenyu You , Ruihan Zhao , Fenglin Liu , Siyuan Dong , Sandeep Chinchali , Ufuk Topcu , Lawrence Staib , James S. Duncan