English
Related papers

Related papers: MS-Twins: Multi-Scale Deep Self-Attention Networks…

200 papers

Ophthalmic image segmentation serves as a critical foundation for ocular disease diagnosis. Although fully convolutional neural networks (CNNs) are commonly employed for segmentation, they are constrained by inductive biases and face…

Computer Vision and Pattern Recognition · Computer Science 2024-08-19 Zunjie Xiao , Xiaoqing Zhang , Risa Higashita , Jiang Liu

Medical image segmentation plays an important role in computer-aided diagnosis. Traditional convolution-based U-shape segmentation architectures are usually limited by the local receptive field. Existing vision transformers have been widely…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Qing Xu , Yanming Chen , Yue Li , Ziyu Liu , Zhenye Lou , Yixuan Zhang , Xiangjian He

We present Token-UNet, adopting the TokenLearner and TokenFuser modules to encase Transformers into UNets. While Transformers have enabled global interactions among input elements in medical imaging, current computational challenges hinder…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Louis Fabrice Tshimanga , Andrea Zanola , Federico Del Pup , Manfredo Atzori

Medical image analysis continues to hold interesting challenges given the subtle characteristics of certain diseases and the significant overlap in appearance between diseases. In this work, we explore the concept of self-attention for…

Image and Video Processing · Electrical Eng. & Systems 2021-10-13 Hossein Aboutalebi , Maya Pavlova , Hayden Gunraj , Mohammad Javad Shafiee , Ali Sabri , Amer Alaref , Alexander Wong

The combination of Spiking Neural Networks (SNNs) with Vision Transformer architectures has garnered significant attention due to their potential for energy-efficient and high-performance computing paradigms. However, a substantial…

Computer Vision and Pattern Recognition · Computer Science 2025-06-19 Wei Hua , Chenlin Zhou , Jibin Wu , Yansong Chua , Yangyang Shu

Transformers have achieved remarkable success across multiple fields, yet their impact on 3D medical image segmentation remains limited with convolutional networks still dominating major benchmarks. In this work, (A) we analyze current…

Computer Vision and Pattern Recognition · Computer Science 2026-05-01 Tassilo Wald , Saikat Roy , Fabian Isensee , Constantin Ulrich , Sebastian Ziegler , Dasha Trofimova , Raphael Stock , Michael Baumgartner , Gregor Köhler , Klaus Maier-Hein

Advancements in medical imaging and endovascular grafting have facilitated minimally invasive treatments for aortic diseases. Accurate 3D segmentation of the aorta and its branches is crucial for interventions, as inaccurate segmentation…

Image segmentation holds a vital position in the realms of diagnosis and treatment within the medical domain. Traditional convolutional neural networks (CNNs) and Transformer models have made significant advancements in this realm, but they…

Image and Video Processing · Electrical Eng. & Systems 2024-05-06 Hao Tang , Lianglun Cheng , Guoheng Huang , Zhengguang Tan , Junhao Lu , Kaihong Wu

Medical image segmentation is essential for clinical diagnosis and treatment planning. Although transformer-based methods have achieved remarkable results, their high computational cost hinders clinical deployment. To address this issue, we…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Yaxuan Jiao , Qing Xu , Yuxiang Luo , Xiangjian He , Zhen Chen , Wenting Duan

Like other applications in computer vision, medical image segmentation has been most successfully addressed using deep learning models that rely on the convolution operation as their main building block. Convolutions enjoy important…

Image and Video Processing · Electrical Eng. & Systems 2022-04-05 Davood Karimi , Serge Vasylechko , Ali Gholipour

Although purely transformer-based architectures showed promising performance in many computer vision tasks, many hybrid models consisting of CNN and transformer blocks are introduced to fit more specialized tasks. Nevertheless, despite the…

Computer Vision and Pattern Recognition · Computer Science 2023-05-01 Yousef Yeganeh , Azade Farshad , Peter Weinberger , Seyed-Ahmad Ahmadi , Ehsan Adeli , Nassir Navab

Accurate medical image segmentation is an integral part of the medical image analysis pipeline that requires the ability to merge local and global information. While vision transformers are able to capture global interactions using vanilla…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Elisha Dayag , Nhat Thanh Tran , Jack Xin

Convolutional blocks have played a crucial role in advancing medical image segmentation by excelling in dense prediction tasks. However, their inability to effectively capture long-range dependencies has limited their performance.…

Image and Video Processing · Electrical Eng. & Systems 2026-03-17 Siddhartha Mallick , Aayushman Ghosh , Jayanta Paul , Jaya Sil

Efficiently capturing multi-scale information and building long-range dependencies among pixels are essential for medical image segmentation because of the various sizes and shapes of the lesion regions or organs. In this paper, we present…

Image and Video Processing · Electrical Eng. & Systems 2025-04-18 Hao Shao , Quansheng Zeng , Qibin Hou , Jufeng Yang

Atrous convolutions are employed as a method to increase the receptive field in semantic segmentation tasks. However, in previous works of semantic segmentation, it was rarely employed in the shallow layers of the model. We revisit the…

Computer Vision and Pattern Recognition · Computer Science 2024-06-07 Zilu Guo , Liuyang Bian , Xuan Huang , Hu Wei , Jingyu Li , Huasheng Ni

Inspired by the success of Transformers in Computer vision, Transformers have been widely investigated for medical imaging segmentation. However, most of Transformer architecture are using the recent transformer architectures as encoder or…

Image and Video Processing · Electrical Eng. & Systems 2024-04-30 Fares Bougourzi , Fadi Dornaika , Abdelmalik Taleb-Ahmed , Vinh Truong Hoang

Segmentation of 3D medical images is a critical task for accurate diagnosis and treatment planning. Convolutional neural networks (CNNs) have dominated the field, achieving significant success in 3D medical image segmentation. However, CNNs…

Image and Video Processing · Electrical Eng. & Systems 2025-02-11 Canxuan Gang

Semantic segmentation is crucial for medical image analysis, enabling precise disease diagnosis and treatment planning. However, many advanced models employ complex architectures, limiting their use in resource-constrained clinical…

Image and Video Processing · Electrical Eng. & Systems 2026-01-06 Le-Anh Tran , Chung Nguyen Tran , Nhan Cach Dang , Anh Le Van Quoc , Jordi Carrabina , David Castells-Rufas , Minh Son Nguyen

Deep learning architecture with convolutional neural network (CNN) achieves outstanding success in the field of computer vision. Where U-Net, an encoder-decoder architecture structured by CNN, makes a great breakthrough in biomedical image…

Image and Video Processing · Electrical Eng. & Systems 2023-02-13 Qing Xu , Zhicheng Ma , Na HE , Wenting Duan

Transformers have emerged as viable alternatives to convolutional neural networks owing to their ability to learn non-local region relationships in the spatial domain. The self-attention mechanism of the transformer enables transformers to…

Image and Video Processing · Electrical Eng. & Systems 2023-08-09 Rahul G. S. , Sriprabha Ramnarayanan , Mohammad Al Fahim , Keerthi Ram , Preejith S. P , Mohanasankar Sivaprakasam