English
Related papers

Related papers: Going Beyond U-Net: Assessing Vision Transformers …

200 papers

Medical image segmentation is crucial for disease diagnosis and monitoring. Though effective, the current segmentation networks such as UNet struggle with capturing long-range features. More accurate models such as TransUNet, Swin-UNet, and…

Image and Video Processing · Electrical Eng. & Systems 2024-06-11 Khaled Alrfou , Tian Zhao

This paper proposes a method MTL-Swin-Unet which is multi-task learning using transformers for classification and semantic segmentation. For spurious-correlation problems, this method allows us to enhance the image representation with two…

Machine Learning · Computer Science 2025-05-14 Kodai Hirata , Tsuyoshi Okita

Image segmentation is a fundamental task in image analysis and clinical practice. The current state-of-the-art techniques are based on U-shape type encoder-decoder networks with skip connections, called U-Net. Despite the powerful…

Computer Vision and Pattern Recognition · Computer Science 2023-02-02 Chun-Wun Cheng , Christina Runkel , Lihao Liu , Raymond H Chan , Carola-Bibiane Schönlieb , Angelica I Aviles-Rivero

The alignment of serial-section electron microscopy (ssEM) images is critical for efforts in neuroscience that seek to reconstruct neuronal circuits. However, each ssEM plane contains densely packed structures that vary from one section to…

Computer Vision and Pattern Recognition · Computer Science 2017-12-06 Inwan Yoo , David G. C. Hildebrand , Willie F. Tobin , Wei-Chung Allen Lee , Won-Ki Jeong

Deep neural networks have been widely used in medical image analysis and medical image segmentation is one of the most important tasks. U-shaped neural networks with encoder-decoder are prevailing and have succeeded greatly in various…

Image and Video Processing · Electrical Eng. & Systems 2023-06-09 Juntao Jiang , Xiyu Chen , Guanzhong Tian , Yong Liu

Precision in identifying and differentiating micro and macro blood vessels in the retina is crucial for the diagnosis of retinal diseases, although it poses a significant challenge. Current autoencoding-based segmentation approaches…

Image and Video Processing · Electrical Eng. & Systems 2024-03-05 Rui Yang , Shunpu Zhang

Semantic segmentation has witnessed remarkable advancements with the adaptation of the Transformer architecture. Parallel to the strides made by the Transformer, CNN-based U-Net has seen significant progress, especially in high-resolution…

Computer Vision and Pattern Recognition · Computer Science 2023-12-12 Seul-Ki Yeom , Julian von Klitzing

An improved model of medical image segmentation for brain tumor is discussed, which is a deep learning algorithm based on U-Net architecture. Based on the traditional U-Net, we introduce GSConv module and ECA attention mechanism to improve…

Image and Video Processing · Electrical Eng. & Systems 2024-09-23 Qiyuan Tian , Zhuoyue Wang , Xiaoling Cui

In the past few years, convolutional neural networks (CNNs), particularly U-Net, have been the prevailing technique in the medical image processing era. Specifically, the seminal U-Net, as well as its alternatives, have successfully managed…

Computer Vision and Pattern Recognition · Computer Science 2022-07-28 Reza Azad , Mohammad T. AL-Antary , Moein Heidari , Dorit Merhof

Neural networks have become the standard technique for medical diagnostics, especially in cancer detection and classification. This work evaluates the performance of Vision Transformers architectures, including Swin Transformer and MaxViT,…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Óscar A. Martín , Javier Sánchez

Recent advances in transformer-based models have drawn attention to exploring these techniques in medical image segmentation, especially in conjunction with the U-Net model (or its variants), which has shown great success in medical image…

Image and Video Processing · Electrical Eng. & Systems 2021-10-22 Xiangyi Yan , Hao Tang , Shanlin Sun , Haoyu Ma , Deying Kong , Xiaohui Xie

Segmentation of 3D medical images is a critical task for accurate diagnosis and treatment planning. Convolutional neural networks (CNNs) have dominated the field, achieving significant success in 3D medical image segmentation. However, CNNs…

Image and Video Processing · Electrical Eng. & Systems 2025-02-11 Canxuan Gang

We present Token-UNet, adopting the TokenLearner and TokenFuser modules to encase Transformers into UNets. While Transformers have enabled global interactions among input elements in medical imaging, current computational challenges hinder…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Louis Fabrice Tshimanga , Andrea Zanola , Federico Del Pup , Manfredo Atzori

The accurate segmentation of medical images is critical for various healthcare applications. Convolutional neural networks (CNNs), especially Fully Convolutional Networks (FCNs) like U-Net, have shown remarkable success in medical image…

Computer Vision and Pattern Recognition · Computer Science 2024-02-15 Omid Nejati Manzari , Javad Mirzapour Kaleybar , Hooman Saadat , Shahin Maleki

U-Nets have achieved tremendous success in medical image segmentation. Nevertheless, it may suffer limitations in global (long-range) contextual interactions and edge-detail preservation. In contrast, Transformer has an excellent ability to…

Computer Vision and Pattern Recognition · Computer Science 2022-06-03 Nan Wang , Shaohui Lin , Xiaoxiao Li , Ke Li , Yunhang Shen , Yue Gao , Lizhuang Ma

Accurate and automated lesion segmentation in Positron Emission Tomography / Computed Tomography (PET/CT) imaging is essential for cancer diagnosis and therapy planning. This paper presents a Swin Transformer UNet 3D (SwinUNet3D) framework…

Image and Video Processing · Electrical Eng. & Systems 2026-01-07 Shovini Guha , Dwaipayan Nandi

Recently, deep learning methods have achieved state-of-the-art performance in many medical image segmentation tasks. Many of these are based on convolutional neural networks (CNNs). For such methods, the encoder is the key part for global…

Image and Video Processing · Electrical Eng. & Systems 2022-08-25 Hao Li , Dewei Hu , Han Liu , Jiacheng Wang , Ipek Oguz

The Resolution of feature maps is critical for medical image segmentation. Most of the existing Transformer-based networks for medical image segmentation are U-Net-like architecture that contains an encoder that utilizes a sequence of…

Computer Vision and Pattern Recognition · Computer Science 2022-07-26 Chen Wei , Shenghan Ren , Kaitai Guo , Haihong Hu , Jimin Liang

In medical image segmentation tasks, the scarcity of labeled training data poses a significant challenge when training deep neural networks. When using U-Net-style architectures, it is common practice to address this problem by pretraining…

Computer Vision and Pattern Recognition · Computer Science 2025-06-09 Gábor Hidy , Bence Bakos , András Lukács

Recently, deep learning has become much more popular in computer vision area. The Convolution Neural Network (CNN) has brought a breakthrough in images segmentation areas, especially, for medical images. In this regard, U-Net is the…

Image and Video Processing · Electrical Eng. & Systems 2020-06-02 Ange Lou , Shuyue Guan , Murray Loew