English
Related papers

Related papers: Transformer-Unet: Raw Image Processing with Unet

200 papers

Transformer-based neural networks have surpassed promising performance on many biomedical image segmentation tasks due to a better global information modeling from the self-attention mechanism. However, most methods are still designed for…

Computer Vision and Pattern Recognition · Computer Science 2023-02-02 Zheyuan Zhang , Ulas Bagci

In the past decade, convolutional neural networks (CNNs) have shown prominence for semantic segmentation. Although CNN models have very impressive performance, the ability to capture global representation is still insufficient, which…

Computer Vision and Pattern Recognition · Computer Science 2023-02-22 Guoan Xu , Juncheng Li , Guangwei Gao , Huimin Lu , Jian Yang , Dong Yue

Transfer learning improves the performance of deep learning models by initializing them with parameters pre-trained on larger datasets. Intuitively, transfer learning is more effective when pre-training is on the in-domain datasets. A…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Khaled Alrfou , Tian Zhao , Amir Kordijazi

The rise of Transformer architectures has advanced medical image segmentation, leading to hybrid models that combine Convolutional Neural Networks (CNNs) and Transformers. However, these models often suffer from excessive complexity and…

Image and Video Processing · Electrical Eng. & Systems 2025-07-17 Yousef Sadegheih , Afshin Bozorgpour , Pratibha Kumari , Reza Azad , Dorit Merhof

Transformer-based models, capable of learning better global dependencies, have recently demonstrated exceptional representation learning capabilities in computer vision and medical image analysis. Transformer reformats the image into…

Medical ultrasound image segmentation presents a formidable challenge in the realm of computer vision. Traditional approaches rely on Convolutional Neural Networks (CNNs) and Transformer-based methods to address the intricacies of medical…

Computer Vision and Pattern Recognition · Computer Science 2025-08-20 Weixin Xu , Ziliang Wang

U-Net and its variants have been widely used in medical image segmentation. However, most current U-Net variants confine their improvement strategies to building more complex encoder, while leaving the decoder unchanged or adopting a simple…

Image and Video Processing · Electrical Eng. & Systems 2023-10-30 Weibin Yang , Longwei Xu , Pengwei Wang , Dehua Geng , Yusong Li , Mingyuan Xu , Zhiqi Dong

In view of the recent paradigm shift in deep AI based image processing methods, medical image processing has advanced considerably. In this study, we propose a novel deep neural network (DNN), entitled InceptNet, in the scope of medical…

Image and Video Processing · Electrical Eng. & Systems 2023-09-06 Amirhossein Sajedi , Mohammad Javad Fadaeieslam

Histopathology has played an essential role in cancer diagnosis. With the rapid advances in convolutional neural networks (CNN). Various CNN-based automated pathological image segmentation approaches have been developed in computer-assisted…

Image and Video Processing · Electrical Eng. & Systems 2021-09-23 Cam Nguyen , Zuhayr Asad , Yuankai Huo

The state-of-the-art models for medical image segmentation are variants of U-Net and fully convolutional networks (FCN). Despite their success, these models have two limitations: (1) their optimal depth is apriori unknown, requiring…

Image and Video Processing · Electrical Eng. & Systems 2020-01-30 Zongwei Zhou , Md Mahfuzur Rahman Siddiquee , Nima Tajbakhsh , Jianming Liang

Medical imaging is essential in healthcare to provide key insights into patient anatomy and pathology, aiding in diagnosis and treatment. Non-invasive techniques such as X-ray, Magnetic Resonance Imaging (MRI), Computed Tomography (CT), and…

Image and Video Processing · Electrical Eng. & Systems 2024-12-04 Fnu Neha , Deepshikha Bhati , Deepak Kumar Shukla , Sonavi Makarand Dalvi , Nikolaos Mantzou , Safa Shubbar

Objective: Transformers, born to remedy the inadequate receptive fields of CNNs, have drawn explosive attention recently. However, the daunting computational complexity of global representation learning, together with rigid window…

Computer Vision and Pattern Recognition · Computer Science 2023-04-20 Xian Lin , Li Yu , Kwang-Ting Cheng , Zengqiang Yan

Unets have become the standard method for semantic segmentation of medical images, along with fully convolutional networks (FCN). Unet++ was introduced as a variant of Unet, in order to solve some of the problems facing Unet and FCNs.…

Computer Vision and Pattern Recognition · Computer Science 2022-06-13 Samayan Bhattacharya , Sk Shahnawaz , Avigyan Bhattacharya

There has been exploding interest in embracing Transformer-based architectures for medical image segmentation. However, the lack of large-scale annotated medical datasets make achieving performances equivalent to those in natural images…

Image and Video Processing · Electrical Eng. & Systems 2024-06-04 Saikat Roy , Gregor Koehler , Constantin Ulrich , Michael Baumgartner , Jens Petersen , Fabian Isensee , Paul F. Jaeger , Klaus Maier-Hein

Medical image segmentation is of great significance in analysis of illness. The use of deep neural networks in medical image segmentation can help doctors extract regions of interest from complex medical images, thereby improving diagnostic…

Image and Video Processing · Electrical Eng. & Systems 2026-04-01 Zhuoyi Fang , Kexuan Shi , Jiajia Liu , Qiang Han

Image analysis technology is used to solve the inadvertences of artificial traditional methods in disease, wastewater treatment, environmental change monitoring analysis and convolutional neural networks (CNN) play an important role in…

Image and Video Processing · Electrical Eng. & Systems 2022-04-26 Jian Wu , Wanli Liu , Chen Li , Tao Jiang , Islam Mohammad Shariful , Hongzan Sun , Xiaoqi Li , Xintong Li , Xinyu Huang , Marcin Grzegorzek

Vision Transformers (ViT)s have recently become popular due to their outstanding modeling capabilities, in particular for capturing long-range information, and scalability to dataset and model sizes which has led to state-of-the-art…

Image and Video Processing · Electrical Eng. & Systems 2022-04-06 Ali Hatamizadeh , Ziyue Xu , Dong Yang , Wenqi Li , Holger Roth , Daguang Xu

Accurate medical image segmentation is essential for clinical quantification, disease diagnosis, treatment planning and many other applications. Both convolution-based and transformer-based u-shaped architectures have made significant…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Libin Lan , Pengzhou Cai , Lu Jiang , Xiaojuan Liu , Yongmei Li , Yudong Zhang

Medical image segmentation is important for computer-aided diagnosis. Good segmentation demands the model to see the big picture and fine details simultaneously, i.e., to learn image features that incorporate large context while keep high…

Image and Video Processing · Electrical Eng. & Systems 2021-06-03 Shaohua Li , Xiuchao Sui , Xiangde Luo , Xinxing Xu , Yong Liu , Rick Goh

Remote sensing image segmentation is a specific task of remote sensing image interpretation. A good remote sensing image segmentation algorithm can provide guidance for environmental protection, agricultural production, and urban…

Computer Vision and Pattern Recognition · Computer Science 2024-01-18 Jiacheng Li