English
Related papers

Related papers: Transformer Utilization in Medical Image Segmentat…

200 papers

Convolutional Neural Networks (CNNs) have reigned for a decade as the de facto approach to automated medical image diagnosis, pushing the state-of-the-art in classification, detection and segmentation tasks. Over the last years, vision…

Computer Vision and Pattern Recognition · Computer Science 2024-11-18 Christos Matsoukas , Johan Fredin Haslum , Moein Sorkhei , Magnus Söderberg , Kevin Smith

Recently, Transformer model, which has achieved great success in many artificial intelligence fields, has demonstrated its great potential in modeling graph-structured data. Till now, a great variety of Transformers has been proposed to…

Machine Learning · Computer Science 2022-02-18 Erxue Min , Runfa Chen , Yatao Bian , Tingyang Xu , Kangfei Zhao , Wenbing Huang , Peilin Zhao , Junzhou Huang , Sophia Ananiadou , Yu Rong

Transformer-based neural networks have surpassed promising performance on many biomedical image segmentation tasks due to a better global information modeling from the self-attention mechanism. However, most methods are still designed for…

Computer Vision and Pattern Recognition · Computer Science 2023-02-02 Zheyuan Zhang , Ulas Bagci

Multi-modality is widely used in medical imaging, because it can provide multiinformation about a target (tumor, organ or tissue). Segmentation using multimodality consists of fusing multi-information to improve the segmentation. Recently,…

Image and Video Processing · Electrical Eng. & Systems 2020-07-17 Tongxue Zhou , Su Ruan , Stéphane Canu

Vision Transformers (VTs) are becoming a valuable alternative to Convolutional Neural Networks (CNNs) when it comes to problems involving high-dimensional and spatially organized inputs such as images. However, their Transfer Learning (TL)…

Computer Vision and Pattern Recognition · Computer Science 2022-08-10 Vincent Tonkes , Matthia Sabatelli

Deformable medical image registration plays an important role in clinical diagnosis and treatment. Recently, the deep learning (DL) based image registration methods have been widely investigated and showed excellent performance in…

Image and Video Processing · Electrical Eng. & Systems 2022-10-18 Yibo Wang , Wen Qian , Xuming Zhang

The convolution operation is a central building block of neural network architectures widely used in computer vision. The size of the convolution kernels determines both the expressiveness of convolutional neural networks (CNN), as well as…

Image and Video Processing · Electrical Eng. & Systems 2022-10-10 Tianyu Ma , Adrian V. Dalca , Mert R. Sabuncu

Dynamic attention mechanism and global modeling ability make Transformer show strong feature learning ability. In recent years, Transformer has become comparable to CNNs methods in computer vision. This review mainly investigates the…

Computer Vision and Pattern Recognition · Computer Science 2022-03-25 Yuting Yang , Licheng Jiao , Xu Liu , Fang Liu , Shuyuan Yang , Zhixi Feng , Xu Tang

The Transformer architecture has inarguably revolutionized deep learning, overtaking classical architectures like multi-layer perceptrons (MLPs) and convolutional neural networks (CNNs). At its core, the attention block differs in form and…

Machine Learning · Computer Science 2025-03-18 Weronika Ormaniec , Felix Dangel , Sidak Pal Singh

Transfer learning from natural image datasets, particularly ImageNet, using standard large models and corresponding pretrained weights has become a de-facto method for deep learning applications to medical imaging. However, there are…

Computer Vision and Pattern Recognition · Computer Science 2019-10-31 Maithra Raghu , Chiyuan Zhang , Jon Kleinberg , Samy Bengio

Recently, deep learning methods have achieved state-of-the-art performance in many medical image segmentation tasks. Many of these are based on convolutional neural networks (CNNs). For such methods, the encoder is the key part for global…

Image and Video Processing · Electrical Eng. & Systems 2022-08-25 Hao Li , Dewei Hu , Han Liu , Jiacheng Wang , Ipek Oguz

Convolutional neural networks demonstrated outstanding empirical results in computer vision and speech recognition tasks where labeled training data is abundant. In medical imaging, there is a huge variety of possible imaging modalities and…

Computer Vision and Pattern Recognition · Computer Science 2015-12-21 Vlado Menkovski , Zharko Aleksovski , Axel Saalbach , Hannes Nickisch

Image generation has been successfully cast as an autoregressive sequence generation or transformation problem. Recent work has shown that self-attention is an effective way of modeling textual sequences. In this work, we generalize a…

Computer Vision and Pattern Recognition · Computer Science 2018-06-19 Niki Parmar , Ashish Vaswani , Jakob Uszkoreit , Łukasz Kaiser , Noam Shazeer , Alexander Ku , Dustin Tran

In this paper, we present Uformer, an effective and efficient Transformer-based architecture for image restoration, in which we build a hierarchical encoder-decoder network using the Transformer block. In Uformer, there are two core…

Computer Vision and Pattern Recognition · Computer Science 2021-11-29 Zhendong Wang , Xiaodong Cun , Jianmin Bao , Wengang Zhou , Jianzhuang Liu , Houqiang Li

Brain tumor segmentation is an active research area due to the difficulty in delineating highly complex shaped and textured tumors as well as the failure of the commonly used U-Net architectures. The combination of different neural…

Image and Video Processing · Electrical Eng. & Systems 2023-08-02 Lanhong Yao , Zheyuan Zhang , Ulas Bagci

Transformer models have recently attracted much interest from computer vision researchers and have since been successfully employed for several problems traditionally addressed with convolutional neural networks. At the same time, image…

Computer Vision and Pattern Recognition · Computer Science 2021-07-13 Ricard Durall , Stanislav Frolov , Jörn Hees , Federico Raue , Franz-Josef Pfreundt , Andreas Dengel , Janis Keupe

Transformer is a promising neural network learner, and has achieved great success in various machine learning tasks. Thanks to the recent prevalence of multimodal applications and big data, Transformer-based multimodal learning has become a…

Computer Vision and Pattern Recognition · Computer Science 2023-05-11 Peng Xu , Xiatian Zhu , David A. Clifton

Transformers have revolutionized deep learning in numerous fields, including natural language processing, computer vision, and audio processing. Their strength lies in their attention mechanism, which allows for the discovering of complex…

Machine Learning · Computer Science 2024-04-02 Uladzislau Yorsh , Martin Holeňa , Ondřej Bojar , David Herel

Deep convolutional neural networks (CNNs) have been widely used in various medical imaging tasks. However, due to the intrinsic locality of convolution operation, CNNs generally cannot model long-range dependencies well, which are important…

Computer Vision and Pattern Recognition · Computer Science 2022-06-22 Xuxin Chen , Ke Zhang , Neman Abdoli , Patrik W. Gilley , Ximin Wang , Hong Liu , Bin Zheng , Yuchen Qiu

Medical image segmentation is crucial for accurate clinical diagnoses, yet it faces challenges such as low contrast between lesions and normal tissues, unclear boundaries, and high variability across patients. Deep learning has improved…

Image and Video Processing · Electrical Eng. & Systems 2024-12-09 Houze Liu , Tong Zhou , Yanlin Xiang , Aoran Shen , Jiacheng Hu , Junliang Du