English
Related papers

Related papers: Primus: Enforcing Attention Usage for 3D Medical I…

200 papers

Vision transformers are effective deep learning models for vision tasks, including medical image segmentation. However, they lack efficiency and translational invariance, unlike convolutional neural networks (CNNs). To model long-range…

Image and Video Processing · Electrical Eng. & Systems 2023-08-15 Liam Chalcroft , Ruben Lourenço Pereira , Mikael Brudfors , Andrew S. Kayser , Mark D'Esposito , Cathy J. Price , Ioannis Pappas , John Ashburner

Transformer, the model of choice for natural language processing, has drawn scant attention from the medical imaging community. Given the ability to exploit long-term dependencies, transformers are promising to help atypical convolutional…

Computer Vision and Pattern Recognition · Computer Science 2022-02-07 Hong-Yu Zhou , Jiansen Guo , Yinghao Zhang , Lequan Yu , Liansheng Wang , Yizhou Yu

The CNN-based methods have achieved impressive results in medical image segmentation, but they failed to capture the long-range dependencies due to the inherent locality of the convolution operation. Transformer-based methods are recently…

Computer Vision and Pattern Recognition · Computer Science 2021-12-21 Xiaohong Huang , Zhifang Deng , Dandan Li , Xueguang Yuan

Even though convolutional neural networks (CNNs) are driving progress in medical image segmentation, standard models still have some drawbacks. First, the use of multi-scale approaches, i.e., encoder-decoder architectures, leads to a…

Computer Vision and Pattern Recognition · Computer Science 2020-02-18 Ashish Sinha , Jose Dolz

Since their emergence, Convolutional Neural Networks (CNNs) have made significant strides in medical image analysis. However, the local nature of the convolution operator may pose a limitation for capturing global and long-range…

Image and Video Processing · Electrical Eng. & Systems 2024-04-01 Abdul Rehman Khan , Asifullah Khan

Transformer, the latest technological advance of deep learning, has gained prevalence in natural language processing or computer vision. Since medical imaging bear some resemblance to computer vision, it is natural to inquire about the…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Jun Li , Junyu Chen , Yucheng Tang , Ce Wang , Bennett A. Landman , S. Kevin Zhou

While CNNs were long considered state of the art for image processing, the introduction of Transformer architectures has challenged this position. While achieving excellent results in image classification and segmentation, Transformers…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 DeShin Hwa , Tobias Holmes , Klaus Drechsler

Over the past decade, convolutional neural networks (CNN) have shown very competitive performance in medical image analysis tasks, such as disease classification, tumor segmentation, and lesion detection. CNN has great advantages in…

Computer Vision and Pattern Recognition · Computer Science 2021-03-11 Yin Dai , Yifan Gao

Brain tissue segmentation has demonstrated great utility in quantifying MRI data through Voxel-Based Morphometry and highlighting subtle structural changes associated with various conditions within the brain. However, manual segmentation is…

Image and Video Processing · Electrical Eng. & Systems 2023-02-02 Vishwanatha M. Rao , Zihan Wan , Soroush Arabshahi , David J. Ma , Pin-Yu Lee , Ye Tian , Xuzhe Zhang , Andrew F. Laine , Jia Guo

The high cure rate of cancer is inextricably linked to physicians' accuracy in diagnosis and treatment, therefore a model that can accomplish high-precision tumor segmentation has become a necessity in many applications of the medical…

Image and Video Processing · Electrical Eng. & Systems 2023-07-26 Zeqiu. Yu , Shuo. Han , Ziheng. Song

Transformer architecture has emerged to be successful in a number of natural language processing tasks. However, its applications to medical vision remain largely unexplored. In this study, we present UTNet, a simple yet powerful hybrid…

Computer Vision and Pattern Recognition · Computer Science 2021-09-29 Yunhe Gao , Mu Zhou , Dimitris Metaxas

The development of efficient segmentation strategies for medical images has evolved from its initial dependence on Convolutional Neural Networks (CNNs) to the current investigation of hybrid models that combine CNNs with Vision Transformers…

Image and Video Processing · Electrical Eng. & Systems 2025-08-08 Pallabi Dutta , Soham Bose , Swalpa Kumar Roy , Sushmita Mitra

One of the common and promising deep learning approaches used for medical image segmentation is transformers, as they can capture long-range dependencies among the pixels by utilizing self-attention. Despite being successful in medical…

Computer Vision and Pattern Recognition · Computer Science 2023-11-01 Md Motiur Rahman , Shiva Shokouhmand , Smriti Bhatt , Miad Faezipour

Convolutional blocks have played a crucial role in advancing medical image segmentation by excelling in dense prediction tasks. However, their inability to effectively capture long-range dependencies has limited their performance.…

Image and Video Processing · Electrical Eng. & Systems 2026-03-17 Siddhartha Mallick , Aayushman Ghosh , Jayanta Paul , Jaya Sil

Computer-aided medical image segmentation has been applied widely in diagnosis and treatment to obtain clinically useful information of shapes and volumes of target organs and tissues. In the past several years, convolutional neural network…

Computer Vision and Pattern Recognition · Computer Science 2022-01-11 Yixuan Wu , Kuanlun Liao , Jintai Chen , Jinhong Wang , Danny Z. Chen , Honghao Gao , Jian Wu

Convolutional neural networks (CNNs) have been the de facto standard in a diverse set of computer vision tasks for many years. Especially, deep neural networks based on seminal architectures such as U-shaped models with skip-connections or…

Image and Video Processing · Electrical Eng. & Systems 2022-08-02 Reza Azad , Moein Heidari , Moein Shariatnia , Ehsan Khodapanah Aghdam , Sanaz Karimijafarbigloo , Ehsan Adeli , Dorit Merhof

Transformer-based architectures have advanced medical image analysis by effectively modeling long-range dependencies, yet they often struggle in 3D settings due to substantial memory overhead and insufficient capture of fine-grained local…

Convolutional Neural Networks (CNNs) have exhibited strong performance in medical image segmentation tasks by capturing high-level (local) information, such as edges and textures. However, due to the limited field of view of convolution…

Image and Video Processing · Electrical Eng. & Systems 2024-02-02 Hao Li , Han Liu , Dewei Hu , Xing Yao , Jiacheng Wang , Ipek Oguz

Medical image segmentation plays an essential role in developing computer-assisted diagnosis and therapy systems, yet still faces many challenges. In the past few years, the popular encoder-decoder architectures based on CNNs (e.g., U-Net)…

Computer Vision and Pattern Recognition · Computer Science 2021-07-20 Guoping Xu , Xingrong Wu , Xuan Zhang , Xinwei He

Medical image segmentation (MIS) aims to finely segment various organs. It requires grasping global information from both parts and the entire image for better segmenting, and clinically there are often certain requirements for segmentation…

Image and Video Processing · Electrical Eng. & Systems 2024-03-26 Dongwei Gan , Ming Chang , Juan Chen