English
Related papers

Related papers: TransFuse: Fusing Transformers and CNNs for Medica…

200 papers

The success of Transformer in computer vision has attracted increasing attention in the medical imaging community. Especially for medical image segmentation, many excellent hybrid architectures based on convolutional neural networks (CNNs)…

Image and Video Processing · Electrical Eng. & Systems 2022-07-26 Wentao Liu , Tong Tian , Weijin Xu , Huihua Yang , Xipeng Pan , Songlin Yan , Lemeng Wang

Multimodal medical image fusion is a crucial task that combines complementary information from different imaging modalities into a unified representation, thereby enhancing diagnostic accuracy and treatment planning. While deep learning…

Image and Video Processing · Electrical Eng. & Systems 2024-11-19 Meng Zhou , Yuxuan Zhang , Xiaolan Xu , Jiayi Wang , Farzad Khalvati

Transformers have achieved remarkable success across multiple fields, yet their impact on 3D medical image segmentation remains limited with convolutional networks still dominating major benchmarks. In this work, (A) we analyze current…

Computer Vision and Pattern Recognition · Computer Science 2026-05-01 Tassilo Wald , Saikat Roy , Fabian Isensee , Constantin Ulrich , Sebastian Ziegler , Dasha Trofimova , Raphael Stock , Michael Baumgartner , Gregor Köhler , Klaus Maier-Hein

Image analysis using more than one modality (i.e. multi-modal) has been increasingly applied in the field of biomedical imaging. One of the challenges in performing the multimodal analysis is that there exist multiple schemes for fusing the…

Computer Vision and Pattern Recognition · Computer Science 2018-06-19 Zhe Guo , Xiang Li , Heng Huang , Ning Guo , Quanzheng Li

Brain tissue segmentation has demonstrated great utility in quantifying MRI data through Voxel-Based Morphometry and highlighting subtle structural changes associated with various conditions within the brain. However, manual segmentation is…

Image and Video Processing · Electrical Eng. & Systems 2023-02-02 Vishwanatha M. Rao , Zihan Wan , Soroush Arabshahi , David J. Ma , Pin-Yu Lee , Ye Tian , Xuzhe Zhang , Andrew F. Laine , Jia Guo

Accurate medical image segmentation allows for the precise delineation of anatomical structures and pathological regions, which is essential for treatment planning, surgical navigation, and disease monitoring. Both CNN-based and…

Computer Vision and Pattern Recognition · Computer Science 2026-04-23 Libin Lan , Yanxin Li , Xiaojuan Liu , Juan Zhou , Jianxun Zhang , Nannan Huang , Yudong Zhang

The CNN-based methods have achieved impressive results in medical image segmentation, but they failed to capture the long-range dependencies due to the inherent locality of the convolution operation. Transformer-based methods are recently…

Computer Vision and Pattern Recognition · Computer Science 2021-12-21 Xiaohong Huang , Zhifang Deng , Dandan Li , Xueguang Yuan

Most recent scribble-supervised segmentation methods commonly adopt a CNN framework with an encoder-decoder architecture. Despite its multiple benefits, this framework generally can only capture small-range feature dependency for the…

Computer Vision and Pattern Recognition · Computer Science 2024-02-06 Zihan Li , Yuan Zheng , Dandan Shan , Shuzhou Yang , Qingde Li , Beizhan Wang , Yuanting Zhang , Qingqi Hong , Dinggang Shen

Nuclei segmentation, despite its fundamental role in histopathological image analysis, is still a challenge work. The main challenge of this task is the existence of overlapping areas, which makes separating independent nuclei more…

Image and Video Processing · Electrical Eng. & Systems 2024-07-25 Dinh-Phu Tran , Quoc-Anh Nguyen , Van-Truong Pham , Thi-Thao Tran

In recent years, computer-aided diagnosis has become an increasingly popular topic. Methods based on convolutional neural networks have achieved good performance in medical image segmentation and classification. Due to the limitations of…

Computer Vision and Pattern Recognition · Computer Science 2021-07-13 Yao Chang , Hu Menghan , Zhai Guangtao , Zhang Xiao-Ping

Transformer, benefiting from global (long-range) information modeling using self-attention mechanism, has been successful in natural language processing and computer vision recently. Convolutional Neural Networks, capable of capturing local…

Image and Video Processing · Electrical Eng. & Systems 2022-05-18 Jiangyun Li , Wenxuan Wang , Chen Chen , Tianxiang Zhang , Sen Zha , Jing Wang , Hong Yu

Recently, deep learning with Convolutional Neural Networks (CNNs) and Transformers has shown encouraging results in fully supervised medical image segmentation. However, it is still challenging for them to achieve good performance with…

Image and Video Processing · Electrical Eng. & Systems 2022-03-02 Xiangde Luo , Minhao Hu , Tao Song , Guotai Wang , Shaoting Zhang

Biomedical image segmentation is crucial for accurately diagnosing and analyzing various diseases. However, Convolutional Neural Networks (CNNs) and Transformers, the most commonly used architectures for this task, struggle to effectively…

Image and Video Processing · Electrical Eng. & Systems 2024-12-09 Rong Zhou , Zhengqing Yuan , Zhiling Yan , Weixiang Sun , Kai Zhang , Yiwei Li , Yanfang Ye , Xiang Li , Lifang He , Lichao Sun

Medical segmentation has grown exponentially through the advent of a fully convolutional network (FCN), and we have now reached a turning point through the success of Transformer. However, the different characteristics of the modality have…

Image and Video Processing · Electrical Eng. & Systems 2023-11-03 Jihoon Cho , Jinah Park

The hybrid architecture of convolutional neural networks (CNNs) and Transformer are very popular for medical image segmentation. However, it suffers from two challenges. First, although a CNNs branch can capture the local image features…

Image and Video Processing · Electrical Eng. & Systems 2023-12-21 Tao Lei , Rui Sun , Xuan Wang , Yingbo Wang , Xi He , Asoke Nandi

Over the past two decades, machine analysis of medical imaging has advanced rapidly, opening up significant potential for several important medical applications. As complicated diseases increase and the number of cases rises, the role of…

Image and Video Processing · Electrical Eng. & Systems 2024-05-08 Fares Bougourzi , Fadi Dornaika , Cosimo Distante , Abdelmalik Taleb-Ahmed

Despite recent progress on semantic segmentation, there still exist huge challenges in medical ultra-resolution image segmentation. The methods based on multi-branch structure can make a good balance between computational burdens and…

Computer Vision and Pattern Recognition · Computer Science 2020-02-20 Tong Wu , Yuan Xie , Yanyun Qu , Bicheng Dai , Shuxin Chen

Transformers have demonstrated remarkable performance in natural language processing and computer vision. However, existing vision Transformers struggle to learn from limited medical data and are unable to generalize on diverse medical…

Image and Video Processing · Electrical Eng. & Systems 2023-04-06 Yunhe Gao , Mu Zhou , Di Liu , Zhennan Yan , Shaoting Zhang , Dimitris N. Metaxas

There has been exploding interest in embracing Transformer-based architectures for medical image segmentation. However, the lack of large-scale annotated medical datasets make achieving performances equivalent to those in natural images…

Image and Video Processing · Electrical Eng. & Systems 2024-06-04 Saikat Roy , Gregor Koehler , Constantin Ulrich , Michael Baumgartner , Jens Petersen , Fabian Isensee , Paul F. Jaeger , Klaus Maier-Hein

Medical image segmentation plays a crucial role in advancing healthcare systems for disease diagnosis and treatment planning. The u-shaped architecture, popularly known as U-Net, has proven highly successful for various medical image…

Computer Vision and Pattern Recognition · Computer Science 2023-10-13 Jieneng Chen , Jieru Mei , Xianhang Li , Yongyi Lu , Qihang Yu , Qingyue Wei , Xiangde Luo , Yutong Xie , Ehsan Adeli , Yan Wang , Matthew Lungren , Lei Xing , Le Lu , Alan Yuille , Yuyin Zhou