English
Related papers

Related papers: TransFuse: Fusing Transformers and CNNs for Medica…

200 papers

In clinical practice, tri-modal medical image fusion, compared to the existing dual-modal technique, can provide a more comprehensive view of the lesions, aiding physicians in evaluating the disease's shape, location, and biological…

Image and Video Processing · Electrical Eng. & Systems 2024-10-16 Yushen Xu , Xiaosong Li , Yuchan Jie , Haishu Tan

Various imaging artifacts, low signal-to-noise ratio, and bone surfaces appearing several millimeters in thickness have hindered the success of ultrasound (US) guided computer assisted orthopedic surgery procedures. In this work, a…

Computer Vision and Pattern Recognition · Computer Science 2018-06-27 Puyang Wang , Vishal M. Patel , Ilker Hacihaliloglu

CNN- and Transformer-based architectures have achieved strong performance in medical image segmentation, but CNNs are limited in modeling long-range dependencies, while Transformers often suffer from quadratic computational and memory…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Diego Adame , Fabian Vazquez , Jose A. Nunez , Huimin Li , Jinghao Yang , Erik Enriquez , DongChul Kim , Haoteng Tang , Bin Fu , Pengfei Gu

Photoacoustic tomography (PAT) offers optical contrast, whereas magnetic resonance imaging (MRI) excels in imaging soft tissue and organ anatomy. The fusion of PAT with MRI holds promising application prospects due to their complementary…

Image and Video Processing · Electrical Eng. & Systems 2025-03-20 Yutian Zhong , Jinchuan He , Zhichao Liang , Shuangyang Zhang , Qianjin Feng , Lijun Lu , Li Qi

Automatic tumor segmentation is a crucial step in medical image analysis for computer-aided diagnosis. Although the existing methods based on convolutional neural networks (CNNs) have achieved the state-of-the-art performance, many…

Image and Video Processing · Electrical Eng. & Systems 2020-05-11 Shuchao Pang , Anan Du , Mehmet A. Orgun , Yan Wang , Quanzheng Sheng , Shoujin Wang , Xiaoshui Huang , Zhemei Yu

Medical Hyperspectral Imaging (MHSI) has emerged as a promising tool for enhanced disease diagnosis, particularly in computational pathology, offering rich spectral information that aids in identifying subtle biochemical properties of…

Computer Vision and Pattern Recognition · Computer Science 2025-07-10 Qing Zhang , Guoquan Pei , Yan Wang

Automatic pancreas segmentation in radiology images, eg., computed tomography (CT) and magnetic resonance imaging (MRI), is frequently required by computer-aided screening, diagnosis, and quantitative assessment. Yet pancreas is a…

Computer Vision and Pattern Recognition · Computer Science 2018-04-02 Jinzheng Cai , Le Lu , Fuyong Xing , Lin Yang

Currently, convolutional neural networks (CNN) (e.g., U-Net) have become the de facto standard and attained immense success in medical image segmentation. However, as a downside, CNN based methods are a double-edged sword as they fail to…

Image and Video Processing · Electrical Eng. & Systems 2022-04-01 Reza Azad , Moein Heidari , Yuli Wu , Dorit Merhof

Medical image segmentation leverages topological connectivity theory to enhance edge precision and regional consistency. However, existing deep networks integrating connectivity often forcibly inject it as an additional feature module,…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Mingda Zhang , Xun Ye , Ruixiang Tang , Haiyan Ding

Convolutional neural networks (CNNs) excel in local feature extraction while Transformers are superior in processing global semantic information. By leveraging the strengths of both, hybrid Transformer-CNN networks have become the major…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Xu Ma , Mengsheng Chen , Junhui Zhang , Lijuan Song , Fang Du , Zhenhua Yu

Transformer, which can benefit from global (long-range) information modeling using self-attention mechanisms, has been successful in natural language processing and 2D image classification recently. However, both local and global features…

Computer Vision and Pattern Recognition · Computer Science 2021-06-29 Wenxuan Wang , Chen Chen , Meng Ding , Jiangyun Li , Hong Yu , Sen Zha

Accurate medical image segmentation plays a crucial role in overall diagnosis and is one of the most essential tasks in the diagnostic pipeline. CNN-based models, despite their extensive use, suffer from a local receptive field and fail to…

Image and Video Processing · Electrical Eng. & Systems 2025-10-02 Zulkaif Sajjad , Furqan Shaukat , Junaid Mir

Accurate medical image segmentation is essential for effective diagnosis and treatment planning but is often challenged by domain shifts caused by variations in imaging devices, acquisition conditions, and patient-specific attributes.…

Image and Video Processing · Electrical Eng. & Systems 2024-12-06 Jie Bao , Zhixin Zhou , Wen Jung Li , Rui Luo

The UNet architecture, based on Convolutional Neural Networks (CNN), has demonstrated its remarkable performance in medical image analysis. However, it faces challenges in capturing long-range dependencies due to the limited receptive…

Image and Video Processing · Electrical Eng. & Systems 2023-07-28 Liang Xu , Mingxiao Chen , Yi Cheng , Pengfei Shao , Shuwei Shen , Peng Yao , Ronald X. Xu

Transformer, the model of choice for natural language processing, has drawn scant attention from the medical imaging community. Given the ability to exploit long-term dependencies, transformers are promising to help atypical convolutional…

Computer Vision and Pattern Recognition · Computer Science 2022-02-07 Hong-Yu Zhou , Jiansen Guo , Yinghao Zhang , Lequan Yu , Liansheng Wang , Yizhou Yu

Identifying biomarkers in medical images is vital for a wide range of biotech applications. However, recent Transformer and CNN based methods often struggle with variations in morphology and staining, which limits their feature extraction…

Image and Video Processing · Electrical Eng. & Systems 2025-04-09 Saad Wazir , Daeyoung Kim

Transformers have made remarkable progress towards modeling long-range dependencies within the medical image analysis domain. However, current transformer-based models suffer from several disadvantages: (1) existing methods fail to capture…

Computer Vision and Pattern Recognition · Computer Science 2022-12-16 Chenyu You , Ruihan Zhao , Fenglin Liu , Siyuan Dong , Sandeep Chinchali , Ufuk Topcu , Lawrence Staib , James S. Duncan

This paper delves into the challenges and advancements in the field of medical image segmentation, particularly focusing on breast cancer diagnosis. The authors propose a novel Transformer-based segmentation model that addresses the…

Image and Video Processing · Electrical Eng. & Systems 2024-09-20 Weijie He , Runyuan Bao , Yiru Cang , Jianjun Wei , Yang Zhang , Jiacheng Hu

Medical image segmentation, a critical application of semantic segmentation in healthcare, has seen significant advancements through specialized computer vision techniques. While deep learning-based medical image segmentation is essential…

Computer Vision and Pattern Recognition · Computer Science 2024-09-13 Fuchen Zheng , Quanjun Li , Weixuan Li , Xuhang Chen , Yihang Dong , Guoheng Huang , Chi-Man Pun , Shoujun Zhou

The single image super-resolution(SISR) algorithms under deep learning currently have two main models, one based on convolutional neural networks and the other based on Transformer. The former uses the stacking of convolutional layers with…

Computer Vision and Pattern Recognition · Computer Science 2024-09-25 Li Ke , Liu Yukai