English
Related papers

Related papers: Fuse4Seg: Image Fusion for Multi-Modal Medical Seg…

200 papers

Our work tackles the fundamental challenge of image segmentation in computer vision, which is crucial for diverse applications. While supervised methods demonstrate proficiency, their reliance on extensive pixel-level annotations limits…

Computer Vision and Pattern Recognition · Computer Science 2024-11-11 Boujemaa Guermazi , Naimul Khan

Modern semantic segmentation frameworks usually combine low-level and high-level features from pre-trained backbone convolutional models to boost performance. In this paper, we first point out that a simple fusion of low-level and…

Computer Vision and Pattern Recognition · Computer Science 2018-04-12 Zhenli Zhang , Xiangyu Zhang , Chao Peng , Dazhi Cheng , Jian Sun

Three-dimensional medical image segmentation is a fundamental yet computationally demanding task due to the cubic growth of voxel processing and the redundant computation on homogeneous regions. To address these limitations, we propose…

Computer Vision and Pattern Recognition · Computer Science 2026-01-09 Sen Zeng , Hong Zhou , Zheng Zhu , Yang Liu

Medical Hyperspectral Imaging (MHSI) has emerged as a promising tool for enhanced disease diagnosis, particularly in computational pathology, offering rich spectral information that aids in identifying subtle biochemical properties of…

Computer Vision and Pattern Recognition · Computer Science 2025-07-10 Qing Zhang , Guoquan Pei , Yan Wang

Multi-parametric magnetic resonance (MR) imaging is an indispensable tool in the clinic. Consequently, automatic volume-of-interest segmentation based on multi-parametric MR imaging is crucial for computer-aided disease diagnosis, treatment…

Image and Video Processing · Electrical Eng. & Systems 2022-11-17 Cheng Li , Yousuf Babiker M. Osman , Weijian Huang , Zhenzhen Xue , Hua Han , Hairong Zheng , Shanshan Wang

Advanced image fusion methods are devoted to generating the fusion results by aggregating the complementary information conveyed by the source images. However, the difference in the source-specific manifestation of the imaged scene content…

Computer Vision and Pattern Recognition · Computer Science 2024-02-09 Chunyang Cheng , Tianyang Xu , Xiao-Jun Wu , Hui Li , Xi Li , Zhangyong Tang , Josef Kittler

Infrared and visible image fusion has garnered considerable attention owing to the strong complementarity of these two modalities in complex, harsh environments. While deep learning-based fusion methods have made remarkable advances in…

Computer Vision and Pattern Recognition · Computer Science 2025-09-17 Guihui Li , Bowei Dong , Kaizhi Dong , Jiayi Li , Haiyong Zheng

There is a key problem in the medical visual question answering task that how to effectively realize the feature fusion of language and medical images with limited datasets. In order to better utilize multi-scale information of medical…

Computer Vision and Pattern Recognition · Computer Science 2022-11-14 Shanshan Song , Jiangyun Li , Jing Wang , Yuanxiu Cai , Wenkai Dong

Recently, developing unified medical image segmentation models gains increasing attention, especially with the advent of the Segment Anything Model (SAM). SAM has shown promising binary segmentation performance in natural domains, however,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-18 Shuangping Huang , Hao Liang , Qingfeng Wang , Chulong Zhong , Zijian Zhou , Miaojing Shi

Multimodal models have achieved remarkable success in natural image segmentation, yet they often underperform when applied to the medical domain. Through extensive study, we attribute this performance gap to the challenges of multimodal…

Computer Vision and Pattern Recognition · Computer Science 2025-09-11 Wenjun Yu , Yinchen Zhou , Jia-Xuan Jiang , Shubin Zeng , Yuee Li , Zhong Wang

Recently, machine learning-based semantic segmentation algorithms have demonstrated their potential to accurately segment regions and contours in medical images, allowing the precise location of anatomical structures and abnormalities.…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Yifei Wang , Chuhong Zhu

Multimodal medical image fusion facilitates comprehensive diagnosis by aggregating complementary structural and functional information, but its effectiveness is limited by resolution degradation and modality discrepancies. Existing…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Fayaz Ali Dharejo , Sharif S. M. A. , Aiman Khalil , Nachiket Chaudhary , Rizwan Ali Naqvi , Radu Timofte

Multimodal 3D MRI brain tumor segmentation is a pivotal step in radiotherapy target delineation, surgical planning and post-treatment assessment. Existing methods often assume artifact-free MRI images. However, inevitable patient motion…

Image and Video Processing · Electrical Eng. & Systems 2026-05-18 Yuchun Wang , Xiaosong Li , Gefei Liang , Yang Liu

In recent years, Fully Convolutional Networks (FCN) has been widely used in various semantic segmentation tasks, including multi-modal remote sensing imagery. How to fuse multi-modal data to improve the segmentation performance has always…

Computer Vision and Pattern Recognition · Computer Science 2018-07-25 Shihao Sun , Lei Yang , Wenjie Liu , Ruirui Li

In clinical practice, tri-modal medical image fusion, compared to the existing dual-modal technique, can provide a more comprehensive view of the lesions, aiding physicians in evaluating the disease's shape, location, and biological…

Image and Video Processing · Electrical Eng. & Systems 2024-10-16 Yushen Xu , Xiaosong Li , Yuchan Jie , Haishu Tan

As a fundamental task in computer vision, semantic segmentation is widely applied in fields such as autonomous driving, remote sensing image analysis, and medical image processing. In recent years, Transformer-based segmentation methods…

Computer Vision and Pattern Recognition · Computer Science 2025-03-31 Tai An , Weiqiang Huang , Da Xu , Qingyuan He , Jiacheng Hu , Yujia Lou

Combining images from multi-modalities is beneficial to explore various information in computer vision, especially in the medical domain. As an essential part of clinical diagnosis, multi-modal brain tumor segmentation aims to delineate the…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Zhongzhen Huang , Linda Wei , Shaoting Zhang , Xiaofan Zhang

In this technical study, we introduce VFusedSeg3D, an innovative multi-modal fusion system created by the VisionRD team that combines camera and LiDAR data to significantly enhance the accuracy of 3D perception. VFusedSeg3D uses the rich…

Computer Vision and Pattern Recognition · Computer Science 2024-08-29 Osama Amjad , Ammad Nadeem

Medical image synthesis is crucial for alleviating data scarcity and privacy constraints. However, fine-tuning general text-to-image (T2I) models remains challenging, mainly due to the significant modality gap between complex visual details…

Computer Vision and Pattern Recognition · Computer Science 2026-03-12 Xin Huang , Junjie Liang , Qingshan Hou , Peng Cao , Jinzhu Yang , Xiaoli Liu , Osmar R. Zaiane

Open-vocabulary segmentation enables pixel-level recognition from an open set of textual categories, allowing generalization beyond fixed classes. Despite great potential in remote sensing, progress in this area remains largely limited to…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Yimin Wei , Aoran Xiao , Hongruixuan Chen , Junshi Xia , Naoto Yokoya