English
Related papers

Related papers: Fuse4Seg: Image Fusion for Multi-Modal Medical Seg…

200 papers

Medical image segmentation - the prerequisite of numerous clinical needs - has been significantly prospered by recent advances in convolutional neural networks (CNNs). However, it exhibits general limitations on modeling explicit long-range…

Computer Vision and Pattern Recognition · Computer Science 2021-07-13 Yundong Zhang , Huiye Liu , Qiang Hu

The recent integration of artificial intelligence into medical imaging has driven remarkable advances in automated organ segmentation. However, most existing 3D segmentation frameworks rely exclusively on visual learning from large…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Hasan Faraz Khan , Noor Fatima , Muzammil Behzad

LiDAR and camera fusion techniques are promising for achieving 3D object detection in autonomous driving. Most multi-modal 3D object detection frameworks integrate semantic knowledge from 2D images into 3D LiDAR point clouds to enhance…

Computer Vision and Pattern Recognition · Computer Science 2023-06-21 Shaoqing Xu , Fang Li , Ziying Song , Jin Fang , Sifen Wang , Zhi-Xin Yang

In recent years, the research community has shown a lot of interest to panoramic images that offer a 360-degree directional perspective. Multiple data modalities can be fed, and complimentary characteristics can be utilized for more robust…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Suresh Guttikonda , Jason Rambach

Conventional 3D medical image segmentation methods typically require learning heavy 3D networks (e.g., 3D-UNet), as well as large amounts of in-domain data with accurate pixel/voxel-level labels to avoid overfitting. These solutions are…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Meng Zheng , Benjamin Planche , Zhongpai Gao , Terrence Chen , Richard J. Radke , Ziyan Wu

LiDAR and camera are two modalities available for 3D semantic segmentation in autonomous driving. The popular LiDAR-only methods severely suffer from inferior segmentation on small and distant objects due to insufficient laser points, while…

Computer Vision and Pattern Recognition · Computer Science 2023-03-16 Jiale Li , Hang Dai , Hao Han , Yong Ding

Image fusion methods and metrics for their evaluation have conventionally used pixel-based or low-level features. However, for many applications, the aim of image fusion is to effectively combine the semantic content of the input images.…

Computer Vision and Pattern Recognition · Computer Science 2021-10-14 P. R. Hill , D. R. Bull

Medical image segmentation plays a crucial role in assisting healthcare professionals with accurate diagnoses and enabling automated diagnostic processes. Traditional convolutional neural networks (CNNs) often struggle with capturing…

Computer Vision and Pattern Recognition · Computer Science 2025-02-17 Phuong-Nam Tran , Nhat Truong Pham , Duc Ngoc Minh Dang , Eui-Nam Huh , Choong Seon Hong

Multimodal learning leverages complementary information derived from different modalities, thereby enhancing performance in medical image segmentation. However, prevailing multimodal learning methods heavily rely on extensive well-annotated…

Computer Vision and Pattern Recognition · Computer Science 2024-09-05 Xiaogen Zhou , Yiyou Sun , Min Deng , Winnie Chiu Wing Chu , Qi Dou

Accurate and efficient 3D medical image segmentation is essential for clinical AI, where models must remain reliable under stringent memory, latency, and data availability constraints. Transformer-based methods achieve strong accuracy but…

Machine Learning · Computer Science 2026-03-10 Kavyansh Tyagi , Vishwas Rathi , Puneet Goyal

Semantic segmentation serves as a cornerstone of scene understanding in autonomous driving but continues to face significant challenges under complex conditions such as occlusion. Light field and LiDAR modalities provide complementary…

Computer Vision and Pattern Recognition · Computer Science 2026-04-16 Jie Luo , Yuxuan Jiang , Xin Jin , Mingyu Liu , Yihui Fan

Automatic segmentation of medical images based on multi-modality is an important topic for disease diagnosis. Although the convolutional neural network (CNN) has been proven to have excellent performance in image segmentation tasks, it is…

Computer Vision and Pattern Recognition · Computer Science 2022-04-27 Xuejian Li , Shiqiang Ma , Jijun Tang , Fei Guo

Different modalities of medical images provide unique physiological and anatomical information for diseases. Multi-modal medical image fusion integrates useful information from different complementary medical images with different…

Computer Vision and Pattern Recognition · Computer Science 2025-09-12 Yushen Xu , Xiaosong Li , Yuchun Wang , Xiaoqi Cheng , Huafeng Li , Haishu Tan

Medical image segmentation remains challenging due to limited annotations for training, ambiguous anatomical features, and domain shifts. While vision-language models such as CLIP offer strong cross-modal representations, their potential…

Computer Vision and Pattern Recognition · Computer Science 2026-02-25 Taha Koleilat , Hojat Asgariandehkordi , Omid Nejati Manzari , Berardino Barile , Yiming Xiao , Hassan Rivaz

Despite recent progress on semantic segmentation, there still exist huge challenges in medical ultra-resolution image segmentation. The methods based on multi-branch structure can make a good balance between computational burdens and…

Computer Vision and Pattern Recognition · Computer Science 2020-02-20 Tong Wu , Yuan Xie , Yanyun Qu , Bicheng Dai , Shuxin Chen

Deep neural networks have evolved as the leading approach in 3D medical image segmentation due to their outstanding performance. However, the ever-increasing model size and computation cost of deep neural networks have become the primary…

Computer Vision and Pattern Recognition · Computer Science 2025-02-20 Boqian Wu , Qiao Xiao , Shiwei Liu , Lu Yin , Mykola Pechenizkiy , Decebal Constantin Mocanu , Maurice Van Keulen , Elena Mocanu

Multi-modal magnetic resonance imaging (MRI) is essential in clinics for comprehensive diagnosis and surgical planning. Nevertheless, the segmentation of multi-modal MR images tends to be time-consuming and challenging. Convolutional neural…

Image and Video Processing · Electrical Eng. & Systems 2019-08-07 Cheng Li , Hui Sun , Zaiyi Liu , Meiyun Wang , Hairong Zheng , Shanshan Wang

Medical image segmentation has advanced rapidly over the past two decades, largely driven by deep learning, which has enabled accurate and efficient delineation of cells, tissues, organs, and pathologies across diverse imaging modalities.…

Image and Video Processing · Electrical Eng. & Systems 2025-08-29 Guoping Xu , Jayaram K. Udupa , Jax Luo , Songlin Zhao , Yajun Yu , Scott B. Raymond , Hao Peng , Lipeng Ning , Yogesh Rathi , Wei Liu , You Zhang

Accurate medical image segmentation is fundamental to precision medicine, yet robust delineation remains challenging under heterogeneous appearances, ambiguous boundaries, and large anatomical variability. Similar intensity and texture…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 Zhiquan Chen , Haitao Wang , Guowei Zou , Hejun Wu

Medical image segmentation plays a pivotal role in disease diagnosis and treatment planning, particularly in resource-constrained clinical settings where lightweight and generalizable models are urgently needed. However, existing…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Chengqi Dong , Fenghe Tang , Rongge Mao , Xinpei Gao , S. Kevin Zhou