English
Related papers

Related papers: Medical Image Segmentation Based on Multi-Modal Co…

200 papers

Dealing with missing modalities in Magnetic Resonance Imaging (MRI) and overcoming their negative repercussions is considered a hurdle in biomedical imaging. The combination of a specified set of modalities, which is selected depending on…

Image and Video Processing · Electrical Eng. & Systems 2022-03-15 Reza Azad , Nika Khosravi , Mohammad Dehghanmanshadi , Julien Cohen-Adad , Dorit Merhof

Segmentation of nasopharyngeal carcinoma (NPC) from Magnetic Resonance Images (MRI) is a crucial prerequisite for NPC radiotherapy. However, manually segmenting of NPC is time-consuming and labor-intensive. Additionally, single-modality MRI…

Computer Vision and Pattern Recognition · Computer Science 2019-10-23 Huai Chen , Yuxiao Qi , Yong Yin , Tengxiang Li , Xiaoqing Liu , Xiuli Li , Guanzhong Gong , Lisheng Wang

In recent years, the research community has shown a lot of interest to panoramic images that offer a 360-degree directional perspective. Multiple data modalities can be fed, and complimentary characteristics can be utilized for more robust…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Suresh Guttikonda , Jason Rambach

Deep learning has shown promising contributions in medical image segmentation with powerful learning and feature representation abilities. However, it has limitations for reasoning with and combining imperfect (imprecise, uncertain, and…

Computer Vision and Pattern Recognition · Computer Science 2023-09-13 Ling Huang

Different modalities of medical images provide unique physiological and anatomical information for diseases. Multi-modal medical image fusion integrates useful information from different complementary medical images with different…

Computer Vision and Pattern Recognition · Computer Science 2025-09-12 Yushen Xu , Xiaosong Li , Yuchun Wang , Xiaoqi Cheng , Huafeng Li , Haishu Tan

Infrared and visible image fusion aims to utilize the complementary information from two modalities to generate fused images with prominent targets and rich texture details. Most existing algorithms only perform pixel-level or feature-level…

Computer Vision and Pattern Recognition · Computer Science 2024-10-31 Kun Hu , Qingle Zhang , Maoxun Yuan , Yitian Zhang

Automatic segmentation of multi-sequence (multi-modal) cardiac MR (CMR) images plays a significant role in diagnosis and management for a variety of cardiac diseases. However, the performance of relevant algorithms is significantly affected…

Image and Video Processing · Electrical Eng. & Systems 2020-09-08 Haochuan Jiang , Chengjia Wang , Agisilaos Chartsias , Sotirios A. Tsaftaris

This study proposes a novel perspective on multimodal deep learning for biomedical signal classification, systematically analyzing how complementary feature domains impact model performance. While fusing multiple domains often presumes…

Machine Learning · Computer Science 2025-08-05 Timothy Oladunni , Alex Wong

In this paper, we introduce a novel semi-supervised learning framework tailored for medical image segmentation. Central to our approach is the innovative Multi-scale Text-aware ViT-CNN Fusion scheme. This scheme adeptly combines the…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 Yixing Lu , Zhaoxin Fan , Min Xu

Current medical image segmentation approaches have limitations in deeply exploring multi-scale information and effectively combining local detail textures with global contextual semantic information. This results in over-segmentation,…

Computer Vision and Pattern Recognition · Computer Science 2025-01-08 Zhenkun Lu , Chaoyin She , Wei Wang , Qinghua Huang

The 3D scene understanding is mainly considered as a crucial requirement in computer vision and robotics applications. One of the high-level tasks in 3D scene understanding is semantic segmentation of RGB-Depth images. With the availability…

Computer Vision and Pattern Recognition · Computer Science 2019-12-30 Fahimeh Fooladgar , Shohreh Kasaei

Automated segmentation is a fundamental medical image analysis task, which enjoys significant advances due to the advent of deep learning. While foundation models have been useful in natural language processing and some vision tasks for…

Computer Vision and Pattern Recognition · Computer Science 2025-05-12 Hanxue Gu , Haoyu Dong , Jichen Yang , Maciej A. Mazurowski

Medical image segmentation is crucial for accurate clinical diagnoses, yet it faces challenges such as low contrast between lesions and normal tissues, unclear boundaries, and high variability across patients. Deep learning has improved…

Image and Video Processing · Electrical Eng. & Systems 2024-12-09 Houze Liu , Tong Zhou , Yanlin Xiang , Aoran Shen , Jiacheng Hu , Junliang Du

Multimodal medical image fusion integrates complementary information from different imaging modalities to enhance diagnostic accuracy and treatment planning. While deep learning methods have advanced performance, existing approaches face…

Image and Video Processing · Electrical Eng. & Systems 2025-08-06 Meng Zhou , Farzad Khalvati

We present a cross-modality generation framework that learns to generate translated modalities from given modalities in MR images without real acquisition. Our proposed method performs NeuroImage-to-NeuroImage translation (abbreviated as…

Computer Vision and Pattern Recognition · Computer Science 2018-09-12 Qianye Yang , Nannan Li , Zixu Zhao , Xingyu Fan , Eric I-Chao Chang , Yan Xu

Even though convolutional neural networks (CNNs) are driving progress in medical image segmentation, standard models still have some drawbacks. First, the use of multi-scale approaches, i.e., encoder-decoder architectures, leads to a…

Computer Vision and Pattern Recognition · Computer Science 2020-02-18 Ashish Sinha , Jose Dolz

Like other applications in computer vision, medical image segmentation has been most successfully addressed using deep learning models that rely on the convolution operation as their main building block. Convolutions enjoy important…

Image and Video Processing · Electrical Eng. & Systems 2022-04-05 Davood Karimi , Serge Vasylechko , Ali Gholipour

Magnetic resonance imaging (MRI) image segmentation is crucial in diagnosing and treating many diseases, such as brain tumors. Existing MRI image segmentation methods mainly fall into a centralized multimodal paradigm, which is inapplicable…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Guyue Hu , Siyuan Song , Jingpeng Sun , Zhe Jin , Chenglong Li , Jin Tang

Magnetic resonance imaging (MRI) is a widely used neuroimaging technique that can provide images of different contrasts (i.e., modalities). Fusing this multi-modal data has proven particularly effective for boosting model performance in…

Computer Vision and Pattern Recognition · Computer Science 2020-02-13 Tao Zhou , Huazhu Fu , Geng Chen , Jianbing Shen , Ling Shao

This paper proposes a novel multimodal fusion approach, aiming to produce best possible decisions by integrating information coming from multiple media. While most of the past multimodal approaches either work by projecting the features of…

Artificial Intelligence · Computer Science 2018-08-23 Valentin Vielzeuf , Alexis Lechervy , Stéphane Pateux , Frédéric Jurie