English
Related papers

Related papers: Disentangle, align and fuse for multimodal and sem…

200 papers

MR imaging is a valuable diagnostic tool allowing to non-invasively visualize patient anatomy and pathology with high soft-tissue contrast. However, MRI acquisition is typically time-consuming, leading to patient discomfort and increased…

Image and Video Processing · Electrical Eng. & Systems 2025-12-23 Jan Nikolas Morshuis , Matthias Hein , Christian F. Baumgartner

Dealing with missing modalities in Magnetic Resonance Imaging (MRI) and overcoming their negative repercussions is considered a hurdle in biomedical imaging. The combination of a specified set of modalities, which is selected depending on…

Image and Video Processing · Electrical Eng. & Systems 2022-03-15 Reza Azad , Nika Khosravi , Mohammad Dehghanmanshadi , Julien Cohen-Adad , Dorit Merhof

In clinical practice, multi-modal magnetic resonance imaging (MRI) with different contrasts is usually acquired in a single study to assess different properties of the same region of interest in the human body. The whole acquisition process…

Image and Video Processing · Electrical Eng. & Systems 2022-04-05 Kai Xuan , Lei Xiang , Xiaoqian Huang , Lichi Zhang , Shu Liao , Dinggang Shen , Qian Wang

In the field of multimodal segmentation, the correlation between different modalities can be considered for improving the segmentation results. In this paper, we propose a multi-modality segmentation network with a correlation constraint.…

Image and Video Processing · Electrical Eng. & Systems 2021-02-08 Tongxue Zhou , Stéphane Canu , Pierre Vera , Su Ruan

Recently, machine learning-based semantic segmentation algorithms have demonstrated their potential to accurately segment regions and contours in medical images, allowing the precise location of anatomical structures and abnormalities.…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Yifei Wang , Chuhong Zhu

The intricate morphology of brain vessels poses significant challenges for automatic segmentation models, which usually focus on a single imaging modality. However, accurately treating brain-related conditions requires a comprehensive…

Computer Vision and Pattern Recognition · Computer Science 2025-10-03 Francesco Galati , Daniele Falcetta , Rosa Cortese , Ferran Prados , Ninon Burgos , Maria A. Zuluaga

Cross-modal medical image segmentation presents a significant challenge, as different imaging modalities produce images with varying resolutions, contrasts, and appearances of anatomical structures. We introduce compositionality as an…

Computer Vision and Pattern Recognition · Computer Science 2024-08-22 Aniek Eijpe , Valentina Corbetta , Kalina Chupetlovska , Regina Beets-Tan , Wilson Silva

Medical image segmentation of tumors and organs at risk is a time-consuming yet critical process in the clinic that utilizes multi-modality imaging (e.g, different acquisitions, data types, and sequences) to increase segmentation precision.…

Image and Video Processing · Electrical Eng. & Systems 2023-06-07 Qisheng He , Nicholas Summerfield , Ming Dong , Carri Glide-Hurst

Multimodal pathological images are usually in clinical diagnosis, but computer vision-based multimodal image-assisted diagnosis faces challenges with modality fusion, especially in the absence of expert-annotated data. To achieve the…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Qinghua Lin , Guang-Hai Liu , Zuoyong Li , Yang Li , Yuting Jiang , Xiang Wu

The Segment Anything Model (SAM) exhibits a capability to segment a wide array of objects in natural images, serving as a versatile perceptual tool for various downstream image segmentation tasks. In contrast, medical image segmentation…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Yizhe Zhang , Tao Zhou , Shuo Wang , Ye Wu , Pengfei Gu , Danny Z. Chen

Leveraging information across diverse modalities is known to enhance performance on multimodal segmentation tasks. However, effectively fusing information from different modalities remains challenging due to the unique characteristics of…

Computer Vision and Pattern Recognition · Computer Science 2024-04-22 Md Kaykobad Reza , Ashley Prater-Bennette , M. Salman Asif

In the past ten years, with the help of deep learning, especially the rapid development of deep neural networks, medical image analysis has made remarkable progress. However, how to effectively use the relational information between various…

Computer Vision and Pattern Recognition · Computer Science 2023-03-29 Zhihua Liu

Owing to a large amount of multi-modal data in modern medical systems, such as medical images and reports, Medical Vision-Language Pre-training (Med-VLP) has demonstrated incredible achievements in coarse-grained downstream tasks (i.e.,…

Computer Vision and Pattern Recognition · Computer Science 2024-09-05 Weiwei Tian , Xinyu Huang , Junlin Hou , Caiyue Ren , Longquan Jiang , Rui-Wei Zhao , Gang Jin , Yuejie Zhang , Daoying Geng

Multi-modal medical image segmentation plays an essential role in clinical diagnosis. It remains challenging as the input modalities are often not well-aligned spatially. Existing learning-based methods mainly consider sharing trainable…

Computer Vision and Pattern Recognition · Computer Science 2021-01-06 Jingkun Chen , Wenqi Li , Hongwei Li , Jianguo Zhang

Brain tumor segmentation remains a significant challenge, particularly in the context of multi-modal magnetic resonance imaging (MRI) where missing modality images are common in clinical settings, leading to reduced segmentation accuracy.…

Image and Video Processing · Electrical Eng. & Systems 2024-06-14 Zhongao Sun , Jiameng Li , Yuhan Wang , Jiarong Cheng , Qing Zhou , Chun Li

Accurate brain tumor segmentation from Magnetic Resonance Imaging (MRI) is desirable to joint learning of multimodal images. However, in clinical practice, it is not always possible to acquire a complete set of MRIs, and the problem of…

Image and Video Processing · Electrical Eng. & Systems 2022-08-05 Yao Zhang , Nanjun He , Jiawei Yang , Yuexiang Li , Dong Wei , Yawen Huang , Yang Zhang , Zhiqiang He , Yefeng Zheng

Motion artifacts caused by prolonged acquisition time are a significant challenge in Magnetic Resonance Imaging (MRI), hindering accurate tissue segmentation. These artifacts appear as blurred images that mimic tissue-like appearances,…

Image and Video Processing · Electrical Eng. & Systems 2024-12-06 Sunyoung Jung , Yoonseok Choi , Mohammed A. Al-masni , Minyoung Jung , Dong-Hyun Kim

The task of labeling multiple organs for segmentation is a complex and time-consuming process, resulting in a scarcity of comprehensively labeled multi-organ datasets while the emergence of numerous partially labeled datasets. Current…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Xiaoyu Liu , Linhao Qu , Ziyue Xie , Yonghong Shi , Zhijian Song

Deep learning models such as convolutional neural net- work have been widely used in 3D biomedical segmentation and achieve state-of-the-art performance. However, most of them often adapt a single modality or stack multiple modalities as…

Computer Vision and Pattern Recognition · Computer Science 2017-04-26 Kuan-Lun Tseng , Yen-Liang Lin , Winston Hsu , Chung-Yang Huang

Brain tumor segmentation is often based on multiple magnetic resonance imaging (MRI). However, in clinical practice, certain modalities of MRI may be missing, which presents a more difficult scenario. To cope with this challenge, Knowledge…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Tianyi Liu , Zhaorui Tan , Muyin Chen , Xi Yang , Haochuan Jiang , Kaizhu Huang