English
Related papers

Related papers: A Semantic-based Medical Image Fusion Approach

200 papers

The inability to interpret the model prediction in semantically and visually meaningful ways is a well-known shortcoming of most existing computer-aided diagnosis methods. In this paper, we propose MDNet to establish a direct multimodal…

Computer Vision and Pattern Recognition · Computer Science 2017-07-11 Zizhao Zhang , Yuanpu Xie , Fuyong Xing , Mason McGough , Lin Yang

Image fusion aims to combine information from different source images to create a comprehensively representative image. Existing fusion methods are typically helpless in dealing with degradations in low-quality source images and…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Xunpeng Yi , Han Xu , Hao Zhang , Linfeng Tang , Jiayi Ma

Multi-modal image fusion (MMIF) maps useful information from various modalities into the same representation space, thereby producing an informative fused image. However, the existing fusion algorithms tend to symmetrically fuse the…

Computer Vision and Pattern Recognition · Computer Science 2024-07-12 Jingxue Huang , Xilai Li , Tianshu Tan , Xiaosong Li , Tao Ye

The fusion techniques that utilize multiple feature sets to form new features that are often more robust and contain useful information for future processing are referred to as feature fusion. The term data fusion is applied to the class of…

Computer Vision and Pattern Recognition · Computer Science 2015-06-02 Alex Pappachen James , Belur Dasarathy

Multi-modality image fusion aims at fusing modality-specific (complementarity) and modality-shared (correlation) information from multiple source images. To tackle the problem of the neglect of inter-feature relationships, high-frequency…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Xiaoli Zhang , Liying Wang , Libo Zhao , Xiongfei Li , Siwei Ma

Multi-modal fusion approaches aim to integrate information from different data sources. Unlike natural datasets, such as in audio-visual applications, where samples consist of "paired" modalities, data in healthcare is often collected…

Image and Video Processing · Electrical Eng. & Systems 2023-03-03 Nasir Hayat , Krzysztof J. Geras , Farah E. Shamout

Accurate automatic medical image segmentation relies on high-quality, dense annotations, which are costly and time-consuming. Weakly supervised learning provides a more efficient alternative by leveraging sparse and coarse annotations…

Computer Vision and Pattern Recognition · Computer Science 2025-06-24 Dongdong Meng , Sheng Li , Hao Wu , Suqing Tian , Wenjun Ma , Guoping Wang , Xueqing Yan

Image Fusion is the process in which core information from a set of component images is merged to form a single image, which is more informative and complete than the component input images in quality and appearance. This paper presents a…

Computer Vision and Pattern Recognition · Computer Science 2014-07-16 Haritha Raveendran , Deepa Thomas

Multi-modal image fusion (MMIF) integrates valuable information from different modality images into a fused one. However, the fusion of multiple visible images with different focal regions and infrared images is a unprecedented challenge in…

Computer Vision and Pattern Recognition · Computer Science 2024-02-01 Xilai Li , Xiaosong Li , Tao Ye , Xiaoqi Cheng , Wuyang Liu , Haishu Tan

Traditional and deep learning-based fusion methods generated the intermediate decision map to obtain the fusion image through a series of post-processing procedures. However, the fusion results generated by these methods are easy to lose…

Computer Vision and Pattern Recognition · Computer Science 2021-04-21 Yongsheng Zang , Dongming Zhou , Changcheng Wang , Rencan Nie , Yanbu Guo

Deep learning-based image fusion approaches have obtained wide attention in recent years, achieving promising performance in terms of visual perception. However, the fusion module in the current deep learning-based methods suffers from two…

Computer Vision and Pattern Recognition · Computer Science 2022-02-01 Dongyu Rao , Xiao-Jun Wu , Tianyang Xu , Guoyang Chen

Until now, of highest relevance for remote sensing data processing and analysis have been techniques for pixel level image fusion. So, This paper attempts to undertake the study of Feature-Level based image fusion. For this purpose, feature…

Computer Vision and Pattern Recognition · Computer Science 2012-09-18 Firouz Abdullah Al-Wassai , N. V. Kalyankar , Ali A. Al-Zaky

Scene depth information can help visual information for more accurate semantic segmentation. However, how to effectively integrate multi-modality information into representative features is still an open problem. Most of the existing work…

Computer Vision and Pattern Recognition · Computer Science 2021-05-11 Yuejiao Su , Yuan Yuan , Zhiyu Jiang

Multi-modal magnetic resonance imaging (MRI) is essential in clinics for comprehensive diagnosis and surgical planning. Nevertheless, the segmentation of multi-modal MR images tends to be time-consuming and challenging. Convolutional neural…

Image and Video Processing · Electrical Eng. & Systems 2019-08-07 Cheng Li , Hui Sun , Zaiyi Liu , Meiyun Wang , Hairong Zheng , Shanshan Wang

RGB and thermal image fusion have great potential to exhibit improved semantic segmentation in low-illumination conditions. Existing methods typically employ a two-branch encoder framework for multimodal feature extraction and design…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Zhengwen Shen , Yulian Li , Han Zhang , Yuchen Weng , Jun Wang

Photoacoustic tomography (PAT) offers optical contrast, whereas magnetic resonance imaging (MRI) excels in imaging soft tissue and organ anatomy. The fusion of PAT with MRI holds promising application prospects due to their complementary…

Image and Video Processing · Electrical Eng. & Systems 2025-03-20 Yutian Zhong , Jinchuan He , Zhichao Liang , Shuangyang Zhang , Qianjin Feng , Lijun Lu , Li Qi

Multi-modality image fusion is a technique that combines information from different sensors or modalities, enabling the fused image to retain complementary features from each modality, such as functional highlights and texture details.…

Computer Vision and Pattern Recognition · Computer Science 2024-04-17 Zixiang Zhao , Haowen Bai , Jiangshe Zhang , Yulun Zhang , Kai Zhang , Shuang Xu , Dongdong Chen , Radu Timofte , Luc Van Gool

The rapid development of diagnostic technologies in healthcare is leading to higher requirements for physicians to handle and integrate the heterogeneous, yet complementary data that are produced during routine practice. For instance, the…

Machine Learning · Computer Science 2023-01-30 Can Cui , Haichun Yang , Yaohong Wang , Shilin Zhao , Zuhayr Asad , Lori A. Coburn , Keith T. Wilson , Bennett A. Landman , Yuankai Huo

Multimodal information processing has become increasingly important for enhancing image classification performance. However, the intricate and implicit dependencies across different modalities often hinder conventional methods from…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Yang Qiao , Xiaoyu Zhong , Xiaofeng Gu , Zhiguo Yu

An image fusion method based on salient features is proposed in this paper. In this work, we have concentrated on salient features of the image for fusion in order to preserve all relevant information contained in the input images and tried…

Computer Vision and Pattern Recognition · Computer Science 2013-12-06 Sourav Pramanik , Debotosh Bhattacharjee