English
Related papers

Related papers: A Semantic-based Medical Image Fusion Approach

200 papers

Medical image segmentation is vital to the area of medical imaging because it enables professionals to more accurately examine and understand the information offered by different imaging modalities. The technique of splitting a medical…

Image and Video Processing · Electrical Eng. & Systems 2024-09-01 Aitik Gupta , Joydip Dhar

Deep Unfolding Network-based methods have emerged as effective solutions for multi-source image fusion by combining model-driven iterative optimization with data-driven deep learning. However, most existing deep unfolding image fusion…

Image and Video Processing · Electrical Eng. & Systems 2026-05-04 Ge Luo , Jun-Jie Huang , Qi Yu , Tianrui Liu , Ke Liang , Yuming Xiang , Wentao Zhao , Xinwang Liu , Meng Wang

Integrating multi-modal data to promote medical image analysis has recently gained great attention. This paper presents a novel scheme to learn the mutual benefits of different modalities to achieve better segmentation results for unpaired…

Computer Vision and Pattern Recognition · Computer Science 2023-05-02 Jie Yang , Ye Zhu , Chaoqun Wang , Zhen Li , Ruimao Zhang

Precise medical image segmentation is fundamental for enabling computer aided diagnosis and effective treatment planning. Traditional models that rely solely on visual features often struggle when confronted with ambiguous or low contrast…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Ashfak Yeafi , Parthaw Goswami , Md Khairul Islam , Ashifa Islam Shamme

With the rapid development of the Internet and social media, multi-modal data (text and image) is increasingly important in sentiment analysis tasks. However, the existing methods are difficult to effectively fuse text and image features,…

Computation and Language · Computer Science 2024-12-06 JiaLe Ren

Multi-modality image fusion and segmentation play a vital role in autonomous driving and robotic operation. Early efforts focus on boosting the performance for only one task, \emph{e.g.,} fusion or segmentation, making it hard to…

Computer Vision and Pattern Recognition · Computer Science 2023-08-07 Jinyuan Liu , Zhu Liu , Guanyao Wu , Long Ma , Risheng Liu , Wei Zhong , Zhongxuan Luo , Xin Fan

Due to the difficulty of automatically mapping visual features with semantic descriptors, state-of-the-art frameworks have exhibited poor performance in terms of coverage and effectiveness for indexing the visual content. This prompted us…

Multimedia · Computer Science 2020-04-28 M. Belkhatir

Cross modal image syntheses is gaining significant interests for its ability to estimate target images of a different modality from a given set of source images,like estimating MR to MR, MR to CT, CT to PET etc, without the need for an…

Computer Vision and Pattern Recognition · Computer Science 2018-07-02 Deepa Gunashekar , Sailesh Conjeti , Abhijit Guha Roy , Nassir Navab , Kuangyu Shi

Automatically segmenting infected areas in radiological images is essential for diagnosing pulmonary infectious diseases. Recent studies have demonstrated that the accuracy of the medical image segmentation can be improved by incorporating…

Computer Vision and Pattern Recognition · Computer Science 2025-09-25 Bo Yu , Jianhua Yang , Zetao Du , Yan Huang , Chenglong Li , Liang Wang

Image fusion aims to synthesize a single high-quality image from a pair of inputs captured under challenging conditions, such as differing exposure levels or focal depths. A core challenge lies in effectively handling disparities in dynamic…

Computer Vision and Pattern Recognition · Computer Science 2025-12-24 Mingwei Tang , Jiahao Nie , Guang Yang , Ziqing Cui , Jie Li

We propose a method called integrated diffusion for combining multimodal datasets, or data gathered via several different measurements on the same system, to create a joint data diffusion operator. As real world data suffers from both local…

Machine Learning · Computer Science 2022-03-07 Manik Kuchroo , Abhinav Godavarthi , Alexander Tong , Guy Wolf , Smita Krishnaswamy

Fusing multi-modal data can improve the performance of deep learning models. However, missing modalities are common for medical data due to patients' specificity, which is detrimental to the performance of multi-modal models in…

Image and Video Processing · Electrical Eng. & Systems 2023-09-28 Muyu Wang , Shiyu Fan , Yichen Li , Hui Chen

In this paper, we propose a similarity-aware fusion network (SAFNet) to adaptively fuse 2D images and 3D point clouds for 3D semantic segmentation. Existing fusion-based methods achieve remarkable performances by integrating information…

Computer Vision and Pattern Recognition · Computer Science 2021-07-20 Linqing Zhao , Jiwen Lu , Jie Zhou

The recent integration of artificial intelligence into medical imaging has driven remarkable advances in automated organ segmentation. However, most existing 3D segmentation frameworks rely exclusively on visual learning from large…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Hasan Faraz Khan , Noor Fatima , Muzammil Behzad

Models for semantic segmentation require a large amount of hand-labeled training data which is costly and time-consuming to produce. For this purpose, we present a label fusion framework that is capable of improving semantic pixel labels of…

Computer Vision and Pattern Recognition · Computer Science 2022-02-25 Florian Fervers , Timo Breuer , Gregor Stachowiak , Sebastian Bullinger , Christoph Bodensteiner , Michael Arens

Accurate segmentation of anatomical structures and abnormalities in medical images is crucial for computer-aided diagnosis and analysis. While deep learning techniques excel at this task, their computational demands pose challenges.…

Image and Video Processing · Electrical Eng. & Systems 2024-09-24 Syed Javed , Tariq M. Khan , Abdul Qayyum , Hamid Alinejad-Rokny , Arcot Sowmya , Imran Razzak

Deep learning models, such as the fully convolutional network (FCN), have been widely used in 3D biomedical segmentation and achieved state-of-the-art performance. Multiple modalities are often used for disease diagnosis and quantification.…

Image and Video Processing · Electrical Eng. & Systems 2019-08-23 Yu Chen , Jiawei Chen , Dong Wei , Yuexiang Li , Yefeng Zheng

In recent years, U-Net and its variants have been widely used in pathology image segmentation tasks. One of the key designs of U-Net is the use of skip connections between the encoder and decoder, which helps to recover detailed information…

Image and Video Processing · Electrical Eng. & Systems 2023-10-18 Zongyi Li , Hongbing Lyu , Jun Wang

Deep learning models for semantic segmentation of images require large amounts of data. In the medical imaging domain, acquiring sufficient data is a significant challenge. Labeling medical image data requires expert knowledge.…

Machine Learning · Computer Science 2018-10-24 Micah J Sheller , G Anthony Reina , Brandon Edwards , Jason Martin , Spyridon Bakas

Despite recent progress on semantic segmentation, there still exist huge challenges in medical ultra-resolution image segmentation. The methods based on multi-branch structure can make a good balance between computational burdens and…

Computer Vision and Pattern Recognition · Computer Science 2020-02-20 Tong Wu , Yuan Xie , Yanyun Qu , Bicheng Dai , Shuxin Chen