English
Related papers

Related papers: Deep Learning based Multi-modal Computing with Fea…

200 papers

One often lacks sufficient annotated samples for training deep segmentation models. This is in particular the case for less common imaging modalities such as Quantitative Susceptibility Mapping (QSM). It has been shown that deep models tend…

Brain tumor segmentation remains a significant challenge, particularly in the context of multi-modal magnetic resonance imaging (MRI) where missing modality images are common in clinical settings, leading to reduced segmentation accuracy.…

Image and Video Processing · Electrical Eng. & Systems 2024-06-14 Zhongao Sun , Jiameng Li , Yuhan Wang , Jiarong Cheng , Qing Zhou , Chun Li

Multi-modality imaging is widely used in clinical practice and biomedical research to gain a comprehensive understanding of an imaging subject. Currently, multi-modality imaging is accomplished by post hoc fusion of independently…

Image and Video Processing · Electrical Eng. & Systems 2024-10-01 Lingting Zhu , Yizheng Chen , Lianli Liu , Lei Xing , Lequan Yu

Multi-modal medical image segmentation plays an essential role in clinical diagnosis. It remains challenging as the input modalities are often not well-aligned spatially. Existing learning-based methods mainly consider sharing trainable…

Computer Vision and Pattern Recognition · Computer Science 2021-01-06 Jingkun Chen , Wenqi Li , Hongwei Li , Jianguo Zhang

Multimodal pathological images are usually in clinical diagnosis, but computer vision-based multimodal image-assisted diagnosis faces challenges with modality fusion, especially in the absence of expert-annotated data. To achieve the…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Qinghua Lin , Guang-Hai Liu , Zuoyong Li , Yang Li , Yuting Jiang , Xiang Wu

Medical imaging plays a vital role in modern diagnostics; however, interpreting high-resolution radiological data remains time-consuming and susceptible to variability among clinicians. Traditional image processing techniques often lack the…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Melika Filvantorkaman , Maral Filvan Torkaman

Multimodal image registration is a fundamental task and a prerequisite for downstream cross-modal analysis. Despite recent progress in shared feature extraction and multi-scale architectures, two key limitations remain. First, some methods…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 Chunlei Zhang , Jiahao Xia , Yun Xiao , Bo Jiang , Jian Zhang

Typically, a medical image offers spatial information on the anatomy (and pathology) modulated by imaging specific characteristics. Many imaging modalities including Magnetic Resonance Imaging (MRI) and Computed Tomography (CT) can be…

Computer Vision and Pattern Recognition · Computer Science 2020-04-21 Agisilaos Chartsias , Thomas Joyce , Giorgos Papanastasiou , Michelle Williams , David Newby , Rohan Dharmakumar , Sotirios A. Tsaftaris

Deep learning holds immense promise for transforming medical image analysis, yet its clinical generalization remains profoundly limited. A major barrier is data heterogeneity. This is particularly true in Magnetic Resonance Imaging, where…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Mehmet Yigit Avci , Pedro Borges , Virginia Fernandez , Paul Wright , Mehmet Yigitsoy , Sebastien Ourselin , Jorge Cardoso

In the big data era, integrating diverse data modalities poses significant challenges, particularly in complex fields like healthcare. This paper introduces a new process model for multimodal Data Fusion for Data Mining, integrating…

Artificial Intelligence · Computer Science 2024-06-04 David Restrepo , Chenwei Wu , Constanza Vásquez-Venegas , Luis Filipe Nakayama , Leo Anthony Celi , Diego M López

We propose neural network layers that explicitly combine frequency and image feature representations and show that they can be used as a versatile building block for reconstruction from frequency space data. Our work is motivated by the…

Computer Vision and Pattern Recognition · Computer Science 2023-06-29 Nalini M. Singh , Juan Eugenio Iglesias , Elfar Adalsteinsson , Adrian V. Dalca , Polina Golland

Medical multimodal representation learning aims to integrate heterogeneous data into unified patient representations to support clinical outcome prediction. However, real-world medical datasets commonly contain systematic biases from…

Machine Learning · Computer Science 2026-05-19 Xiaoguang Zhu , Linxiao Gong , Lianlong Sun , Yang Liu , Haoyu Wang , Jing Liu

The diagnosis, prognosis, and treatment of patients with musculoskeletal (MSK) disorders require radiology imaging (using computed tomography, magnetic resonance imaging(MRI), and ultrasound) and their precise analysis by expert…

Image and Video Processing · Electrical Eng. & Systems 2020-03-03 Ismail Irmakci , Syed Muhammad Anwar , Drew A. Torigian , Ulas Bagci

Multimodal medical image fusion plays an instrumental role in several areas of medical image processing, particularly in disease recognition and tumor detection. Traditional fusion methods tend to process each modality independently before…

Image and Video Processing · Electrical Eng. & Systems 2023-10-11 Lin Liu , Xinxin Fan , Chulong Zhang , Jingjing Dai , Yaoqin Xie , Xiaokun Liang

Magnetic Resonance Imaging (MRI) is important in clinic to produce high resolution images for diagnosis, but its acquisition time is long for high resolution images. Deep learning based MRI super resolution methods can reduce scan time…

Image and Video Processing · Electrical Eng. & Systems 2022-09-08 Ziyan Lin , Zihao Chen

An important task in image processing and neuroimaging is to extract quantitative information from the acquired images in order to make observations about the presence of disease or markers of development in populations. Having a…

Computer Vision and Pattern Recognition · Computer Science 2018-11-27 Camilo Bermudez , Andrew J. Plassard , Larry T. Davis , Allen T. Newton , Susan M Resnick , Bennett A. Landman

Real-life medical data is often multimodal and incomplete, fueling the growing need for advanced deep learning models capable of integrating them efficiently. The use of diverse modalities, including histopathology slides, MRI, and genetic…

Artificial Intelligence · Computer Science 2024-10-02 Lucas Robinet , Ahmad Berjaoui , Ziad Kheil , Elizabeth Cohen-Jonathan Moyal

Fast and accurate reconstruction of magnetic resonance (MR) images from under-sampled data is important in many clinical applications. In recent years, deep learning-based methods have been shown to produce superior performance on MR image…

Image and Video Processing · Electrical Eng. & Systems 2021-03-12 Pengfei Guo , Puyang Wang , Jinyuan Zhou , Shanshan Jiang , Vishal M. Patel

Multiple Sclerosis (MS) is a type of brain disease which causes visual, sensory, and motor problems for people with a detrimental effect on the functioning of the nervous system. In order to diagnose MS, multiple screening methods have been…

Magnetic resonance imaging (MRI) reconstruction is a fundamental task aimed at recovering high-quality images from undersampled or low-quality MRI data. This process enhances diagnostic accuracy and optimizes clinical applications. In…

Image and Video Processing · Electrical Eng. & Systems 2025-03-11 Xiaoyan Kui , Zijie Fan , Zexin Ji , Qinsong Li , Chengtao Liu , Weixin Si , Beiji Zou