English
Related papers

Related papers: Deep Learning based Multi-modal Computing with Fea…

200 papers

Medical image synthesis remains challenging due to misalignment noise during training. Existing methods have attempted to address this challenge by incorporating a registration-guided module. However, these methods tend to overlook the…

Computer Vision and Pattern Recognition · Computer Science 2024-07-11 Chuanpu Li , Zeli Chen , Yiwen Zhang , Liming Zhong , Wei Yang

Magnetic resonance imaging (MRI) is extensively used for diagnosis and image-guided therapeutics. Due to hardware, physical and physiological limitations, acquisition of high-resolution MRI data takes long scan time at high system cost, and…

Medical Physics · Physics 2018-10-17 Qing Lyu , Chenyu You , Hongming Shan , Ge Wang

One of the biggest challenges for deep learning algorithms in medical image analysis is the indiscriminate mixing of image properties, e.g. artifacts and anatomy. These entangled image properties lead to a semantically redundant feature…

Machine Learning · Computer Science 2019-08-22 Qingjie Meng , Nick Pawlowski , Daniel Rueckert , Bernhard Kainz

Although deep learning models in medical imaging often achieve excellent classification performance, they can rely on shortcut learning, exploiting spurious correlations or confounding factors that are not causally related to the target…

Computer Vision and Pattern Recognition · Computer Science 2026-04-15 Sarah Müller , Philipp Berens

Synthesizing missing modalities in multi-modal magnetic resonance imaging (MRI) is vital for ensuring diagnostic completeness, particularly when full acquisitions are infeasible due to time constraints, motion artifacts, and patient…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Yue Zhang , Zhizheng Zhuo , Siyao Xu , Shan Lv , Zhaoxi Liu , Jun Qiu , Qiuli Wang , Yaou Liu , S. Kevin Zhou

Motion artifacts caused by prolonged acquisition time are a significant challenge in Magnetic Resonance Imaging (MRI), hindering accurate tissue segmentation. These artifacts appear as blurred images that mimic tissue-like appearances,…

Image and Video Processing · Electrical Eng. & Systems 2024-12-06 Sunyoung Jung , Yoonseok Choi , Mohammed A. Al-masni , Minyoung Jung , Dong-Hyun Kim

Magnetic resonance imaging (MRI) is a crucial medical imaging modality. However, long acquisition times remain a significant challenge, leading to increased costs, and reduced patient comfort. Recent studies have shown the potential of…

Computer Vision and Pattern Recognition · Computer Science 2025-07-30 Amirmohammad Shamaei , Alexander Stebner , Salome , Bosshart , Johanna Ospel , Gouri Ginde , Mariana Bento , Roberto Souza

Current Computer-Aided Diagnosis (CAD) methods mainly depend on medical images. The clinical information, which usually needs to be considered in practical clinical diagnosis, has not been fully employed in CAD. In this paper, we propose a…

Image and Video Processing · Electrical Eng. & Systems 2021-03-11 Songxiao Yang , Xiabi Liu , Zhongshu Zheng , Wei Wang , Xiaohong Ma

Early and accurate diagnosis of parkinsonian syndromes is critical to provide appropriate care to patients and for inclusion in therapeutic trials. The red nucleus is a structure of the midbrain that plays an important role in these…

Multi-sequence MRI is valuable in clinical settings for reliable diagnosis and treatment prognosis, but some sequences may be unusable or missing for various reasons. To address this issue, MRI synthesis is a potential solution. Recent deep…

Image and Video Processing · Electrical Eng. & Systems 2023-07-04 Luyi Han , Tianyu Zhang , Yunzhi Huang , Haoran Dou , Xin Wang , Yuan Gao , Chunyao Lu , Tan Tao , Ritse Mann

Healthcare applications are inherently multimodal, benefiting greatly from the integration of diverse data sources. However, the modalities available in clinical settings can vary across different locations and patients. A key area that…

Computer Vision and Pattern Recognition · Computer Science 2025-09-04 Mohammed Amer , Mohamed A. Suliman , Tu Bui , Nuria Garcia , Serban Georgescu

Magnetic Resonance Imaging (MRI) is a non-invasive diagnostic and radiotherapy (RT) planning tool, offering detailed insights into the anatomy of the human body. The extensive scan time is stressful for patients, who must remain motionless…

Image and Video Processing · Electrical Eng. & Systems 2023-11-23 Shahinur Alam , Jinsoo Uh , Alexander Dresner , Chia-ho Hua , Khaled Khairy

The key challenge in unaligned multimodal language sequences lies in effectively integrating information from various modalities to obtain a refined multimodal joint representation. Recently, the disentangle and fuse methods have achieved…

Computation and Language · Computer Science 2024-09-20 Fan Qian , Jiqing Han , Jianchen Li , Yongjun He , Tieran Zheng , Guibin Zheng

We propose a unified deep meta-learning framework for accelerated magnetic resonance imaging (MRI) that jointly addresses multi-coil reconstruction and cross-modality synthesis. Motivated by the limitations of conventional methods in…

Optimization and Control · Mathematics 2026-03-10 Merham Fouladvand , Peuroly Batra

Background and objective: Employing deep learning models in critical domains such as medical imaging poses challenges associated with the limited availability of training data. We present a strategy for improving the performance and…

Computer Vision and Pattern Recognition · Computer Science 2024-03-27 Eva Pachetti , Sotirios A. Tsaftaris , Sara Colantonio

Multimodal MRI offers complementary multi-scale information to characterize the brain structure. However, it remains challenging to effectively integrate multimodal MRI while achieving neuroscience interpretability. Here we propose to use…

Neurons and Cognition · Quantitative Biology 2025-12-15 Chengzhi Xia , Jianwei Chen , Yixuan Jiang , Qi Yan , Chao Li

Multimodal MR image synthesis aims to generate missing modality images by effectively fusing and mapping from a subset of available MRI modalities. Most existing methods adopt an image-to-image translation paradigm, treating multiple…

Image and Video Processing · Electrical Eng. & Systems 2025-04-29 Tao Song , Yicheng Wu , Minhao Hu , Xiangde Luo , Linda Wei , Guotai Wang , Yi Guo , Feng Xu , Shaoting Zhang

In clinical practice, multi-modal magnetic resonance imaging (MRI) with different contrasts is usually acquired in a single study to assess different properties of the same region of interest in the human body. The whole acquisition process…

Image and Video Processing · Electrical Eng. & Systems 2022-04-05 Kai Xuan , Lei Xiang , Xiaoqian Huang , Lichi Zhang , Shu Liao , Dinggang Shen , Qian Wang

In this paper, an innovative multi-modal deep learning model is proposed to deeply integrate heterogeneous information from medical images and clinical reports. First, for medical images, convolutional neural networks were used to extract…

Machine Learning · Computer Science 2024-05-29 Ziyan Yao , Fei Lin , Sheng Chai , Weijie He , Lu Dai , Xinghui Fei

This paper proposes a novel method for automatic MRI denoising that exploits last advances in deep learning feature regression and self-similarity properties of the MR images. The proposed method is a two-stage approach. In the first stage,…

Image and Video Processing · Electrical Eng. & Systems 2019-11-19 Jose V. Manjon , Pierrick Coupe