English
Related papers

Related papers: Multimodal synthesis of MRI and tabular data with …

200 papers

Recent advances in generative models for medical imaging have shown promise in representing multiple modalities. However, the variability in modality availability across datasets limits the general applicability of the synthetic data they…

Image and Video Processing · Electrical Eng. & Systems 2024-10-02 Sven Lüpke , Yousef Yeganeh , Ehsan Adeli , Nassir Navab , Azade Farshad

Cross-modality medical image synthesis is a critical topic and has the potential to facilitate numerous applications in the medical imaging field. Despite recent successes in deep-learning-based generative models, most current medical image…

Image and Video Processing · Electrical Eng. & Systems 2023-07-20 Lingting Zhu , Zeyue Xue , Zhenchao Jin , Xian Liu , Jingzhen He , Ziwei Liu , Lequan Yu

Magnetic resonance imaging (MRI) is a widely used neuroimaging technique that can provide images of different contrasts (i.e., modalities). Fusing this multi-modal data has proven particularly effective for boosting model performance in…

Computer Vision and Pattern Recognition · Computer Science 2020-02-13 Tao Zhou , Huazhu Fu , Geng Chen , Jianbing Shen , Ling Shao

MRI synthesis promises to mitigate the challenge of missing MRI modality in clinical practice. Diffusion model has emerged as an effective technique for image synthesis by modelling complex and variable data distributions. However, most…

Image and Video Processing · Electrical Eng. & Systems 2023-03-27 Lan Jiang , Ye Mao , Xi Chen , Xiangfeng Wang , Chao Li

The integration of diverse clinical modalities such as medical imaging and the tabular data extracted from patients' Electronic Health Records (EHRs) is a crucial aspect of modern healthcare. Integrative analysis of multiple sources can…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Daniel Duenias , Brennan Nichyporuk , Tal Arbel , Tammy Riklin Raviv

Generating multi-contrasts/modal MRI of the same anatomy enriches diagnostic information but is limited in practice due to excessive data acquisition time. In this paper, we propose a novel deep-learning model for joint reconstruction and…

Image and Video Processing · Electrical Eng. & Systems 2022-06-30 Wanyu Bian , Qingchao Zhang , Xiaojing Ye , Yunmei Chen

Multimodal deep learning has shown strong potential in medical applications by integrating heterogeneous data sources such as medical images and structured clinical variables. However, most existing approaches implicitly assume complete…

Machine Learning · Computer Science 2026-05-13 Camillo Maria Caruso , Valerio Guarrasi , Paolo Soda

We propose a method called integrated diffusion for combining multimodal datasets, or data gathered via several different measurements on the same system, to create a joint data diffusion operator. As real world data suffers from both local…

Machine Learning · Computer Science 2022-03-07 Manik Kuchroo , Abhinav Godavarthi , Alexander Tong , Guy Wolf , Smita Krishnaswamy

Although diffusion models have achieved remarkable progress in multi-modal magnetic resonance imaging (MRI) translation tasks, existing methods still tend to suffer from anatomical inconsistencies or degraded texture details when handling…

Image and Video Processing · Electrical Eng. & Systems 2026-03-16 Jianqiang Lin , Zhiqiang Shen , Peng Cao , Jinzhu Yang , Osmar R. Zaiane , Xiaoli Liu

The joint analysis of biomedical data in Alzheimer's Disease (AD) is important for better clinical diagnosis and to understand the relationship between biomarkers. However, jointly accounting for heterogeneous measures poses important…

Methodology · Statistics 2018-08-14 Luigi Antelmi , Nicholas Ayache , Philippe Robert , Marco Lorenzi

Purpose: Different Magnetic resonance imaging (MRI) modalities of the same anatomical structure are required to present different pathological information from the physical level for diagnostic needs. However, it is often difficult to…

Image and Video Processing · Electrical Eng. & Systems 2021-09-15 Yuchen Fei , Bo Zhan , Mei Hong , Xi Wu , Jiliu Zhou , Yan Wang

Synthesizing MR imaging sequences is highly relevant in clinical practice, as single sequences are often missing or are of poor quality (e.g. due to motion). Naturally, the idea arises that a target modality would benefit from multi-modal…

Computer Vision and Pattern Recognition · Computer Science 2019-07-29 Hongwei Li , Johannes C. Paetzold , Anjany Sekuboyina , Florian Kofler , Jianguo Zhang , Jan S. Kirschke , Benedikt Wiestler , Bjoern Menze

Integrating multi-modal clinical data, such as electronic health records (EHR) and chest X-ray images (CXR), is particularly beneficial for clinical prediction tasks. However, in a temporal setting, multi-modal data are often inherently…

Computer Vision and Pattern Recognition · Computer Science 2024-10-24 Wenfang Yao , Chen Liu , Kejing Yin , William K. Cheung , Jing Qin

Diffusion models have demonstrated remarkable performance in generating unimodal data across various tasks, including image, video, and text generation. On the contrary, the joint generation of multimodal data through diffusion models is…

Machine Learning · Computer Science 2025-06-16 Kevin Rojas , Yuchen Zhu , Sichen Zhu , Felix X. -F. Ye , Molei Tao

Recent advances in tabular data generation have greatly enhanced synthetic data quality. However, extending diffusion models to tabular data is challenging due to the intricately varied distributions and a blend of data types of tabular…

Magnetic resonance imaging (MRI) is a potent diagnostic tool, but suffers from long examination times. To accelerate the process, modern MRI machines typically utilize multiple coils that acquire sub-sampled data in parallel. Data-driven…

Image and Video Processing · Electrical Eng. & Systems 2023-10-24 Moritz Erlacher , Martin Zach

Diffusion model has become a main paradigm for synthetic data generation in many subfields of modern machine learning, including computer vision, language model, or speech synthesis. In this paper, we leverage the power of diffusion model…

Machine Learning · Statistics 2023-11-20 Namjoon Suh , Xiaofeng Lin , Din-Yin Hsieh , Merhdad Honarkhah , Guang Cheng

Major depressive disorder (MDD) is a prevalent mental disorder associated with complex neurobiological changes that cannot be fully captured using a single imaging modality. The use of multimodal magnetic resonance imaging (MRI) provides a…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Nojod M. Alotaibi , Areej M. Alhothali

Modern deep learning methods have achieved impressive results across tasks from disease classification, estimating continuous biomarkers, to generating realistic medical images. Most of these approaches are trained to model conditional…

Magnetic resonance imaging (MRI) is a powerful medical imaging modality, but long acquisition times limit throughput, patient comfort, and clinical accessibility. Diffusion-based generative models serve as strong image priors for reducing…

Machine Learning · Computer Science 2026-02-13 Sriram Ravula , Brett Levac , Yamin Arefeen , Ajil Jalal , Alexandros G. Dimakis , Jonathan I. Tamir
‹ Prev 1 2 3 10 Next ›