English
Related papers

Related papers: SLaM-DiMM: Shared Latent Modeling for Diffusion Ba…

200 papers

Real-life medical data is often multimodal and incomplete, fueling the growing need for advanced deep learning models capable of integrating them efficiently. The use of diverse modalities, including histopathology slides, MRI, and genetic…

Artificial Intelligence · Computer Science 2024-10-02 Lucas Robinet , Ahmad Berjaoui , Ziad Kheil , Elizabeth Cohen-Jonathan Moyal

Magnetic Resonance Imaging (MRI) is a widely used imaging technique to assess brain tumor. Accurately segmenting brain tumor from MR images is the key to clinical diagnostics and treatment planning. In addition, multi-modal MR images can…

Image and Video Processing · Electrical Eng. & Systems 2021-04-21 Tongxue Zhou , Stéphane Canu , Pierre Vera , Su Ruan

Deep neural networks have brought remarkable breakthroughs in medical image analysis. However, due to their data-hungry nature, the modest dataset sizes in medical imaging projects might be hindering their full potential. Generating…

Multi-modality magnetic resonance imaging (MRI) is essential for the diagnosis and treatment of brain tumors. However, missing modalities are commonly observed due to limitations in scan time, scan corruption, artifacts, motion, and…

Image and Video Processing · Electrical Eng. & Systems 2025-01-08 Xiaojiao Xiao , Qinmin Vivian Hu , Guanghui Wang

In real-world clinical settings, magnetic resonance imaging (MRI) frequently suffers from missing modalities due to equipment variability or patient cooperation issues, which can significantly affect model performance. To address this…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Zhejia Zhang , Junjie Wang , Le Zhang

Despite significant progress in generative modelling, existing diffusion models often struggle to produce anatomically precise female pelvic images, limiting their application in gynaecological imaging, where data scarcity and patient…

Image and Video Processing · Electrical Eng. & Systems 2025-08-26 Johanna P. Müller , Anika Knupfer , Pedro Blöss , Edoardo Berardi Vittur , Bernhard Kainz , Jana Hutter

High-resolution (HR) MRI scans obtained from research-grade medical centers provide precise information about imaged tissues. However, routine clinical MRI scans are typically in low-resolution (LR) and vary greatly in contrast and spatial…

Image and Video Processing · Electrical Eng. & Systems 2023-08-25 Jueqi Wang , Jacob Levman , Walter Hugo Lopez Pinaya , Petru-Daniel Tudosiu , M. Jorge Cardoso , Razvan Marinescu

Automated brain tumor segmentation methods have become well-established and reached performance levels offering clear clinical utility. These methods typically rely on four input magnetic resonance imaging (MRI) modalities: T1-weighted…

Multimodal MRI provides critical complementary information for accurate brain tumor segmentation. However, conventional methods struggle when certain modalities are missing due to issues such as image quality, protocol inconsistencies,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-03 Runze Cheng , Xihang Qiu , Ming Li , Ye Zhang , Chun Li , Fei Yu

Multimodal MR images can provide complementary information for accurate brain tumor segmentation. However, it's common to have missing imaging modalities in clinical practice. Since there exists a strong correlation between multi…

Image and Video Processing · Electrical Eng. & Systems 2021-04-21 Tongxue Zhou , Stéphane Canu , Pierre Vera , Su Ruan

Due to the three-dimensional nature of CT- or MR-scans, generative modeling of medical images is a particularly challenging task. Existing approaches mostly apply patch-wise, slice-wise, or cascaded generation techniques to fit the…

Image and Video Processing · Electrical Eng. & Systems 2024-10-15 Paul Friedrich , Julia Wolleb , Florentin Bieder , Alicia Durrer , Philippe C. Cattin

Multi-modal medical images provide complementary soft-tissue characteristics that aid in the screening and diagnosis of diseases. However, limited scanning time, image corruption and various imaging protocols often result in incomplete…

Computer Vision and Pattern Recognition · Computer Science 2024-07-10 Yue Zhang , Chengtao Peng , Qiuli Wang , Dan Song , Kaiyan Li , S. Kevin Zhou

Diffusion MRI (dMRI) is an advanced imaging technique characterizing tissue microstructure and white matter structural connectivity of the human brain. The demand for high-quality dMRI data is growing, driven by the need for better…

Image and Video Processing · Electrical Eng. & Systems 2024-08-26 Xi Zhu , Wei Zhang , Yijie Li , Lauren J. O'Donnell , Fan Zhang

Multi-modal magnetic resonance imaging (MRI) provides rich, complementary information for analyzing diseases. However, the practical challenges of acquiring multiple MRI modalities, such as cost, scan time, and safety considerations, often…

Image and Video Processing · Electrical Eng. & Systems 2024-09-16 Zhaohu Xing , Sicheng Yang , Sixiang Chen , Tian Ye , Yijun Yang , Jing Qin , Lei Zhu

Missing data problems, such as missing modalities in multi-modal brain MRI and missing slices in cardiac MRI, pose significant challenges in clinical practice. Existing methods rely on external guidance to supply detailed missing state for…

Image and Video Processing · Electrical Eng. & Systems 2026-03-11 Junkai Liu , Nay Aung , Theodoros N. Arvanitis , Joao A. C. Lima , Steffen E. Petersen , Le Zhang

Magnetic Resonance Imaging (MRI) plays a crucial role in brain disease diagnosis, but it is not always feasible for certain patients due to physical or clinical constraints. Recent studies attempt to synthesize MRI from Computed Tomography…

Computer Vision and Pattern Recognition · Computer Science 2026-01-13 Junming Liu , Yifei Sun , Weihua Cheng , Yujin Kang , Yirong Chen , Ding Wang , Guosun Zeng

Image-to-Image translation models can help mitigate various challenges inherent to medical image acquisition. Latent diffusion models (LDMs) leverage efficient learning in compressed latent space and constitute the core of state-of-the-art…

Computer Vision and Pattern Recognition · Computer Science 2025-10-13 Junhyeok Lee , Hyunwoong Kim , Hyungjin Chung , Heeseong Eom , Joon Jang , Chul-Ho Sohn , Kyu Sung Choi

Multimodal neuroimaging provides complementary insights for Alzheimer's disease diagnosis, yet clinical datasets frequently suffer from missing modalities. We propose ACADiff, a framework that synthesizes missing brain imaging modalities…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Rong Zhou , Houliang Zhou , Yao Su , Brian Y. Chen , Yu Zhang , Lifang He , Alzheimer's Disease Neuroimaging Initiative

Non-contrast CT (NCCT) imaging may reduce image contrast and anatomical visibility, potentially increasing diagnostic uncertainty. In contrast, contrast-enhanced CT (CECT) facilitates the observation of regions of interest (ROI). Leading…

Image and Video Processing · Electrical Eng. & Systems 2024-11-18 Tingyi Lin , Pengju Lyu , Jie Zhang , Yuqing Wang , Cheng Wang , Jianjun Zhu

Existing segmentation models trained on a single medical imaging dataset often lack robustness when encountering unseen organs or tumors. Developing a robust model capable of identifying rare or novel tumor categories not present during…

Computer Vision and Pattern Recognition · Computer Science 2025-07-02 Rong Wu , Ziqi Chen , Liming Zhong , Heng Li , Hai Shu