English
Related papers

Related papers: Contrast-X: A Multi-Modal Contrast Image Synthesis…

200 papers

We perform a comprehensive benchmarking of contrastive frameworks for learning multimodal representations in the medical domain. Through this study, we aim to answer the following research questions: (i) How transferable are general-domain…

Computer Vision and Pattern Recognition · Computer Science 2024-06-12 Shuvendu Roy , Yasaman Parhizkar , Franklin Ogidi , Vahid Reza Khazaie , Michael Colacci , Ali Etemad , Elham Dolatabadi , Arash Afkanpour

Synthesizing high fidelity contrast enhanced MRI is clinically valuable for safer and more efficient breast cancer screening, yet remains challenging due to complex lesion textures and heterogeneous enhancement patterns.

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Tianyu Zhang , Xinglong Liang , Jarek van Dijk , Luyi Han , Chunyao Lu , Antonio Portaluri , Xinghe Xie , Yaofei Duan , Nika Rasoolzadeh , Xin Wang , Yuan Gao , Muzhen He , Yue Sun , Jonas Teuwen , Tao Tan , Ritse Mann

In this paper, we introduce a novel Multi-Modal Contrastive Pre-training Framework that synergistically combines X-rays, electrocardiograms (ECGs), and radiology/cardiology reports. Our approach leverages transformers to encode these…

Artificial Intelligence · Computer Science 2024-10-24 Samrajya Thapa , Koushik Howlader , Subhankar Bhattacharjee , Wei le

Generating synthetic CT (sCT) from MRI or CBCT plays a crucial role in enabling MRI-only and CBCT-based adaptive radiotherapy, improving treatment precision while reducing patient radiation exposure. To address this task, we adopt a fully…

Computer Vision and Pattern Recognition · Computer Science 2026-04-24 Arnela Hadzic , Simon Johannes Joham , Martin Urschler

Magnetic resonance imaging (MRI) is a leading modality for the diagnosis of liver cancer, significantly improving the classification of the lesion and patient outcomes. However, traditional MRI faces challenges including risks from contrast…

Image and Video Processing · Electrical Eng. & Systems 2025-08-14 Xiaojiao Xiao , Jianfeng Zhao , Qinmin Vivian Hu , Guanghui Wang

Radiology is essential to modern healthcare, yet rising demand and staffing shortages continue to pose major challenges. Recent advances in artificial intelligence have the potential to support radiologists and help address these…

Image and Video Processing · Electrical Eng. & Systems 2025-11-14 Phillip Sloan , Edwin Simpson , Majid Mirmehdi

The acquisition of different data modalities can enhance our knowledge and understanding of various diseases, paving the way for a more personalized healthcare. Thus, medicine is progressively moving towards the generation of massive…

Image and Video Processing · Electrical Eng. & Systems 2024-05-06 Tiago Mota , M. Rita Verdelho , Alceu Bissoto , Carlos Santiago , Catarina Barata

Magnetic resonance imaging (MRI) is the most sensitive technique for breast cancer detection among current clinical imaging modalities. Contrast-enhanced MRI (CE-MRI) provides superior differentiation between tumors and invaded healthy…

Image and Video Processing · Electrical Eng. & Systems 2023-07-04 Tianyu Zhang , Luyi Han , Anna D'Angelo , Xin Wang , Yuan Gao , Chunyao Lu , Jonas Teuwen , Regina Beets-Tan , Tao Tan , Ritse Mann

Recently, multi-modal vision-language foundation models have gained significant attention in the medical field. While these models offer great opportunities, they still face crucial challenges, such as the requirement for fine-grained…

Computer Vision and Pattern Recognition · Computer Science 2024-09-05 Weijian Huang , Cheng Li , Hong-Yu Zhou , Hao Yang , Jiarun Liu , Yong Liang , Hairong Zheng , Shaoting Zhang , Shanshan Wang

Synthesizing missing modalities in multi-modal magnetic resonance imaging (MRI) is vital for ensuring diagnostic completeness, particularly when full acquisitions are infeasible due to time constraints, motion artifacts, and patient…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Yue Zhang , Zhizheng Zhuo , Siyao Xu , Shan Lv , Zhaoxi Liu , Jun Qiu , Qiuli Wang , Yaou Liu , S. Kevin Zhou

Chest radiographs (CXRs) are among the most common tests in medicine. Automated image interpretation may reduce radiologists\' workload and expand access to diagnostic expertise. Deep learning multi-task and foundation models have shown…

Image and Video Processing · Electrical Eng. & Systems 2025-09-11 Lauren H. Cooke , Matthias Jung , Jan M. Brendel , Nora M. Kerkovits , Borek Foldyna , Michael T. Lu , Vineet K. Raghu

Timely and accurate lymphoma diagnosis is essential for guiding cancer treatment. Standard diagnostic practice combines hematoxylin and eosin (HE)-stained whole slide images with immunohistochemistry, flow cytometry, and molecular genetic…

Medical image enhancement is crucial for improving the quality and interpretability of diagnostic images, ultimately supporting early detection, accurate diagnosis, and effective treatment planning. Despite advancements in imaging…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Chun Wai Chin , Haniza Yazid , Hoi Leong Lee

Publicly available full-field digital mammography (FFDM) datasets remain limited in size, clinical annotations, and vendor diversity, hindering the development of robust models. We introduce LUMINA, a curated, multi-vendor FFDM dataset that…

Medical image segmentation plays an important role in clinical decision making, treatment planning, and disease tracking. However, it still faces two major challenges. On the one hand, there is often a ``soft boundary'' between foreground…

Image and Video Processing · Electrical Eng. & Systems 2024-12-12 Mengqi Lei , Haochen Wu , Xinhua Lv , Xin Wang

A precise assessment of the risk of breast lesions can greatly lower it and assist physicians in choosing the best course of action. To categorise breast lesions, the majority of current computer-aided systems only use characteristics from…

Image and Video Processing · Electrical Eng. & Systems 2025-08-25 Muhaisin Tiyumba Nantogmah , Abdul-Barik Alhassan , Salamudeen Alhassan

Despite significant progress in Multi-modal Large Language Models (MLLMs), their clinical reasoning capacity for multi-modal diagnosis remains largely unexamined. Current benchmarks, mostly single-modality data, can't evaluate progressive…

Computer Vision and Pattern Recognition · Computer Science 2026-04-23 Gui Wang , Zehao Zhong , YongSong Zhou , Yudong Li , Ende Wu , Wooi Ping Cheah , Rong Qu , Jianfeng Ren , Linlin Shen

Unpaired medical image synthesis aims to provide complementary information for an accurate clinical diagnostics, and address challenges in obtaining aligned multi-modal medical scans. Transformer-based models excel in imaging translation…

Computer Vision and Pattern Recognition · Computer Science 2024-08-29 Vu Minh Hieu Phan , Yutong Xie , Bowen Zhang , Yuankai Qi , Zhibin Liao , Antonios Perperidis , Son Lam Phung , Johan W. Verjans , Minh-Son To

Purpose: Grating-based imaging (GBI) and edge-illumination (EI) are two promising types of XPCI as the conventional x-ray sources can be directly utilized. For GBI and EI systems, the phase-stepping acquisition with multiple exposures at a…

Medical Physics · Physics 2022-01-19 Chengpeng Wu , Yuxiang Xing , Li Zhang , Zhiqiang Chen , Xiaohua Zhu , Xi Zhang , Hewei Gao

Medical data poses a daunting challenge for AI algorithms: it exists in many different modalities, experiences frequent distribution shifts, and suffers from a scarcity of examples and labels. Recent advances, including transformers and…