English
Related papers

Related papers: Towards 3D Semantic Image Synthesis for Medical Im…

200 papers

This paper introduces an innovative methodology for producing high-quality 3D lung CT images guided by textual information. While diffusion-based generative models are increasingly used in medical imaging, current state-of-the-art…

Image and Video Processing · Electrical Eng. & Systems 2024-10-16 Yanwu Xu , Li Sun , Wei Peng , Shuyue Jia , Katelyn Morrison , Adam Perer , Afrooz Zandifar , Shyam Visweswaran , Motahhare Eslami , Kayhan Batmanghelich

With the rapid development of artificial intelligence (AI), AI-assisted medical imaging analysis demonstrates remarkable performance in early lung cancer screening. However, the costly annotation process and privacy concerns limit the…

Image and Video Processing · Electrical Eng. & Systems 2025-08-14 Yifan Jiang , Yannick Lemaréchal , Sophie Plante , Josée Bafaro , Jessica Abi-Rjeile , Philippe Joubert , Philippe Després , Venkata Manem

Advancements in AI for medical imaging offer significant potential. However, their applications are constrained by the limited availability of data and the reluctance of medical centers to share it due to patient privacy concerns.…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Marvin Seyfarth , Salman Ul Hassan Dar , Isabelle Ayx , Matthias Alexander Fink , Stefan O. Schoenberg , Hans-Ulrich Kauczor , Sandy Engelhardt

Medical image data is less accessible than in other domains due to privacy and regulatory constraints. In addition, labeling requires costly, time-intensive manual image annotation by clinical experts. To overcome these challenges,…

Image and Video Processing · Electrical Eng. & Systems 2025-07-11 Fangyijie Wang , Kevin Whelan , Félix Balado , Kathleen M. Curran , Guénolé Silvestre

Generative latent diffusion models have been established as state-of-the-art in data generation. One promising application is generation of realistic synthetic medical imaging data for open data sharing without compromising patient privacy.…

Computer Vision and Pattern Recognition · Computer Science 2023-07-07 Salman Ul Hassan Dar , Arman Ghanaat , Jannik Kahmann , Isabelle Ayx , Theano Papavassiliu , Stefan O. Schoenberg , Sandy Engelhardt

Despite significant progress in generative modelling, existing diffusion models often struggle to produce anatomically precise female pelvic images, limiting their application in gynaecological imaging, where data scarcity and patient…

Image and Video Processing · Electrical Eng. & Systems 2025-08-26 Johanna P. Müller , Anika Knupfer , Pedro Blöss , Edoardo Berardi Vittur , Bernhard Kainz , Jana Hutter

Generative models based on deep learning have shown significant potential in medical imaging, particularly for modality transformation and multimodal fusion in MRI-based brain imaging. This study introduces GM-LDM, a novel framework that…

Image and Video Processing · Electrical Eng. & Systems 2025-06-17 Hu Xu , Yang Jingling , Jia Sihan , Bi Yuda , Calhoun Vince

The scarcity of publicly available medical imaging data limits the development of effective AI models. This work proposes a memory-efficient patch-wise denoising diffusion probabilistic model (DDPM) for generating synthetic medical images,…

Image and Video Processing · Electrical Eng. & Systems 2024-10-17 Kathrin Khadra , Utku Türkbey

Digital subtraction angiography (DSA) plays a central role in the diagnosis and treatment of cerebrovascular disease, yet its invasive nature and high acquisition cost severely limit large-scale data collection and public data sharing.…

Computer Vision and Pattern Recognition · Computer Science 2026-02-13 Qiwen Xu , David Rügamer , Holger Wenz , Johann Fontana , Nora Meggyeshazi , Andreas Bender , Máté E. Maros

In this study we develop dimension-reduction techniques to accelerate diffusion model inference in the context of synthetic data generation. The idea is to integrate compressed sensing into diffusion models (hence, CSDM): First, compress…

Machine Learning · Statistics 2025-09-30 Zhengyi Guo , Jiatu Li , Wenpin Tang , David D. Yao

Semantic image synthesis (SIS) is a task to generate realistic images corresponding to semantic maps (labels). However, in real-world applications, SIS often encounters noisy user inputs. To address this, we propose Stochastic Conditional…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Juyeon Ko , Inho Kong , Dogyun Park , Hyunwoo J. Kim

Deep learning models in the Earth Observation domain heavily rely on the availability of large-scale accurately labeled satellite imagery. However, obtaining and labeling satellite imagery is a resource-intensive endeavor. While generative…

Computer Vision and Pattern Recognition · Computer Science 2023-10-02 Orkhan Baghirli , Hamid Askarov , Imran Ibrahimli , Ismat Bakhishov , Nabi Nabiyev

In this paper, we present an effective data augmentation framework leveraging the Large Language Model (LLM) and Diffusion Model (DM) to tackle the challenges inherent in data-scarce scenarios. Recently, DMs have opened up the possibility…

Computer Vision and Pattern Recognition · Computer Science 2024-09-26 Kyuheon Jung , Yongdeuk Seo , Seongwoo Cho , Jaeyoung Kim , Hyun-seok Min , Sungchul Choi

Recent 3D human generative models have achieved remarkable progress by learning 3D-aware GANs from 2D images. However, existing 3D human generative methods model humans in a compact 1D latent space, ignoring the articulated structure and…

Computer Vision and Pattern Recognition · Computer Science 2024-07-03 Tao Hu , Fangzhou Hong , Ziwei Liu

Latent diffusion models (LDMs) dominate high-quality image generation, yet integrating representation learning with generative modeling remains a challenge. We introduce a novel generative image modeling framework that seamlessly bridges…

Computer Vision and Pattern Recognition · Computer Science 2026-01-23 Theodoros Kouzelis , Efstathios Karypidis , Ioannis Kakogeorgiou , Spyros Gidaris , Nikos Komodakis

Computed Tomography (CT) is a widely utilized imaging modality in clinical settings. Using densely acquired rotational X-ray arrays, CT can capture 3D spatial features. However, it is confronted with challenged such as significant time…

Image and Video Processing · Electrical Eng. & Systems 2025-07-16 Duoyou Chen , Yunqing Chen , Can Zhang , Zhou Wang , Cheng Chen , Ruoxiu Xiao

Multi-modal images play a crucial role in comprehensive evaluations in medical image analysis providing complementary information for identifying clinically important biomarkers. However, in clinical practice, acquiring multiple modalities…

Image and Video Processing · Electrical Eng. & Systems 2024-10-02 Jonghun Kim , Hyunjin Park

Acquiring and annotating sufficient labeled data is crucial in developing accurate and robust learning-based models, but obtaining such data can be challenging in many medical image segmentation tasks. One promising solution is to…

Image and Video Processing · Electrical Eng. & Systems 2023-07-06 Kun Han , Yifeng Xiong , Chenyu You , Pooya Khosravi , Shanlin Sun , Xiangyi Yan , James Duncan , Xiaohui Xie

Latent Diffusion Models (LDMs) enable high-quality image synthesis while avoiding excessive compute demands by training a diffusion model in a compressed lower-dimensional latent space. Here, we apply the LDM paradigm to high-resolution…

Computer Vision and Pattern Recognition · Computer Science 2023-12-29 Andreas Blattmann , Robin Rombach , Huan Ling , Tim Dockhorn , Seung Wook Kim , Sanja Fidler , Karsten Kreis

The generation of realistic medical images from text descriptions has significant potential to address data scarcity challenges in healthcare AI while preserving patient privacy. This paper presents a comprehensive study of text-to-image…

Computer Vision and Pattern Recognition · Computer Science 2025-05-13 Mikhail Chaichuk , Sushant Gautam , Steven Hicks , Elena Tutubalina