English
Related papers

Related papers: Physics-Informed Latent Diffusion for Multimodal B…

200 papers

In medical imaging, generative models are increasingly relied upon for two distinct but equally critical tasks: reconstruction, where the goal is to restore medical imaging (usually inverse problems like inpainting or superresolution), and…

Image and Video Processing · Electrical Eng. & Systems 2025-07-28 Niklas Bubeck , Yundi Zhang , Suprosanna Shit , Daniel Rueckert , Jiazhen Pan

Generative latent diffusion models have been established as state-of-the-art in data generation. One promising application is generation of realistic synthetic medical imaging data for open data sharing without compromising patient privacy.…

Computer Vision and Pattern Recognition · Computer Science 2023-07-07 Salman Ul Hassan Dar , Arman Ghanaat , Jannik Kahmann , Isabelle Ayx , Theano Papavassiliu , Stefan O. Schoenberg , Sandy Engelhardt

Multi-modal medical images provide complementary soft-tissue characteristics that aid in the screening and diagnosis of diseases. However, limited scanning time, image corruption and various imaging protocols often result in incomplete…

Computer Vision and Pattern Recognition · Computer Science 2024-07-10 Yue Zhang , Chengtao Peng , Qiuli Wang , Dan Song , Kaiyan Li , S. Kevin Zhou

The number of samples in structural brain MRI studies is often too small to properly train deep learning models. Generative models show promise in addressing this issue by effectively learning the data distribution and generating…

Computer Vision and Pattern Recognition · Computer Science 2026-03-20 Wei Peng , Tian Xia , Fabio De Sousa Ribeiro , Tomas Bosschieter , Ehsan Adeli , Qingyu Zhao , Ben Glocker , Kilian M. Pohl

The development of high-dimensional generative models has recently gained a great surge of interest with the introduction of variational auto-encoders and generative adversarial neural networks. Different variants have been proposed where…

Computer Vision and Pattern Recognition · Computer Science 2019-04-18 Mickaël Chen , Ludovic Denoyer , Thierry Artières

This paper introduces an innovative methodology for producing high-quality 3D lung CT images guided by textual information. While diffusion-based generative models are increasingly used in medical imaging, current state-of-the-art…

Image and Video Processing · Electrical Eng. & Systems 2024-10-16 Yanwu Xu , Li Sun , Wei Peng , Shuyue Jia , Katelyn Morrison , Adam Perer , Afrooz Zandifar , Shyam Visweswaran , Motahhare Eslami , Kayhan Batmanghelich

Synthetic neuroimaging data can mitigate critical limitations of real-world datasets, including the scarcity of rare phenotypes, domain shifts across scanners, and insufficient longitudinal coverage. However, existing generative models…

Computer Vision and Pattern Recognition · Computer Science 2026-01-28 Fabian Bongratz , Yitong Li , Sama Elbaroudy , Christian Wachinger

High-resolution (HR) MRI scans obtained from research-grade medical centers provide precise information about imaged tissues. However, routine clinical MRI scans are typically in low-resolution (LR) and vary greatly in contrast and spatial…

Image and Video Processing · Electrical Eng. & Systems 2023-08-25 Jueqi Wang , Jacob Levman , Walter Hugo Lopez Pinaya , Petru-Daniel Tudosiu , M. Jorge Cardoso , Razvan Marinescu

Generative models have been very successful over the years and have received significant attention for synthetic data generation. As deep learning models are getting more and more complex, they require large amounts of data to perform…

Image and Video Processing · Electrical Eng. & Systems 2023-02-24 Usama Tariq , Rizwan Qureshi , Anas Zafar , Danyal Aftab , Jia Wu , Tanvir Alam , Zubair Shah , Hazrat Ali

In medical imaging, the diffusion models have shown great potential for synthetic image generation tasks. However, these approaches often lack the interpretable connections between the generated and real images and can create anatomically…

Image and Video Processing · Electrical Eng. & Systems 2026-02-12 Jian-Qing Zheng , Yuanhan Mo , Yang Sun , Jiahua Li , Fuping Wu , Ziyang Wang , Tonia Vincent , Bartłomiej W. Papież

We present an empirical evaluation of fMRI data augmentation via synthesis. For synthesis we use generative mod-els trained on real neuroimaging data to produce novel task-dependent functional brain images. Analyzed generative mod-els…

Computer Vision and Pattern Recognition · Computer Science 2019-07-16 Peiye Zhuang , Alexander G. Schwing , Sanmi Koyejo

Generative models have emerged as powerful tools in medical imaging, enabling tasks such as segmentation, anomaly detection, and high-quality synthetic data generation. These models typically rely on learning meaningful latent…

Computer Vision and Pattern Recognition · Computer Science 2026-02-17 Jordi Malé , Juan Fortea , Mateus Rozalem-Aranha , Neus Martínez-Abadías , Xavier Sevillano

Although diffusion models have achieved remarkable progress in multi-modal magnetic resonance imaging (MRI) translation tasks, existing methods still tend to suffer from anatomical inconsistencies or degraded texture details when handling…

Image and Video Processing · Electrical Eng. & Systems 2026-03-16 Jianqiang Lin , Zhiqiang Shen , Peng Cao , Jinzhu Yang , Osmar R. Zaiane , Xiaoli Liu

Diffusion magnetic resonance imaging (diffusion MRI) is a non-invasive microstructure assessment technique. Scalar measures, such as FA (fractional anisotropy) and MD (mean diffusivity), quantifying micro-structural tissue properties can be…

Computer Vision and Pattern Recognition · Computer Science 2019-07-23 Xuan Gu , Hans Knutsson , Markus Nilsson , Anders Eklund

This article considers the generative modeling of the (mixed) states of quantum systems, and an approach based on denoising diffusion model is proposed. The key contribution is an algorithmic innovation that respects the physical nature of…

Quantum Physics · Physics 2024-05-28 Yuchen Zhu , Tianrong Chen , Evangelos A. Theodorou , Xie Chen , Molei Tao

Most existing cross-modal generative methods based on diffusion models use guidance to provide control over the latent space to enable conditional generation across different modalities. Such methods focus on providing guidance through…

Machine Learning · Computer Science 2023-05-31 Zizhao Hu , Mohammad Rostami

The availability of large-scale chest X-ray datasets is a requirement for developing well-performing deep learning-based algorithms in thoracic abnormality detection and classification. However, biometric identifiers in chest radiographs…

Image and Video Processing · Electrical Eng. & Systems 2024-10-28 Kai Packhäuser , Lukas Folle , Florian Thamm , Andreas Maier

Recently, the advent of generative AI technologies has made transformational impacts on our daily lives, yet its application in scientific applications remains in its early stages. Data scarcity is a major, well-known barrier in data-driven…

Machine Learning · Computer Science 2025-01-03 Junhuan Yang , Yuzhou Zhang , Yi Sheng , Youzuo Lin , Lei Yang

Magnetic resonance imaging (MRI) inpainting supports numerous clinical and research applications. We introduce the first generative model that conditions on voxel-level, continuous tumor concentrations to synthesize high-fidelity brain…

Image and Video Processing · Electrical Eng. & Systems 2025-12-09 Valentin Biller , Lucas Zimmer , Ayhan Can Erdur , Sandeep Nagar , Daniel Rückert , Niklas Bubeck , Jonas Weidner

Currently there is strong interest in data-driven approaches to medical image classification. However, medical imaging data is scarce, expensive, and fraught with legal concerns regarding patient privacy. Typical consent forms only allow…

Computer Vision and Pattern Recognition · Computer Science 2018-01-10 John T. Guibas , Tejpal S. Virdi , Peter S. Li