English
Related papers

Related papers: Aligning Synthetic Medical Images with Clinical Kn…

200 papers

Recent advances in generative models for medical imaging have shown promise in representing multiple modalities. However, the variability in modality availability across datasets limits the general applicability of the synthetic data they…

Image and Video Processing · Electrical Eng. & Systems 2024-10-02 Sven Lüpke , Yousef Yeganeh , Ehsan Adeli , Nassir Navab , Azade Farshad

Devising domain- and model-agnostic evaluation metrics for generative models is an important and as yet unresolved problem. Most existing metrics, which were tailored solely to the image synthesis setup, exhibit a limited capacity for…

Machine Learning · Computer Science 2022-07-14 Ahmed M. Alaa , Boris van Breugel , Evgeny Saveliev , Mihaela van der Schaar

Ultrasound imaging is widely used in medical diagnosis, especially for fetal health assessment. However, the availability of high-quality annotated ultrasound images is limited, which restricts the training of machine learning models. In…

Computer Vision and Pattern Recognition · Computer Science 2025-07-04 Yueying Tian , Elif Ucurum , Xudong Han , Rupert Young , Chris Chatwin , Philip Birch

Automated synthesis of histology images has several potential applications in computational pathology. However, no existing method can generate realistic tissue images with a bespoke cellular layout or user-defined histology parameters. In…

Image and Video Processing · Electrical Eng. & Systems 2022-12-29 Srijay Deshpande , Muhammad Dawood , Fayyaz Minhas , Nasir Rajpoot

Diffusion models have recently achieved astonishing performance in generating high-fidelity photo-realistic images. Given their huge success, it is still unclear whether synthetic images are applicable for knowledge distillation when real…

Computer Vision and Pattern Recognition · Computer Science 2023-05-23 Zheng Li , Yuxuan Li , Penghai Zhao , Renjie Song , Xiang Li , Jian Yang

Acquiring and annotating sufficient labeled data is crucial in developing accurate and robust learning-based models, but obtaining such data can be challenging in many medical image segmentation tasks. One promising solution is to…

Image and Video Processing · Electrical Eng. & Systems 2023-07-06 Kun Han , Yifeng Xiong , Chenyu You , Pooya Khosravi , Shanlin Sun , Xiangyi Yan , James Duncan , Xiaohui Xie

Image and video synthesis has become a blooming topic in computer vision and machine learning communities along with the developments of deep generative models, due to its great academic and application value. Many researchers have been…

Computer Vision and Pattern Recognition · Computer Science 2024-05-27 Zhen Jia , Zhang Zhang , Liang Wang , Tieniu Tan

Deep generative modeling has emerged as a powerful tool for synthesizing realistic medical images, driving advances in medical image analysis, disease diagnosis, and treatment planning. This chapter explores various deep generative models…

Image and Video Processing · Electrical Eng. & Systems 2024-10-24 Paul Friedrich , Yannik Frisch , Philippe C. Cattin

Deep neural networks have brought remarkable breakthroughs in medical image analysis. However, due to their data-hungry nature, the modest dataset sizes in medical imaging projects might be hindering their full potential. Generating…

In order to achieve good performance and generalisability, medical image segmentation models should be trained on sizeable datasets with sufficient variability. Due to ethics and governance restrictions, and the costs associated with…

Computer Vision and Pattern Recognition · Computer Science 2023-11-22 Virginia Fernandez , Walter Hugo Lopez Pinaya , Pedro Borges , Petru-Daniel Tudosiu , Mark S Graham , Tom Vercauteren , M Jorge Cardoso

We fine-tuned a foundational stable diffusion model using X-ray scattering images and their corresponding descriptions to generate new scientific images from given prompts. However, some of the generated images exhibit significant…

Image and Video Processing · Electrical Eng. & Systems 2024-08-26 Zhuowen Zhao , Xiaoya Chong , Tanny Chavez , Alexander Hexemer

Diffusion models have recently driven significant breakthroughs in generative modeling. While state-of-the-art models produce high-quality samples on average, individual samples can still be low quality. Detecting such samples without human…

Machine Learning · Computer Science 2025-06-13 Metod Jazbec , Eliot Wong-Toi , Guoxuan Xia , Dan Zhang , Eric Nalisnick , Stephan Mandt

Recent Text-to-Image (T2I) generation models such as Stable Diffusion and Imagen have made significant progress in generating high-resolution images based on text descriptions. However, many generated images still suffer from issues such as…

Despite the recent success in applying supervised deep learning to medical imaging tasks, the problem of obtaining large and diverse expert-annotated datasets required for the development of high performant models remains particularly…

Computer Vision and Pattern Recognition · Computer Science 2019-11-21 Amirata Ghorbani , Vivek Natarajan , David Coz , Yuan Liu

In biomedical image analysis, the applicability of deep learning methods is directly impacted by the quantity of image data available. This is due to deep learning models requiring large image datasets to provide high-level performance.…

Machine Learning · Computer Science 2023-08-14 Muhammad Muneeb Saad , Ruairi O'Reilly , Mubashir Husain Rehmani

Medical image segmentation models struggle with rare abnormalities due to scarce annotated pathological data. We propose DiffAug a novel framework that combines textguided diffusion-based generation with automatic segmentation validation to…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Maham Nazir , Muhammad Aqeel , Francesco Setti

Rapid advances in generative AI have enabled the creation of highly realistic synthetic images, which, while beneficial in many domains, also pose serious risks in terms of disinformation, fraud, and other malicious applications. Current…

Computer Vision and Pattern Recognition · Computer Science 2025-04-07 Aref Azizpour , Tai D. Nguyen , Matthew C. Stamm

Recent generative models produce near-photorealistic images, challenging the trustworthiness of photographs. Synthetic image detection (SID) has thus become an important area of research. Prior work has highlighted how synthetic images…

Computer Vision and Pattern Recognition · Computer Science 2026-02-16 Marco Willi , Melanie Mathys , Michael Graber

The machine learning community has mainly relied on real data to benchmark algorithms as it provides compelling evidence of model applicability. Evaluation on synthetic datasets can be a powerful tool to provide a better understanding of a…

Machine Learning · Computer Science 2022-11-01 Florence Regol , Anja Kroon , Mark Coates

Human emotion synthesis is a crucial aspect of affective computing. It involves using computational methods to mimic and convey human emotions through various modalities, with the goal of enabling more natural and effective human-computer…

Machine Learning · Computer Science 2024-12-11 Fei Ma , Yukan Li , Yifan Xie , Ying He , Yi Zhang , Hongwei Ren , Zhou Liu , Wei Yao , Fuji Ren , Fei Richard Yu , Shiguang Ni