English
Related papers

Related papers: Latent Space Synergy: Text-Guided Data Augmentatio…

200 papers

Deep learning has shown excellent performance in analysing medical images. However, datasets are difficult to obtain due privacy issues, standardization problems, and lack of annotations. We address these problems by producing realistic…

Computer Vision and Pattern Recognition · Computer Science 2023-07-24 Enric Moreu , Eric Arazo , Kevin McGuinness , Noel E. O'Connor

In recent years, Denoising Diffusion Models have demonstrated remarkable success in generating semantically valuable pixel-wise representations for image generative modeling. In this study, we propose a novel end-to-end framework, called…

Image and Video Processing · Electrical Eng. & Systems 2023-03-21 Zhaohu Xing , Liang Wan , Huazhu Fu , Guang Yang , Lei Zhu

In spite of the rapidly evolving landscape of text-to-image generation, the synthesis and manipulation of multiple entities while adhering to specific relational constraints pose enduring challenges. This paper introduces an innovative…

Computer Vision and Pattern Recognition · Computer Science 2024-01-22 YuTeng Ye , Jiale Cai , Hang Zhou , Guanwen Li , Youjia Zhang , Zikai Song , Chenxing Gao , Junqing Yu , Wei Yang

Medical image annotation is constrained by privacy concerns and labor-intensive labeling, significantly limiting the performance and generalization of segmentation models. While mask-controllable diffusion models excel in synthesis, they…

Computer Vision and Pattern Recognition · Computer Science 2025-08-01 Kunpeng Qiu , Zhiying Zhou , Yongxin Guo

Accurate spatial correspondence between medical images is essential for longitudinal analysis, lesion tracking, and image-guided interventions. Medical image registration methods rely on local intensity-based similarity measures, which fail…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Xingyu Zhang , Anna Reithmeir , Fryderyk Kögl , Rickmer Braren , Julia A. Schnabel , Daniel M. Lang

Obtaining annotated table structure data for complex tables is a challenging task due to the inherent diversity and complexity of real-world document layouts. The scarcity of publicly available datasets with comprehensive annotations for…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Syed Jawwad Haider Hamdani , Saifullah Saifullah , Stefan Agne , Andreas Dengel , Sheraz Ahmed

Crowd counting is a critical task in computer vision, with several important applications. However, existing counting methods rely on labor-intensive density map annotations, necessitating the manual localization of each individual…

Computer Vision and Pattern Recognition · Computer Science 2023-10-13 Adriano D'Alessandro , Ali Mahdavi-Amiri , Ghassan Hamarneh

Large-scale diffusion-based generative models have led to breakthroughs in text-conditioned high-resolution image synthesis. Starting from random noise, such text-to-image diffusion models gradually synthesize images in an iterative fashion…

Computer Vision and Pattern Recognition · Computer Science 2023-03-15 Yogesh Balaji , Seungjun Nah , Xun Huang , Arash Vahdat , Jiaming Song , Qinsheng Zhang , Karsten Kreis , Miika Aittala , Timo Aila , Samuli Laine , Bryan Catanzaro , Tero Karras , Ming-Yu Liu

Modern biomedical image analysis using deep learning often encounters the challenge of limited annotated data. To overcome this issue, deep generative models can be employed to synthesize realistic biomedical images. In this regard, we…

Image and Video Processing · Electrical Eng. & Systems 2026-02-23 Yuli Wu , Weidong He , Dennis Eschweiler , Ningxin Dou , Zixin Fan , Shengli Mi , Peter Walter , Johannes Stegmaier

Artificial intelligence (AI) is increasingly used in every stage of drug development. Continuing breakthroughs in AI-based methods for drug discovery require the creation, improvement, and refinement of drug discovery data. We posit a new…

Machine Learning · Computer Science 2024-05-08 Bing Hu , Ashish Saragadam , Anita Layton , Helen Chen

We investigate whether synthetic images generated by diffusion models can enhance multi-label classification of protein subcellular localization. Specifically, we implement a simplified class-conditional denoising diffusion probabilistic…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Sylvey Lin , Zhi-Yi Cao

This paper introduces a methodology for generating synthetic annotated data to address data scarcity in semantic segmentation tasks within the precision agriculture domain. Utilizing Denoising Diffusion Probabilistic Models (DDPMs) and…

Computer Vision and Pattern Recognition · Computer Science 2024-11-07 Andrew Heschl , Mauricio Murillo , Keyhan Najafian , Farhad Maleki

In this paper, we propose a novel data augmentation technique called GenMix, which combines generative and mixture approaches to leverage the strengths of both methods. While generative models excel at creating new data patterns, they face…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Hansang Lee , Haeil Lee , Helen Hong

In medical imaging, the diffusion models have shown great potential for synthetic image generation tasks. However, these approaches often lack the interpretable connections between the generated and real images and can create anatomically…

Image and Video Processing · Electrical Eng. & Systems 2026-02-12 Jian-Qing Zheng , Yuanhan Mo , Yang Sun , Jiahua Li , Fuping Wu , Ziyang Wang , Tonia Vincent , Bartłomiej W. Papież

Medical imaging plays a vital role in modern diagnostics and treatment. The temporal nature of disease or treatment progression often results in longitudinal data. Due to the cost and potential harm, acquiring large medical datasets…

Computer Vision and Pattern Recognition · Computer Science 2023-01-16 Julian Schön , Raghavendra Selvan , Lotte Nygård , Ivan Richter Vogelius , Jens Petersen

Synthetic tumors in medical images offer controllable characteristics that facilitate the training of machine learning models, leading to an improved segmentation performance. However, the existing methods of tumor synthesis yield…

Computer Vision and Pattern Recognition · Computer Science 2025-09-04 Hongxu Yang , Edina Timko , Levente Lippenszky , Vanda Czipczer , Lehel Ferenczi

Current large-scale diffusion models represent a giant leap forward in conditional image synthesis, capable of interpreting diverse cues like text, human poses, and edges. However, their reliance on substantial computational resources and…

Computer Vision and Pattern Recognition · Computer Science 2024-01-01 Guansong Lu , Yuanfan Guo , Jianhua Han , Minzhe Niu , Yihan Zeng , Songcen Xu , Zeyi Huang , Zhao Zhong , Wei Zhang , Hang Xu

Integrating deep learning with clinical expertise holds great potential for addressing healthcare challenges and empowering medical professionals with improved diagnostic tools. However, the need for annotated medical images is often an…

Computer Vision and Pattern Recognition · Computer Science 2023-11-16 Romain Hardy , Joe Klepich , Ryan Mitchell , Steve Hall , Jericho Villareal , Cornelia Ilin

Augmentation by generative modelling yields a promising alternative to the accumulation of surgical data, where ethical, organisational and regulatory aspects must be considered. Yet, the joint synthesis of (image, mask) pairs for…

Computer Vision and Pattern Recognition · Computer Science 2025-07-02 Yannik Frisch , Christina Bornberg , Moritz Fuchs , Anirban Mukhopadhyay

Recent text-to-image diffusion models have demonstrated an astonishing capacity to generate high-quality images. However, researchers mainly studied the way of synthesizing images with only text prompts. While some works have explored using…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Jinheng Xie , Yuexiang Li , Yawen Huang , Haozhe Liu , Wentian Zhang , Yefeng Zheng , Mike Zheng Shou