English

Semantic Map Guided Synthesis of Wireless Capsule Endoscopy Images using Diffusion Models

Image and Video Processing 2023-11-13 v1 Computer Vision and Pattern Recognition Machine Learning

Abstract

Wireless capsule endoscopy (WCE) is a non-invasive method for visualizing the gastrointestinal (GI) tract, crucial for diagnosing GI tract diseases. However, interpreting WCE results can be time-consuming and tiring. Existing studies have employed deep neural networks (DNNs) for automatic GI tract lesion detection, but acquiring sufficient training examples, particularly due to privacy concerns, remains a challenge. Public WCE databases lack diversity and quantity. To address this, we propose a novel approach leveraging generative models, specifically the diffusion model (DM), for generating diverse WCE images. Our model incorporates semantic map resulted from visualization scale (VS) engine, enhancing the controllability and diversity of generated images. We evaluate our approach using visual inspection and visual Turing tests, demonstrating its effectiveness in generating realistic and diverse WCE images.

Keywords

Cite

@article{arxiv.2311.05889,
  title  = {Semantic Map Guided Synthesis of Wireless Capsule Endoscopy Images using Diffusion Models},
  author = {Haejin Lee and Jeongwoo Ju and Jonghyuck Lee and Yeoun Joo Lee and Heechul Jung},
  journal= {arXiv preprint arXiv:2311.05889},
  year   = {2023}
}
R2 v1 2026-06-28T13:17:06.311Z