English

Towards Application Aligned Synthetic Surgical Image Synthesis

Computer Vision and Pattern Recognition 2025-09-24 v1

Abstract

The scarcity of annotated surgical data poses a significant challenge for developing deep learning systems in computer-assisted interventions. While diffusion models can synthesize realistic images, they often suffer from data memorization, resulting in inconsistent or non-diverse samples that may fail to improve, or even harm, downstream performance. We introduce \emph{Surgical Application-Aligned Diffusion} (SAADi), a new framework that aligns diffusion models with samples preferred by downstream models. Our method constructs pairs of \emph{preferred} and \emph{non-preferred} synthetic images and employs lightweight fine-tuning of diffusion models to align the image generation process with downstream objectives explicitly. Experiments on three surgical datasets demonstrate consistent gains of 77--9%9\% in classification and 22--10%10\% in segmentation tasks, with the considerable improvements observed for underrepresented classes. Iterative refinement of synthetic samples further boosts performance by 44--10%10\%. Unlike baseline approaches, our method overcomes sample degradation and establishes task-aware alignment as a key principle for mitigating data scarcity and advancing surgical vision applications.

Keywords

Cite

@article{arxiv.2509.18796,
  title  = {Towards Application Aligned Synthetic Surgical Image Synthesis},
  author = {Danush Kumar Venkatesh and Stefanie Speidel},
  journal= {arXiv preprint arXiv:2509.18796},
  year   = {2025}
}
R2 v1 2026-07-01T05:51:43.595Z