English

Towards Robust In-Context Learning for Medical Image Segmentation via Data Synthesis

Computer Vision and Pattern Recognition 2025-09-25 v1

Abstract

The rise of In-Context Learning (ICL) for universal medical image segmentation has introduced an unprecedented demand for large-scale, diverse datasets for training, exacerbating the long-standing problem of data scarcity. While data synthesis offers a promising solution, existing methods often fail to simultaneously achieve both high data diversity and a domain distribution suitable for medical data. To bridge this gap, we propose \textbf{SynthICL}, a novel data synthesis framework built upon domain randomization. SynthICL ensures realism by leveraging anatomical priors from real-world datasets, generates diverse anatomical structures to cover a broad data distribution, and explicitly models inter-subject variations to create data cohorts suitable for ICL. Extensive experiments on four held-out datasets validate our framework's effectiveness, showing that models trained with our data achieve performance gains of up to 63\% in average Dice and substantially enhanced generalization to unseen anatomical domains. Our work helps mitigate the data bottleneck for ICL-based segmentation, paving the way for robust models. Our code and the generated dataset are publicly available at https://github.com/jiesihu/Neuroverse3D.

Keywords

Cite

@article{arxiv.2509.19711,
  title  = {Towards Robust In-Context Learning for Medical Image Segmentation via Data Synthesis},
  author = {Jiesi Hu and Yanwu Yang and Zhiyu Ye and Chenfei Ye and Hanyang Peng and Jianfeng Cao and Ting Ma},
  journal= {arXiv preprint arXiv:2509.19711},
  year   = {2025}
}
R2 v1 2026-07-01T05:53:26.264Z