English

A Semantically Enhanced Generative Foundation Model Improves Pathological Image Synthesis

Computer Vision and Pattern Recognition 2025-12-17 v2 Artificial Intelligence

Abstract

The development of clinical-grade artificial intelligence in pathology is limited by the scarcity of diverse, high-quality annotated datasets. Generative models offer a potential solution but suffer from semantic instability and morphological hallucinations that compromise diagnostic reliability. To address this challenge, we introduce a Correlation-Regulated Alignment Framework for Tissue Synthesis (CRAFTS), the first generative foundation model for pathology-specific text-to-image synthesis. By leveraging a dual-stage training strategy on approximately 2.8 million image-caption pairs, CRAFTS incorporates a novel alignment mechanism that suppresses semantic drift to ensure biological accuracy. This model generates diverse pathological images spanning 30 cancer types, with quality rigorously validated by objective metrics and pathologist evaluations. Furthermore, CRAFTS-augmented datasets enhance the performance across various clinical tasks, including classification, cross-modal retrieval, self-supervised learning, and visual question answering. In addition, coupling CRAFTS with ControlNet enables precise control over tissue architecture from inputs such as nuclear segmentation masks and fluorescence images. By overcoming the critical barriers of data scarcity and privacy concerns, CRAFTS provides a limitless source of diverse, annotated histology data, effectively unlocking the creation of robust diagnostic tools for rare and complex cancer phenotypes.

Keywords

Cite

@article{arxiv.2512.13164,
  title  = {A Semantically Enhanced Generative Foundation Model Improves Pathological Image Synthesis},
  author = {Xianchao Guan and Zhiyuan Fan and Yifeng Wang and Fuqiang Chen and Yanjiang Zhou and Zengyang Che and Hongxue Meng and Xin Li and Yaowei Wang and Hongpeng Wang and Min Zhang and Heng Tao Shen and Zheng Zhang and Yongbing Zhang},
  journal= {arXiv preprint arXiv:2512.13164},
  year   = {2025}
}

Comments

68 pages, 9 figures, 16 tables

R2 v1 2026-07-01T08:24:57.902Z