English

Explainable Synthetic Image Detection through Diffusion Timestep Ensembling

Computer Vision and Pattern Recognition 2025-07-29 v2 Artificial Intelligence Computation and Language

Abstract

Recent advances in diffusion models have enabled the creation of deceptively real images, posing significant security risks when misused. In this study, we empirically show that different timesteps of DDIM inversion reveal varying subtle distinctions between synthetic and real images that are extractable for detection, in the forms of such as Fourier power spectrum high-frequency discrepancies and inter-pixel variance distributions. Based on these observations, we propose a novel synthetic image detection method that directly utilizes features of intermediately noised images by training an ensemble on multiple noised timesteps, circumventing conventional reconstruction-based strategies. To enhance human comprehension, we introduce a metric-grounded explanation generation and refinement module to identify and explain AI-generated flaws. Additionally, we construct the GenHard and GenExplain benchmarks to provide detection samples of greater difficulty and high-quality rationales for fake images. Extensive experiments show that our method achieves state-of-the-art performance with 98.91% and 95.89% detection accuracy on regular and challenging samples respectively, and demonstrates generalizability and robustness. Our code and datasets are available at https://github.com/Shadowlized/ESIDE.

Keywords

Cite

@article{arxiv.2503.06201,
  title  = {Explainable Synthetic Image Detection through Diffusion Timestep Ensembling},
  author = {Yixin Wu and Feiran Zhang and Tianyuan Shi and Ruicheng Yin and Zhenghua Wang and Zhenliang Gan and Xiaohua Wang and Changze Lv and Xiaoqing Zheng and Xuanjing Huang},
  journal= {arXiv preprint arXiv:2503.06201},
  year   = {2025}
}

Comments

16 pages, 8 figures

R2 v1 2026-06-28T22:12:06.929Z