English

Text-to-Image Models Leave Identifiable Signatures: Implications for Leaderboard Security

Machine Learning 2025-10-09 v1 Cryptography and Security

Abstract

Generative AI leaderboards are central to evaluating model capabilities, but remain vulnerable to manipulation. Among key adversarial objectives is rank manipulation, where an attacker must first deanonymize the models behind displayed outputs -- a threat previously demonstrated and explored for large language models (LLMs). We show that this problem can be even more severe for text-to-image leaderboards, where deanonymization is markedly easier. Using over 150,000 generated images from 280 prompts and 19 diverse models spanning multiple organizations, architectures, and sizes, we demonstrate that simple real-time classification in CLIP embedding space identifies the generating model with high accuracy, even without prompt control or historical data. We further introduce a prompt-level separability metric and identify prompts that enable near-perfect deanonymization. Our results indicate that rank manipulation in text-to-image leaderboards is easier than previously recognized, underscoring the need for stronger defenses.

Keywords

Cite

@article{arxiv.2510.06525,
  title  = {Text-to-Image Models Leave Identifiable Signatures: Implications for Leaderboard Security},
  author = {Ali Naseh and Anshuman Suri and Yuefeng Peng and Harsh Chaudhari and Alina Oprea and Amir Houmansadr},
  journal= {arXiv preprint arXiv:2510.06525},
  year   = {2025}
}

Comments

Accepted at Lock-LLM Workshop, NeurIPS 2025

R2 v1 2026-07-01T06:22:49.209Z