English

Penalizing Transparency? How AI Disclosure and Author Demographics Shape Human and AI Judgments About Writing

Computers and Society 2025-07-03 v1 Artificial Intelligence

Abstract

As AI integrates in various types of human writing, calls for transparency around AI assistance are growing. However, if transparency operates on uneven ground and certain identity groups bear a heavier cost for being honest, then the burden of openness becomes asymmetrical. This study investigates how AI disclosure statement affects perceptions of writing quality, and whether these effects vary by the author's race and gender. Through a large-scale controlled experiment, both human raters (n = 1,970) and LLM raters (n = 2,520) evaluated a single human-written news article while disclosure statements and author demographics were systematically varied. This approach reflects how both human and algorithmic decisions now influence access to opportunities (e.g., hiring, promotion) and social recognition (e.g., content recommendation algorithms). We find that both human and LLM raters consistently penalize disclosed AI use. However, only LLM raters exhibit demographic interaction effects: they favor articles attributed to women or Black authors when no disclosure is present. But these advantages disappear when AI assistance is revealed. These findings illuminate the complex relationships between AI disclosure and author identity, highlighting disparities between machine and human evaluation patterns.

Keywords

Cite

@article{arxiv.2507.01418,
  title  = {Penalizing Transparency? How AI Disclosure and Author Demographics Shape Human and AI Judgments About Writing},
  author = {Inyoung Cheong and Alicia Guo and Mina Lee and Zhehui Liao and Kowe Kadoma and Dongyoung Go and Joseph Chee Chang and Peter Henderson and Mor Naaman and Amy X. Zhang},
  journal= {arXiv preprint arXiv:2507.01418},
  year   = {2025}
}

Comments

Presented at CHIWORK 2025 Workshop on Generative AI Disclosure, Ownership, and Accountability in Co-Creative Domains