English

SafeReview: Defending LLM-based Review Systems Against Adversarial Hidden Prompts

Computation and Language 2026-05-29 v2 Cryptography and Security

Abstract

As Large Language Models (LLMs) are increasingly integrated into academic peer review, their vulnerability to adversarial hidden prompts, i.e., adversarial instructions embedded in submissions to manipulate outcomes, poses a critical threat to scholarly integrity. We propose SafeReview, a co-evolutionary adversarial training framework for defending LLM-based peer review systems against such attacks. SafeReview jointly trains a Generator model to create sophisticated attack prompts and a Defender model to preserve review integrity under adversarial manipulation. The Generator is optimized to produce increasingly effective prompt injections, while the Defender is strengthened through preference-based training to maintain consistent reviews between clean and attacked submissions. Experimental results show that SafeReview improves robustness against adaptive prompt injection attacks, better preserves paper ranking under attack, and generalizes across attacker architectures compared with static defenses. These results demonstrate the potential of co-evolutionary training as a foundation for securing LLM-assisted peer review.

Keywords

Cite

@article{arxiv.2604.26506,
  title  = {SafeReview: Defending LLM-based Review Systems Against Adversarial Hidden Prompts},
  author = {Yuan Xin and Yixuan Weng and Minjun Zhu and Ying Ling and Chengwei Qin and Michael Backes and Yue Zhang and Linyi Yang},
  journal= {arXiv preprint arXiv:2604.26506},
  year   = {2026}
}

Comments

17 pages, 5 figures, 8 tables