English

LLM Review: Enhancing Creative Writing via Blind Peer Review Feedback

Computation and Language 2026-01-14 v1 Artificial Intelligence Multiagent Systems

Abstract

Large Language Models (LLMs) often struggle with creative generation, and multi-agent frameworks that improve reasoning through interaction can paradoxically hinder creativity by inducing content homogenization. We introduce LLM Review, a peer-review-inspired framework implementing Blind Peer Review: agents exchange targeted feedback while revising independently, preserving divergent creative trajectories. To enable rigorous evaluation, we propose SciFi-100, a science fiction writing dataset with a unified framework combining LLM-as-a-judge scoring, human annotation, and rule-based novelty metrics. Experiments demonstrate that LLM Review consistently outperforms multi-agent baselines, and smaller models with our framework can surpass larger single-agent models, suggesting interaction structure may substitute for model scale.

Keywords

Cite

@article{arxiv.2601.08003,
  title  = {LLM Review: Enhancing Creative Writing via Blind Peer Review Feedback},
  author = {Weiyue Li and Mingxiao Song and Zhenda Shen and Dachuan Zhao and Yunfan Long and Yi Li and Yongce Li and Ruyi Yang and Mengyu Wang},
  journal= {arXiv preprint arXiv:2601.08003},
  year   = {2026}
}