We introduce a constraint-selection-based experiment design for measuring narrative preferences of Large Language Models (LLMs). This design offers an interpretable lens on LLMs' narrative selection behavior. We developed a library of 200 narratology-grounded constraints and prompted selections from six LLMs under three different instruction types: basic, quality-focused, and creativity-focused. Findings demonstrate that models consistently prioritize Style over narrative content elements like Event, Character, and Setting. Style preferences remain stable across models and instruction types, whereas content elements show cross-model divergence and instructional sensitivity. These results suggest that LLMs have latent narrative preferences, which should inform how the NLP community evaluates and deploys models in creative domains.
@article{arxiv.2510.02025,
title = {Style over Story: Measuring LLM Narrative Preferences via Structured Selection},
author = {Donghoon Jung and Jiwoo Choi and Songeun Chae and Seohyon Jung},
journal= {arXiv preprint arXiv:2510.02025},
year = {2026}
}
Comments
Accepted to ACL 2026 (Findings), camera-ready version