English

Style over Story: Measuring LLM Narrative Preferences via Structured Selection

Computation and Language 2026-04-21 v4

Abstract

We introduce a constraint-selection-based experiment design for measuring narrative preferences of Large Language Models (LLMs). This design offers an interpretable lens on LLMs' narrative selection behavior. We developed a library of 200 narratology-grounded constraints and prompted selections from six LLMs under three different instruction types: basic, quality-focused, and creativity-focused. Findings demonstrate that models consistently prioritize Style over narrative content elements like Event, Character, and Setting. Style preferences remain stable across models and instruction types, whereas content elements show cross-model divergence and instructional sensitivity. These results suggest that LLMs have latent narrative preferences, which should inform how the NLP community evaluates and deploys models in creative domains.

Keywords

Cite

@article{arxiv.2510.02025,
  title  = {Style over Story: Measuring LLM Narrative Preferences via Structured Selection},
  author = {Donghoon Jung and Jiwoo Choi and Songeun Chae and Seohyon Jung},
  journal= {arXiv preprint arXiv:2510.02025},
  year   = {2026}
}

Comments

Accepted to ACL 2026 (Findings), camera-ready version

R2 v1 2026-07-01T06:13:15.885Z