English

As X, Do Y: How Persona and Task Combine in Instruction-Tuned LLMs

Computation and Language 2026-05-25 v1 Artificial Intelligence

Abstract

Role prompts of the form As X, do Y admit a clean linear decomposition at one specific site in the residual stream: the prompt-to-answer transition -- the last prompt token together with the first two generated tokens -- in an early/mid layer band. There, persona and task contribute through partially orthogonal additive directions. Forming a pure persona effect ΔX\Delta_X, a pure task effect ΔY\Delta_Y, and substituting hBB+ΔX+ΔYh_{BB} + \Delta_X + \Delta_Y for the clean residual yields downstream output within a small KL of clean on Gemma-2-2B-IT and Qwen-2.5-\{1.5B, 3B\}-Instruct, across a 12-cell short grid and a 48-cell long-persona grid, with persona-specific behavioral markers preserved. The natural inference from this additive structure is that the role prompt can be compressed into a single cached residual vector. \emph{We show it cannot.} Injecting the cached additive prediction -- or even the oracle clean residual hXYh_{XY} -- into a baseline host prompt with the persona text removed does not approach the clean long-persona target, at one site or at many layers. Persona-conditioned multi-token generation flows through attention back to the persona-text positions throughout the prompt, which no residual at one site reproduces. Local additivity in the residual stream does not imply prompt compressibility. The additive structure at the prompt-to-answer transition supports interpretability and fine-grained steering of persona or task contributions; persona-conditioned behavior across the full continuation depends on a distributed prompt/KV mechanism that local activation arithmetic does not displace.

Keywords

Cite

@article{arxiv.2605.23147,
  title  = {As X, Do Y: How Persona and Task Combine in Instruction-Tuned LLMs},
  author = {Eric Xu},
  journal= {arXiv preprint arXiv:2605.23147},
  year   = {2026}
}

Comments

12 pages, 1 figure. Code: https://github.com/xuy/localized-additive-composition