English

Steer Model beyond Assistant: Controlling System Prompt Strength via Contrastive Decoding

Computation and Language 2026-01-13 v1

Abstract

Large language models excel at complex instructions yet struggle to deviate from their helpful assistant persona, as post-training instills strong priors that resist conflicting instructions. We introduce system prompt strength, a training-free method that treats prompt adherence as a continuous control. By contrasting logits from target and default system prompts, we isolate and amplify the behavioral signal unique to the target persona by a scalar factor alpha. Across five diverse benchmarks spanning constraint satisfaction, behavioral control, pluralistic alignment, capability modulation, and stylistic control, our method yields substantial improvements: up to +8.5 strict accuracy on IFEval, +45pp refusal rate on OffTopicEval, and +13% steerability on Prompt-Steering. Our approach enables practitioners to modulate system prompt strength, providing dynamic control over model behavior without retraining.

Keywords

Cite

@article{arxiv.2601.06403,
  title  = {Steer Model beyond Assistant: Controlling System Prompt Strength via Contrastive Decoding},
  author = {Yijiang River Dong and Tiancheng Hu and Zheng Hui and Nigel Collier},
  journal= {arXiv preprint arXiv:2601.06403},
  year   = {2026}
}
R2 v1 2026-07-01T08:58:42.977Z