English

Conflicts Make Large Reasoning Models Vulnerable to Attacks

Cryptography and Security 2026-04-14 v1 Artificial Intelligence

Abstract

Large Reasoning Models (LRMs) have achieved remarkable performance across diverse domains, yet their decision-making under conflicting objectives remains insufficiently understood. This work investigates how LRMs respond to harmful queries when confronted with two categories of conflicts: internal conflicts that pit alignment values against each other and dilemmas, which impose mutually contradictory choices, including sacrificial, duress, agent-centered, and social forms. Using over 1,300 prompts across five benchmarks, we evaluate three representative LRMs - Llama-3.1-Nemotron-8B, QwQ-32B, and DeepSeek R1 - and find that conflicts significantly increase attack success rates, even under single-round non-narrative queries without sophisticated auto-attack techniques. Our findings reveal through layerwise and neuron-level analyses that safety-related and functional representations shift and overlap under conflict, interfering with safety-aligned behavior. This study highlights the need for deeper alignment strategies to ensure the robustness and trustworthiness of next-generation reasoning models. Our code is available at https://github.com/DataArcTech/ConflictHarm. Warning: This paper contains inappropriate, offensive and harmful content.

Keywords

Cite

@article{arxiv.2604.09750,
  title  = {Conflicts Make Large Reasoning Models Vulnerable to Attacks},
  author = {Honghao Liu and Chengjin Xu and Xuhui Jiang and Cehao Yang and Shengming Yin and Zhengwu Ma and Lionel Ni and Jian Guo},
  journal= {arXiv preprint arXiv:2604.09750},
  year   = {2026}
}
R2 v1 2026-07-01T12:03:35.737Z