English

Open-source LLMs administer maximum electric shocks in a Milgram-like obedience experiment

Computers and Society 2026-05-21 v1 Artificial Intelligence

Abstract

Large language models (LLMs) are increasingly deployed as autonomous agents that make sequences of decisions over extended interactions in high-stakes domains. However, the behavior of LLMs under sustained authority pressure is still an open question with direct implications for the safety of agentic pipelines. We ran a variation of Milgram's obedience experiment on 11 open-source LLMs and found that most models reached or approached the final shock level before refusing, across 8 conditions with 30 trials per model per condition. We found four main takeaways: (1) LLMs are subject to pressure, and they comply despite explicitly expressing distress, just like human subjects did in the original experiment; (2) LLMs are vulnerable to gradual boundary/value violations; (3) when LLMs refuse, they may ignore the response format requirements, so the response is discarded by the orchestrator, which causes a retry that can result in compliance with the underlying request even when refusal was intended initially; (4) we hypothesise that there is a low-level token pattern continuation attractor that might be contributing to compliance, overriding higher level processing of the situation's meaning and values.

Keywords

Cite

@article{arxiv.2605.21401,
  title  = {Open-source LLMs administer maximum electric shocks in a Milgram-like obedience experiment},
  author = {Roland Pihlakas and Jan Llenzl Dagohoy},
  journal= {arXiv preprint arXiv:2605.21401},
  year   = {2026}
}

Comments

28 pages, 16 figures, 16 tables

R2 v1 2026-07-22T07:24:24.634Z