English

Misalignment Bounty: Crowdsourcing AI Agent Misbehavior

Artificial Intelligence 2025-11-06 v2

Abstract

Advanced AI systems sometimes act in ways that differ from human intent. To gather clear, reproducible examples, we ran the Misalignment Bounty: a crowdsourced project that collected cases of agents pursuing unintended or unsafe goals. The bounty received 295 submissions, of which nine were awarded. This report explains the program's motivation and evaluation criteria, and walks through the nine winning submissions step by step.

Keywords

Cite

@article{arxiv.2510.19738,
  title  = {Misalignment Bounty: Crowdsourcing AI Agent Misbehavior},
  author = {Rustem Turtayev and Natalia Fedorova and Oleg Serikov and Sergey Koldyba and Lev Avagyan and Dmitrii Volkov},
  journal= {arXiv preprint arXiv:2510.19738},
  year   = {2025}
}

Comments

Add Limitations section

R2 v1 2026-07-01T07:00:05.485Z