English

Acquiescence Bias in Large Language Models

Computation and Language 2025-09-11 v1

Abstract

Acquiescence bias, i.e. the tendency of humans to agree with statements in surveys, independent of their actual beliefs, is well researched and documented. Since Large Language Models (LLMs) have been shown to be very influenceable by relatively small changes in input and are trained on human-generated data, it is reasonable to assume that they could show a similar tendency. We present a study investigating the presence of acquiescence bias in LLMs across different models, tasks, and languages (English, German, and Polish). Our results indicate that, contrary to humans, LLMs display a bias towards answering no, regardless of whether it indicates agreement or disagreement.

Keywords

Cite

@article{arxiv.2509.08480,
  title  = {Acquiescence Bias in Large Language Models},
  author = {Daniel Braun},
  journal= {arXiv preprint arXiv:2509.08480},
  year   = {2025}
}

Comments

Accepted to EMNLP 2025 Findings

R2 v1 2026-07-01T05:29:52.679Z