English

Debating Truth: Debate-driven Claim Verification with Multiple Large Language Model Agents

Computation and Language 2026-04-06 v4

Abstract

State-of-the-art single-agent claim verification methods struggle with complex claims that require nuanced analysis of multifaceted evidence. Inspired by real-world professional fact-checkers, we propose \textbf{DebateCV}, the first debate-driven claim verification framework powered by multiple LLM agents. In DebateCV, two \textit{Debaters} argue opposing stances to surface subtle errors in single-agent assessments. A decisive \textit{Moderator} is then required to weigh the evidential strength of conflicting arguments to deliver an accurate verdict. Yet, zero-shot Moderators are biased toward neutral judgments, and no datasets exist for training them. To bridge this gap, we propose \textbf{Debate-SFT}, a post-training framework that leverages synthetic data to enhance agents' ability to effectively adjudicate debates for claim verification. Results show that our methods surpass state-of-the-art non-debate approaches in both accuracy (across various evidence conditions) and justification quality.

Keywords

Cite

@article{arxiv.2507.19090,
  title  = {Debating Truth: Debate-driven Claim Verification with Multiple Large Language Model Agents},
  author = {Haorui He and Yupeng Li and Dacheng Wen and Yang Chen and Reynold Cheng and Donglong Chen and Francis C. M. Lau},
  journal= {arXiv preprint arXiv:2507.19090},
  year   = {2026}
}

Comments

Accepted by the ACM Web Conference 2026 (WWW 2026)

R2 v1 2026-07-01T04:18:31.975Z