English

L-MAD: A Systematic Evaluation of Multi-Agent Debate Structures in Legal Reasoning

Artificial Intelligence 2026-07-10 v1

Abstract

While multi-agent debate (MAD) frameworks have shown significant potential in general reasoning, their effectiveness in highly structured, knowledge-heavy legal domains remains under-explored. In this work, we introduce the Legal Multi-Agent Debate (L-MAD) framework to systematically evaluate different debate structures and aggregation methods within Legal Textual Entailment. By assigning distinct expert personas to multiple agents, L-MAD improves upon strong single-agent baselines by up to 8\%. Furthermore, analyzing how debate scales reveals a clear trade-off: increasing the agent population reduces inconsistency and improves accuracy, whereas extending discussion rounds induces a detrimental \textit{over-deliberation drift} where agents reinforce each other's mistakes. Ultimately, our findings outline the practical boundaries and safety margins of deploying collaborative multi-agent systems in high-stakes legal reasoning environments.

Keywords

Cite

@article{arxiv.2607.09099,
  title  = {L-MAD: A Systematic Evaluation of Multi-Agent Debate Structures in Legal Reasoning},
  author = {Tan-Minh Nguyen and Hoang-Trung Nguyen and Huu-Dong Nguyen and Dinh-Truong Do and Thi-Hai-Yen Vuong and Le-Minh Nguyen},
  journal= {arXiv preprint arXiv:2607.09099},
  year   = {2026}
}

Comments

Outstanding paper in the AI4Law Workshop at ICML 2026