English
Related papers

Related papers: CortexDebate: Debating Sparsely and Equally for Mu…

200 papers

Multi-agent debate (MAD) is widely used to improve large language model (LLM) performance through test-time scaling, yet recent work shows that vanilla MAD often underperforms simple majority vote despite higher computational cost. Studies…

Computation and Language · Computer Science 2026-01-29 Xiaochen Zhu , Caiqi Zhang , Yizhou Chi , Tom Stafford , Nigel Collier , Andreas Vlachos

Multi-agent debate has been shown to improve reasoning in large language models (LLMs). However, it is compute-intensive, requiring generation of long transcripts before answering questions. To address this inefficiency, we develop a…

Artificial Intelligence · Computer Science 2026-04-29 John Seon Keun Yi , Aaron Mueller , Dokyun Lee

Recent studies on LLM agent scaling have highlighted the potential of Multi-Agent Debate (MAD) to enhance reasoning abilities. However, the critical aspect of role allocation strategies remains underexplored. In this study, we demonstrate…

Artificial Intelligence · Computer Science 2025-11-17 Qian Zhang , Yan Zheng , Jinyi Liu , Hebin Liang , Lanjun Wang

Multi-Agent Debate~(MAD) has emerged as a promising paradigm for improving the performance of large language models through collaborative reasoning. Despite recent advances, the key factors driving MAD's effectiveness remain unclear. In…

Computation and Language · Computer Science 2025-10-24 Hyeong Kyu Choi , Xiaojin Zhu , Sharon Li

Large language models (LLMs) have demonstrated remarkable capabilities in language generation, understanding, and few-shot learning in recent years. An extensive body of work has explored how their performance may be further improved…

Computation and Language · Computer Science 2023-05-24 Yilun Du , Shuang Li , Antonio Torralba , Joshua B. Tenenbaum , Igor Mordatch

Multi-Agent Debate (MAD) has emerged as a promising inference scaling method for Large Language Model (LLM) reasoning. However, it frequently suffers from belief entrenchment, where agents reinforce shared errors rather than correcting…

Machine Learning · Computer Science 2026-02-12 Jihwan Oh , Minchan Jeong , Jongwoo Ko , Se-Young Yun

We introduce AgenticSimLaw, a role-structured, multi-agent debate framework that provides transparent and controllable test-time reasoning for high-stakes tabular decision-making tasks. Unlike black-box approaches, our courtroom-style…

Artificial Intelligence · Computer Science 2026-01-30 Jon Chun , Kathrine Elkins , Yong Suk Lee

In today's digital environment, the rapid propagation of fake news via social networks poses significant social challenges. Most existing detection methods either employ traditional classification models, which suffer from low…

Social and Information Networks · Computer Science 2025-05-14 Yuhan Liu , Yuxuan Liu , Xiaoqing Zhang , Xiuying Chen , Rui Yan

As an agent-level reasoning and coordination paradigm, Multi-Agent Debate (MAD) orchestrates multiple agents through structured debate to improve answer quality and support complex reasoning. However, existing research on MAD suffers from…

Artificial Intelligence · Computer Science 2026-01-07 Ao Li , Jinghui Zhang , Luyu Li , Yuxiang Duan , Lang Gao , Mingcai Chen , Weijun Qin , Shaopeng Li , Fengxian Ji , Ning Liu , Lizhen Cui , Xiuying Chen , Yuntao Du

Multi-agent debate (MAD) systems improve LLM reasoning through iterative deliberation, but remain vulnerable to debate collapse, a failure type where final agent decisions are compromised on erroneous reasoning. Existing methods lack…

Multiagent Systems · Computer Science 2026-02-10 Luoxi Tang , Yuqiao Meng , Joseph Costa , Yingxue Zhang , Muchao Ye , Zhaohan Xi

Multi-agent debate (MAD) has demonstrated the ability to augment collective intelligence by scaling test-time compute and leveraging expertise. Current frameworks for multi-agent debate are often designed towards tool use, lack integrated…

Multiagent Systems · Computer Science 2025-12-16 Jonas Becker , Lars Benedikt Kaesberg , Niklas Bauer , Jan Philip Wahle , Terry Ruas , Bela Gipp

Large Language Models (LLMs) excel in various natural language processing tasks but struggle with hallucination issues. Existing solutions have considered utilizing LLMs' inherent reasoning abilities to alleviate hallucination, such as…

Computation and Language · Computer Science 2025-01-16 Yi Fang , Moxin Li , Wenjie Wang , Hui Lin , Fuli Feng

Recent years have witnessed the rapid development of Large Language Model-based Multi-Agent Systems (MAS), which excel at collaborative decision-making and complex problem-solving. Recently, researchers have further investigated Multi-Agent…

Artificial Intelligence · Computer Science 2026-01-12 Zhenghao Li , Zhi Zheng , Wei Chen , Jielun Zhao , Yong Chen , Tong Xu , Enhong Chen

Large Language Models (LLMs) have shown impressive capabilities in various applications, but they still face various inconsistency issues. Existing works primarily focus on the inconsistency issues within a single LLM, while we…

Computation and Language · Computer Science 2024-11-15 Kai Xiong , Xiao Ding , Yixin Cao , Ting Liu , Bing Qin

Multi-agent debate (MAD) systems increasingly rely on shared memory to support long-horizon reasoning, but this convenience opens a critical vulnerability: a single corrupted entry can contaminate the downstream memory-augmented reasoning,…

Artificial Intelligence · Computer Science 2026-05-12 Yuqiao Meng , Sakshi Sunil Narvekar , Luoxi Tang , Rupali Rajendra Vaje , Yingxue Zhang , Muchao Ye , Zhaohan Xi

Multi-agent debate has proven effective in improving large language models quality for reasoning and factuality tasks. While various role-playing strategies in multi-agent debates have been explored, in terms of the communication among…

Computation and Language · Computer Science 2024-06-18 Yunxuan Li , Yibing Du , Jiageng Zhang , Le Hou , Peter Grabowski , Yeqing Li , Eugene Ie

Recent advancements in large language models (LLMs) have given rise to the LLM-as-a-judge paradigm, showcasing their potential to deliver human-like judgments. However, in the field of machine translation (MT) evaluation, current…

Computation and Language · Computer Science 2025-02-21 Zhaopeng Feng , Jiayuan Su , Jiamei Zheng , Jiahan Ren , Yan Zhang , Jian Wu , Hongwei Wang , Zuozhu Liu

Multi-Agent Debate (MAD) has shown promise in leveraging collective intelligence to improve reasoning and reduce hallucinations, yet it remains unclear how information exchange shapes the underlying ability. Empirically, MAD exhibits…

Multiagent Systems · Computer Science 2026-03-03 Dan Qiao , Binbin Chen , Fengyu Cai , Jianlong Chen , Wenhao Li , Fuxin Jiang , Zuzhi Chen , Hongyuan Zha , Tieying Zhang , Baoxiang Wang

Multimodal Large Language Models (MLLMs) in healthcare suffer from severe confirmation bias, often hallucinating visual details to support initial, potentially erroneous diagnostic hypotheses. Existing Chain-of-Thought (CoT) approaches lack…

Computation and Language · Computer Science 2026-04-14 Zhixiang Lu , Jionglong Su

Multi-agent debate (MAD) systems leverage collective intelligence to enhance reasoning capabilities, yet existing approaches struggle to simultaneously optimize accuracy, consensus formation, and computational efficiency. Static topology…

Artificial Intelligence · Computer Science 2026-03-02 Chao Wang , Han Lin , Huaze Tang , Huijing Lin , Wenbo Ding