English
Related papers

Related papers: Stop Overvaluing Multi-Agent Debate -- We Must Ret…

200 papers

Multi-agent debate (MAD) has recently emerged as a promising framework for improving the reasoning performance of large language models (LLMs). Yet, whether LLM agents can genuinely engage in deliberative reasoning, beyond simple ensembling…

Multiagent Systems · Computer Science 2025-11-12 Haolun Wu , Zhenkun Li , Lingyao Li

Recent years have witnessed the rapid development of Large Language Model-based Multi-Agent Systems (MAS), which excel at collaborative decision-making and complex problem-solving. Recently, researchers have further investigated Multi-Agent…

Artificial Intelligence · Computer Science 2026-01-12 Zhenghao Li , Zhi Zheng , Wei Chen , Jielun Zhao , Yong Chen , Tong Xu , Enhong Chen

Argument Mining (AM) is a foundational technology for automated writing evaluation, yet traditional supervised approaches rely heavily on expensive, domain-specific fine-tuning. While Large Language Models (LLMs) offer a training-free…

Computation and Language · Computer Science 2026-03-31 Jakub Bąba , Jarosław A. Chudziak

Modern large language models (LLMs) like ChatGPT have shown remarkable performance on general language tasks but still struggle on complex reasoning tasks, which drives the research on cognitive behaviors of LLMs to explore human-like…

Computation and Language · Computer Science 2024-10-10 Tian Liang , Zhiwei He , Wenxiang Jiao , Xing Wang , Yan Wang , Rui Wang , Yujiu Yang , Shuming Shi , Zhaopeng Tu

LLM-as-Judge has emerged as a scalable alternative to human evaluation, enabling large language models (LLMs) to provide reward signals in trainings. While recent work has explored multi-agent extensions such as multi-agent debate and…

Artificial Intelligence · Computer Science 2025-09-19 Chiyu Ma , Enpei Zhang , Yilun Zhao , Wenjun Liu , Yaning Jia , Peijun Qing , Lin Shi , Arman Cohan , Yujun Yan , Soroush Vosoughi

Large Language Models (LLMs) have shown remarkable reasoning capabilities in mathematical and scientific tasks. To enhance complex reasoning, multi-agent systems have been proposed to harness the collective intelligence of LLM agents.…

Artificial Intelligence · Computer Science 2025-10-22 Zhenyu Bi , Meng Lu , Yang Li , Swastik Roy , Weijie Guan , Morteza Ziyadi , Xuan Wang

Recent interest in Multi-Agent Systems of Large Language Models (MAS LLMs) has led to an increase in frameworks leveraging multiple LLMs to tackle complex tasks. However, much of this literature appropriates the terminology of MAS without…

Multi-Agent Debate (MAD) is a collaborative framework in which multiple agents iteratively refine solutions through the generation of reasoning and alternating critique cycles. Current work primarily optimizes intra-round topologies and…

Multiagent Systems · Computer Science 2026-04-14 Yiqing Liu , Hantao Yao , Wu Liu , Allen He , Yongdong Zhang

Multi-agent debate system (MAD) imitating the process of human discussion in pursuit of truth, aims to align the correct cognition of different agents for the optimal solution. It is challenging to make various agents perform right and…

Computation and Language · Computer Science 2024-07-12 Haotian Wang , Xiyuan Du , Weijiang Yu , Qianglong Chen , Kun Zhu , Zheng Chu , Lian Yan , Yi Guan

While state-of-the-art language models have achieved impressive results, they remain susceptible to inference-time adversarial attacks, such as adversarial prompts generated by red teams arXiv:2209.07858. One approach proposed to improve…

Computation and Language · Computer Science 2024-01-12 Steffi Chern , Zhen Fan , Andy Liu

Text evaluation has historically posed significant challenges, often demanding substantial labor and time cost. With the emergence of large language models (LLMs), researchers have explored LLMs' potential as alternatives for human…

Computation and Language · Computer Science 2023-08-15 Chi-Min Chan , Weize Chen , Yusheng Su , Jianxuan Yu , Wei Xue , Shanghang Zhang , Jie Fu , Zhiyuan Liu

Nowadays, single Large Language Model (LLM) struggles with critical issues such as hallucination and inadequate reasoning abilities. To mitigate these issues, Multi-Agent Debate (MAD) has emerged as an effective strategy, where LLM agents…

Artificial Intelligence · Computer Science 2025-07-08 Yiliu Sun , Zicheng Zhao , Sheng Wan , Chen Gong

Large Language Models (LLMs) have exhibited impressive capabilities across diverse application domains. Recent work has explored Multi-LLM Agent Debate (MAD) as a way to enhance performance by enabling multiple LLMs to discuss and refine…

Computation and Language · Computer Science 2026-05-27 Xuhang Chen , Zhifan Song , Deyi Ji , Shuo Gao , Lanyun Zhu

Multi-agent debate (MAD) systems leverage collective intelligence to enhance reasoning capabilities, yet existing approaches struggle to simultaneously optimize accuracy, consensus formation, and computational efficiency. Static topology…

Artificial Intelligence · Computer Science 2026-03-02 Chao Wang , Han Lin , Huaze Tang , Huijing Lin , Wenbo Ding

This paper is concerned with evaluating different multiagent learning (MAL) algorithms in problems where individual agents may be heterogenous, in the sense of utilizing different learning strategies, without the opportunity for prior…

Multiagent Systems · Computer Science 2019-07-23 Stefano V. Albrecht , Subramanian Ramamoorthy

Large Language Models (LLMs) are increasingly deployed as reasoning systems, where reasoning paradigms - such as Chain-of-Thought (CoT) and multi-agent systems (MAS) - play a critical role, yet their relative effectiveness and cost-accuracy…

Machine Learning · Computer Science 2026-01-21 Yapeng Li , Jiakuo Yu , Zhixin Liu , Xinnan Liu , Jing Yu , Songze Li , Tonghua Su

Large Language Models (LLMs) need to adapt their predictions to diverse cultural contexts to benefit diverse communities across the world. While previous efforts have focused on single-LLM, single-turn approaches, we propose to exploit the…

Computation and Language · Computer Science 2025-09-03 Dayeon Ki , Rachel Rudinger , Tianyi Zhou , Marine Carpuat

As AI agents evolve, the community is rapidly shifting from single Large Language Models (LLMs) to Multi-Agent Systems (MAS) to overcome cognitive bottlenecks in automated research. However, the optimal multi-agent coordination framework…

Multiagent Systems · Computer Science 2026-05-12 Yang Shen , Zhenyi Yi , Ziyi Zhao , Lijun Sun , Dongyang Li , Chin-Teng Lin , Yuhui Shi

Generative Large Language Models (LLMs) have demonstrated remarkable performance across a wide range of tasks. Recent research has introduced Multi-Agent Debate (MAD) systems, which leverage multiple LLMs to simulate human debate and…

Computation and Language · Computer Science 2025-09-18 Zijie Lin , Bryan Hooi

Multi-Agent Debate (MAD) has shown promise in leveraging collective intelligence to improve reasoning and reduce hallucinations, yet it remains unclear how information exchange shapes the underlying ability. Empirically, MAD exhibits…

Multiagent Systems · Computer Science 2026-03-03 Dan Qiao , Binbin Chen , Fengyu Cai , Jianlong Chen , Wenhao Li , Fuxin Jiang , Zuzhi Chen , Hongyuan Zha , Tieying Zhang , Baoxiang Wang