English
Related papers

Related papers: Stop Overvaluing Multi-Agent Debate -- We Must Ret…

200 papers

Large language models (LLMs) often display sycophancy, a tendency toward excessive agreeability. This behavior poses significant challenges for multi-agent debating systems (MADS) that rely on productive disagreement to refine arguments and…

Computation and Language · Computer Science 2025-09-30 Binwei Yao , Chao Shang , Wanyu Du , Jianfeng He , Ruixue Lian , Yi Zhang , Hang Su , Sandesh Swamy , Yanjun Qi

While small language models (SLMs) have shown promise on various reasoning tasks, their ability to judge the correctness of answers remains unclear compared to large language models (LLMs). Prior work on LLM-as-a-judge frameworks typically…

Artificial Intelligence · Computer Science 2025-11-21 Zhenyu Bi , Gaurav Srivastava , Yang Li , Meng Lu , Swastik Roy , Morteza Ziyadi , Xuan Wang

Multi-agent large language model (LLM) systems have emerged as a promising approach for clinical diagnosis, leveraging collaboration among agents to refine medical reasoning. However, most existing frameworks rely on single-vendor teams…

Computation and Language · Computer Science 2026-03-17 Grace Chang Yuan , Xiaoman Zhang , Sung Eun Kim , Pranav Rajpurkar

Large language models (LLMs) have demonstrated strong reasoning, planning, and communication abilities, enabling them to operate as autonomous agents in open environments. While single-agent systems remain limited in adaptability and…

Multiagent Systems · Computer Science 2026-01-22 Jianing Hao , Han Ding , Yuanjian Xu , Tianze Sun , Ran Chen , Wanbo Zhang , Guang Zhang , Siguang Li

Despite the utility of Large Language Models (LLMs) across a wide range of tasks and scenarios, developing a method for reliably evaluating LLMs across varied contexts continues to be challenging. Modern evaluation approaches often use LLMs…

Computation and Language · Computer Science 2024-01-31 Steffi Chern , Ethan Chern , Graham Neubig , Pengfei Liu

The widespread adoption of Large Language Models (LLMs) raises critical concerns about the factual accuracy of their outputs, especially in high-risk domains such as biomedicine, law, and education. Existing evaluation methods for short…

Computation and Language · Computer Science 2025-10-30 Yucheng Ning , Xixun Lin , Fang Fang , Yanan Cao

Multi-agent large language model (LLM) and vision-language model (VLM) debate systems employ specialized roles for complex problem-solving, yet model specializations are not leveraged to decide which model should fill which role. We propose…

Computation and Language · Computer Science 2026-01-27 Miao Zhang , Junsik Kim , Siyuan Xiang , Jian Gao , Cheng Cao

Multi-Agent Debate (MAD) improves LLM-agent accuracy but suffers from rapid context growth, limiting scalability in larger multi-agent settings. Existing methods prune low-utility communications using prior signals, such as token-level…

Multiagent Systems · Computer Science 2026-05-25 Weifan Jiang , Rana Shahout , Minghao Li , Zhenting Qi , Yilun Du , Michael Mitzenmacher , Minlan Yu

Multi-agent systems (MAS) have emerged as a prominent paradigm for leveraging large language models (LLMs) to tackle complex tasks. However, the mechanisms governing the effectiveness of MAS built upon publicly available LLMs, specifically…

Multiagent Systems · Computer Science 2026-05-11 Yuxuan Zhao , Sijia Chen , Ningxin Su

Multi-agent debates have been introduced to improve the accuracy of Large Language Models (LLMs) by having multiple agents discuss solutions to a problem over several rounds of debate. However, models often generate incorrect yet…

Computation and Language · Computer Science 2025-02-25 Luke Yoffe , Alfonso Amayuelas , William Yang Wang

The rapid evolution of Large Language Model (LLM) agents has produced diverse interaction paradigms, yet few production systems integrate multiple paradigms within a unified architecture. This paper presents a systematic analysis of three…

Artificial Intelligence · Computer Science 2026-05-19 Xiaohua Wang , Chao Han , Kai Yu , XiaoLiang Xu , Liang Wang

Fact-checking research has extensively explored verification but less so the generation of natural-language explanations, crucial for user trust. While Large Language Models (LLMs) excel in text generation, their capability for producing…

Computation and Language · Computer Science 2024-02-13 Kyungha Kim , Sangyun Lee , Kung-Hsiang Huang , Hou Pong Chan , Manling Li , Heng Ji

In today's digital environment, the rapid propagation of fake news via social networks poses significant social challenges. Most existing detection methods either employ traditional classification models, which suffer from low…

Social and Information Networks · Computer Science 2025-05-14 Yuhan Liu , Yuxuan Liu , Xiaoqing Zhang , Xiuying Chen , Rui Yan

Large Language Models (LLMs) trained with reinforcement learning and verifiable rewards have achieved strong results on complex reasoning tasks. Recent work extends this paradigm to a multi-agent setting, where a meta-thinking agent…

Artificial Intelligence · Computer Science 2025-11-05 Zhiwei Zhang , Xiaomin Li , Yudi Lin , Hui Liu , Ramraj Chandradevan , Linlin Wu , Minhua Lin , Fali Wang , Xianfeng Tang , Qi He , Suhang Wang

Therapy recommendation for chronic patients with multimorbidity is challenging due to risks of treatment conflicts. Existing decision support systems face scalability limitations. Inspired by the way in which general practitioners (GP)…

Artificial Intelligence · Computer Science 2025-07-16 Yicong Wu , Ting Chen , Irit Hochberg , Zhoujian Sun , Ruth Edry , Zhengxing Huang , Mor Peleg

Despite the impressive capabilities of large language models, their substantial computational costs, latency, and privacy risks hinder their widespread deployment in real-world applications. Small Language Models (SLMs) with fewer than 10…

Computation and Language · Computer Science 2026-04-22 Xinlin Wang , Mats Brorsson

Multi-Agent Systems (MAS) built on Large Language Models (LLMs) often exhibit high variance in their reasoning trajectories. Process verification, which evaluates intermediate steps in trajectories, has shown promise in general reasoning…

Artificial Intelligence · Computer Science 2026-02-04 Vishal Venkataramani , Haizhou Shi , Zixuan Ke , Austin Xu , Xiaoxiao He , Yingbo Zhou , Semih Yavuz , Hao Wang , Shafiq Joty

Multi-agent debate (MAD) systems leverage collaborative interactions among large language models (LLMs) agents to improve reasoning capabilities. While recent studies have focused on increasing the accuracy and scalability of MAD systems,…

Cryptography and Security · Computer Science 2025-07-18 Yu Cui , Hongyang Du

Large Language Models (LLMs) have shown exceptional results on current benchmarks when working individually. The advancement in their capabilities, along with a reduction in parameter size and inference times, has facilitated the use of…

Computation and Language · Computer Science 2024-06-27 Alfonso Amayuelas , Xianjun Yang , Antonis Antoniades , Wenyue Hua , Liangming Pan , William Wang

Multi-agent systems (MAS) built on large language models promise improved problem-solving through collaboration, yet they often fail to consistently outperform strong single-agent baselines due to error propagation at inter-agent message…

Artificial Intelligence · Computer Science 2026-01-21 Bohan Lin , Kuo Yang , Zelin Tan , Yingchuan Lai , Chen Zhang , Guibin Zhang , Xinlei Yu , Miao Yu , Xu Wang , Yudong Zhang , Yang Wang