中文
相关论文

相关论文: Stop Overvaluing Multi-Agent Debate -- We Must Ret…

200 篇论文

Large language models (LLMs) often display sycophancy, a tendency toward excessive agreeability. This behavior poses significant challenges for multi-agent debating systems (MADS) that rely on productive disagreement to refine arguments and…

计算与语言 · 计算机科学 2025-09-30 Binwei Yao , Chao Shang , Wanyu Du , Jianfeng He , Ruixue Lian , Yi Zhang , Hang Su , Sandesh Swamy , Yanjun Qi

While small language models (SLMs) have shown promise on various reasoning tasks, their ability to judge the correctness of answers remains unclear compared to large language models (LLMs). Prior work on LLM-as-a-judge frameworks typically…

人工智能 · 计算机科学 2025-11-21 Zhenyu Bi , Gaurav Srivastava , Yang Li , Meng Lu , Swastik Roy , Morteza Ziyadi , Xuan Wang

Multi-agent large language model (LLM) systems have emerged as a promising approach for clinical diagnosis, leveraging collaboration among agents to refine medical reasoning. However, most existing frameworks rely on single-vendor teams…

计算与语言 · 计算机科学 2026-03-17 Grace Chang Yuan , Xiaoman Zhang , Sung Eun Kim , Pranav Rajpurkar

Large language models (LLMs) have demonstrated strong reasoning, planning, and communication abilities, enabling them to operate as autonomous agents in open environments. While single-agent systems remain limited in adaptability and…

多智能体系统 · 计算机科学 2026-01-22 Jianing Hao , Han Ding , Yuanjian Xu , Tianze Sun , Ran Chen , Wanbo Zhang , Guang Zhang , Siguang Li

Despite the utility of Large Language Models (LLMs) across a wide range of tasks and scenarios, developing a method for reliably evaluating LLMs across varied contexts continues to be challenging. Modern evaluation approaches often use LLMs…

计算与语言 · 计算机科学 2024-01-31 Steffi Chern , Ethan Chern , Graham Neubig , Pengfei Liu

The widespread adoption of Large Language Models (LLMs) raises critical concerns about the factual accuracy of their outputs, especially in high-risk domains such as biomedicine, law, and education. Existing evaluation methods for short…

计算与语言 · 计算机科学 2025-10-30 Yucheng Ning , Xixun Lin , Fang Fang , Yanan Cao

Multi-agent large language model (LLM) and vision-language model (VLM) debate systems employ specialized roles for complex problem-solving, yet model specializations are not leveraged to decide which model should fill which role. We propose…

计算与语言 · 计算机科学 2026-01-27 Miao Zhang , Junsik Kim , Siyuan Xiang , Jian Gao , Cheng Cao

Multi-Agent Debate (MAD) improves LLM-agent accuracy but suffers from rapid context growth, limiting scalability in larger multi-agent settings. Existing methods prune low-utility communications using prior signals, such as token-level…

多智能体系统 · 计算机科学 2026-05-25 Weifan Jiang , Rana Shahout , Minghao Li , Zhenting Qi , Yilun Du , Michael Mitzenmacher , Minlan Yu

Multi-agent systems (MAS) have emerged as a prominent paradigm for leveraging large language models (LLMs) to tackle complex tasks. However, the mechanisms governing the effectiveness of MAS built upon publicly available LLMs, specifically…

多智能体系统 · 计算机科学 2026-05-11 Yuxuan Zhao , Sijia Chen , Ningxin Su

Multi-agent debates have been introduced to improve the accuracy of Large Language Models (LLMs) by having multiple agents discuss solutions to a problem over several rounds of debate. However, models often generate incorrect yet…

计算与语言 · 计算机科学 2025-02-25 Luke Yoffe , Alfonso Amayuelas , William Yang Wang

The rapid evolution of Large Language Model (LLM) agents has produced diverse interaction paradigms, yet few production systems integrate multiple paradigms within a unified architecture. This paper presents a systematic analysis of three…

人工智能 · 计算机科学 2026-05-19 Xiaohua Wang , Chao Han , Kai Yu , XiaoLiang Xu , Liang Wang

Fact-checking research has extensively explored verification but less so the generation of natural-language explanations, crucial for user trust. While Large Language Models (LLMs) excel in text generation, their capability for producing…

计算与语言 · 计算机科学 2024-02-13 Kyungha Kim , Sangyun Lee , Kung-Hsiang Huang , Hou Pong Chan , Manling Li , Heng Ji

In today's digital environment, the rapid propagation of fake news via social networks poses significant social challenges. Most existing detection methods either employ traditional classification models, which suffer from low…

社会与信息网络 · 计算机科学 2025-05-14 Yuhan Liu , Yuxuan Liu , Xiaoqing Zhang , Xiuying Chen , Rui Yan

Large Language Models (LLMs) trained with reinforcement learning and verifiable rewards have achieved strong results on complex reasoning tasks. Recent work extends this paradigm to a multi-agent setting, where a meta-thinking agent…

Therapy recommendation for chronic patients with multimorbidity is challenging due to risks of treatment conflicts. Existing decision support systems face scalability limitations. Inspired by the way in which general practitioners (GP)…

人工智能 · 计算机科学 2025-07-16 Yicong Wu , Ting Chen , Irit Hochberg , Zhoujian Sun , Ruth Edry , Zhengxing Huang , Mor Peleg

Despite the impressive capabilities of large language models, their substantial computational costs, latency, and privacy risks hinder their widespread deployment in real-world applications. Small Language Models (SLMs) with fewer than 10…

计算与语言 · 计算机科学 2026-04-22 Xinlin Wang , Mats Brorsson

Multi-Agent Systems (MAS) built on Large Language Models (LLMs) often exhibit high variance in their reasoning trajectories. Process verification, which evaluates intermediate steps in trajectories, has shown promise in general reasoning…

人工智能 · 计算机科学 2026-02-04 Vishal Venkataramani , Haizhou Shi , Zixuan Ke , Austin Xu , Xiaoxiao He , Yingbo Zhou , Semih Yavuz , Hao Wang , Shafiq Joty

Multi-agent debate (MAD) systems leverage collaborative interactions among large language models (LLMs) agents to improve reasoning capabilities. While recent studies have focused on increasing the accuracy and scalability of MAD systems,…

密码学与安全 · 计算机科学 2025-07-18 Yu Cui , Hongyang Du

Large Language Models (LLMs) have shown exceptional results on current benchmarks when working individually. The advancement in their capabilities, along with a reduction in parameter size and inference times, has facilitated the use of…

计算与语言 · 计算机科学 2024-06-27 Alfonso Amayuelas , Xianjun Yang , Antonis Antoniades , Wenyue Hua , Liangming Pan , William Wang

Multi-agent systems (MAS) built on large language models promise improved problem-solving through collaboration, yet they often fail to consistently outperform strong single-agent baselines due to error propagation at inter-agent message…

人工智能 · 计算机科学 2026-01-21 Bohan Lin , Kuo Yang , Zelin Tan , Yingchuan Lai , Chen Zhang , Guibin Zhang , Xinlei Yu , Miao Yu , Xu Wang , Yudong Zhang , Yang Wang