中文
相关论文

相关论文: Stop Overvaluing Multi-Agent Debate -- We Must Ret…

200 篇论文

Current Large Language Model (LLM) agents demonstrate strong reasoning and tool use capabilities, but often lack self-awareness, failing to balance these approaches effectively. This imbalance leads to Tool Overuse, where models…

人工智能 · 计算机科学 2025-05-27 Cheng Qian , Emre Can Acikgoz , Hongru Wang , Xiusi Chen , Avirup Sil , Dilek Hakkani-Tür , Gokhan Tur , Heng Ji

In multi-agent debate (MAD) systems, performance gains are often reported; however, because the debate protocol (e.g., number of agents, rounds, and aggregation rule) is typically held fixed while model-related factors vary, it is difficult…

多智能体系统 · 计算机科学 2026-04-01 Ramtin Zargari Marandi

This paper presents a benchmark self-evolving framework to dynamically evaluate rapidly advancing Large Language Models (LLMs), aiming for a more accurate assessment of their capabilities and limitations. We utilize a multi-agent system to…

计算与语言 · 计算机科学 2024-02-20 Siyuan Wang , Zhuohan Long , Zhihao Fan , Zhongyu Wei , Xuanjing Huang

We introduce RedDebate, a novel multi-agent debate framework that provides the foundation for Large Language Models (LLMs) to identify and mitigate their unsafe behaviours. Existing AI safety approaches often rely on costly human evaluation…

计算与语言 · 计算机科学 2025-10-13 Ali Asad , Stephen Obadinma , Radin Shayanfar , Xiaodan Zhu

Open data repositories hold potential for evidence-based decision-making, yet are inaccessible to non-experts lacking expertise in dataset discovery, schema mapping, and statistical analysis. Large language models show promise for…

人工智能 · 计算机科学 2025-11-06 Sina Montazeri , Yunhe Feng , Kewei Sha

Chain-of-thought prompting has popularized step-by-step reasoning in large language models, yet model performance still degrades as problem complexity and context length grow. By decomposing difficult tasks with long contexts into shorter,…

多智能体系统 · 计算机科学 2025-10-17 Michael Rizvi-Martel , Satwik Bhattamishra , Neil Rathi , Guillaume Rabusseau , Michael Hahn

Large language model (LLM) agents have shown increasing promise for collaborative task completion. However, existing multi-agent frameworks often rely on static workflows, fixed roles, and limited inter-agent communication, reducing their…

多智能体系统 · 计算机科学 2026-02-13 Chengxuan Xia , Qianye Wu , Sixuan Tian , Yilun Hao

Multi-agent large language model frameworks are promising for complex multi step reasoning, yet existing systems remain weak for scientific and knowledge intensive domains due to static prompts and agent roles, rigid workflows, and…

人工智能 · 计算机科学 2026-03-04 Yichao Feng , Haoran Luo , Zhenghong Lin , Yiqun Sun , Pengfei Wei , Lawrence B. Hsieh , Anh Tuan Luu

Multi-agent collaboration among models has shown promise in reasoning tasks but is underexplored in long-form generation tasks like summarization and question-answering. We extend multi-agent multi-model reasoning to generation,…

计算与语言 · 计算机科学 2025-03-20 David Wan , Justin Chih-Yao Chen , Elias Stengel-Eskin , Mohit Bansal

As large language models (LLMs) transition from static tools to fully agentic systems, their potential for transforming social science research has become increasingly evident. This paper introduces a structured framework for understanding…

多智能体系统 · 计算机科学 2026-05-19 Jennifer Haase , Sebastian Pokutta

This paper formalises the literature on emerging design patterns and paradigms for Large Language Model (LLM)-enabled multi-agent systems (MAS), evaluating their practical utility across various domains. We define key architectural…

多智能体系统 · 计算机科学 2026-01-08 Harri Renney , Maxim N Nethercott , Nathan Renney , Peter Hayes

Large Language Models (LLMs) have demonstrated potential in automating scientific ideation, yet current approaches relying on iterative prompting or complex multi-agent architectures often suffer from hallucination or computational…

Large Language Models (LLMs) have significantly advanced the fact-checking studies. However, existing automated fact-checking evaluation methods rely on static datasets and classification metrics, which fail to automatically evaluate the…

计算与语言 · 计算机科学 2025-03-04 Hongzhan Lin , Yang Deng , Yuxuan Gu , Wenxuan Zhang , Jing Ma , See-Kiong Ng , Tat-Seng Chua

Recent advancements in AI have reinvigorated Agent-Based Models (ABMs), as the integration of Large Language Models (LLMs) has led to the emergence of ``generative ABMs'' as a novel approach to simulating social systems. While ABMs offer…

多智能体系统 · 计算机科学 2025-04-07 Maik Larooij , Petter Törnberg

Large language models (LLMs) have achieved remarkable performance in recent years but are fundamentally limited by the underlying training data. To improve models beyond the training data, recent works have explored how LLMs can be used to…

计算与语言 · 计算机科学 2025-03-04 Vighnesh Subramaniam , Yilun Du , Joshua B. Tenenbaum , Antonio Torralba , Shuang Li , Igor Mordatch

As large language models (LLMs) grow in capability and autonomy, evaluating their outputs-especially in open-ended and complex tasks-has become a critical bottleneck. A new paradigm is emerging: using AI agents as the evaluators themselves.…

人工智能 · 计算机科学 2025-08-06 Fangyi Yu

Automatic search for Multi-Agent Systems has recently emerged as a key focus in agentic AI research. Several prior approaches have relied on LLM-based free-form search over the code space. In this work, we propose a more structured…

Multiagent collaboration has emerged as a promising framework for enhancing the reasoning capabilities of large language models (LLMs). Despite improvements in reasoning, the approach introduces substantial computational overhead resulting…

人工智能 · 计算机科学 2025-05-21 Sugyeong Eo , Hyeonseok Moon , Evelyn Hayoon Zi , Chanjun Park , Heuiseok Lim

Reliable evaluation of large language models (LLMs) is impeded by two key challenges: objective metrics often fail to reflect human perception of natural language, and exhaustive human labeling is prohibitively expensive. Here, we propose a…

Recent advances in Large Language Models (LLMs) have upgraded them from sophisticated text generators to autonomous agents capable of cooperation and tool use in multi-agent systems (MAS). However, it remains unclear how disagreements shape…