English
Related papers

Related papers: Single-Agent LLMs Outperform Multi-Agent Systems o…

200 papers

Multi-agent systems (MAS) composed of large language models often exhibit improved problem-solving performance despite operating on identical information. In this work, we provide a formal explanation for this phenomenon grounded in…

Computation and Language · Computer Science 2026-01-22 Christopher Scofield

Effectively processing long contexts remains a fundamental yet unsolved challenge for large language models (LLMs). Existing single-LLM-based methods primarily reduce the context window or optimize the attention mechanism, but they often…

Computation and Language · Computer Science 2026-04-22 Yichen Jiang , Jiakang Yuan , Chongjun Tu , Peng Ye , Tao Chen

In this paper, we propose to incorporate the blackboard architecture into LLM multi-agent systems (MASs) so that (1) agents with various roles can share all the information and others' messages during the whole problem-solving process, (2)…

Multiagent Systems · Computer Science 2025-07-03 Bochen Han , Songmao Zhang

Large language models (LLMs) have enabled multi-agent systems (MAS) in which multiple agents argue, critique, and coordinate to solve complex tasks, making communication topology a first-class design choice. Yet most existing LLM-based MAS…

Artificial Intelligence · Computer Science 2025-12-23 Boxuan Wang , Zhuoyun Li , Xiaowei Huang , Yi Dong

This study investigated LLM-based automation for analyzing non-financial data in corporate credit evaluation. Two systems were developed and compared: a Single-Agent System (SAS), in which one LLM agent infers favorable and adverse…

Artificial Intelligence · Computer Science 2026-01-14 Yoonjin Lee , Munhee Kim , Hanbi Choi , Juhyeon Park , Seungho Lyoo , Woojin Park

With the development of LLMs as agents, there is a growing interest in connecting multiple agents into multi-agent systems to solve tasks concurrently, focusing on their role in task assignment and coordination. This paper explores how LLMs…

Multiagent Systems · Computer Science 2025-04-22 Alfonso Amayuelas , Jingbo Yang , Saaket Agashe , Ashwin Nagarajan , Antonis Antoniades , Xin Eric Wang , William Wang

Large Language Models (LLMs) trained with reinforcement learning and verifiable rewards have achieved strong results on complex reasoning tasks. Recent work extends this paradigm to a multi-agent setting, where a meta-thinking agent…

Artificial Intelligence · Computer Science 2025-11-05 Zhiwei Zhang , Xiaomin Li , Yudi Lin , Hui Liu , Ramraj Chandradevan , Linlin Wu , Minhua Lin , Fali Wang , Xianfeng Tang , Qi He , Suhang Wang

A multi-agent AI system (MAS) is composed of multiple autonomous agents that interact, exchange information, and make decisions based on internal generative models. Recent advances in large language models and tool-using agents have made…

Agentic language model (LM) systems power modern applications like "Deep Research" and "Claude Code," and leverage multi-LM architectures to overcome context limitations. Beneath their apparent diversity lies a recurring pattern: smaller…

Machine Learning · Computer Science 2025-12-29 Shizhe He , Avanika Narayan , Ishan S. Khare , Scott W. Linderman , Christopher Ré , Dan Biderman

Multi-agent LLM systems are increasingly deployed as autonomous collaborators, where agents interact freely rather than execute fixed, pre-specified workflows. In such settings, effective coordination cannot be fully designed in advance and…

Multiagent Systems · Computer Science 2026-02-10 Aneesh Pappu , Batu El , Hancheng Cao , Carmelo di Nolfo , Yanchao Sun , Meng Cao , James Zou

When are multi-agent LLM systems merely a collection of individual agents versus an integrated collective with higher-order structure? We introduce an information-theoretic framework to test -- in a purely data-driven way -- whether…

Multiagent Systems · Computer Science 2026-04-30 Christoph Riedl

Recent advances in large language models (LLMs) have demonstrated the power of reasoning through self-generated chains of thought. Multiple reasoning agents can collaborate to raise joint reasoning quality above individual outcomes.…

Artificial Intelligence · Computer Science 2025-05-19 Chan-Jan Hsu , Davide Buffelli , Jamie McGowan , Feng-Ting Liao , Yi-Chang Chen , Sattar Vakili , Da-shan Shiu

The rapid development of large language model (LLM)-based agents has unlocked new possibilities for autonomous multi-turn reasoning and tool-augmented decision-making. However, their real-world deployment is hindered by severe…

Recent progress in language modeling has largely relied on scaling model size, yet larger models do not reliably improve performance on tasks requiring multi-step reasoning and tool use. Multi-agent collaboration offers a potential…

Multiagent Systems · Computer Science 2026-04-15 Agata Żywot , Xinyi Chen , Yifei Yuan , Anders Søgaard , Maarten de Rijke

Multi-agent AI systems powered by large language models (LLMs) are increasingly applied to solve complex tasks. However, these systems often rely on fragile, manually designed prompts and heuristics, making optimization difficult. A key…

Artificial Intelligence · Computer Science 2025-02-10 Wanjia Zhao , Mert Yuksekgonul , Shirley Wu , James Zou

The past two years have witnessed the meteoric rise of Large Language Model (LLM)-powered multi-agent systems (MAS), which harness collective intelligence and exhibit a remarkable trajectory toward self-evolution. This paradigm has rapidly…

Multiagent Systems · Computer Science 2025-09-30 Kun Wang , Guibin Zhang , ManKit Ye , Xinyu Deng , Dongxia Wang , Xiaobin Hu , Jinyang Guo , Yang Liu , Yufei Guo

Recent research on Reasoning of Large Language Models (LLMs) has sought to further enhance their performance by integrating meta-thinking -- enabling models to monitor, evaluate, and control their reasoning processes for more adaptive and…

Artificial Intelligence · Computer Science 2025-05-28 Ziyu Wan , Yunxiang Li , Xiaoyu Wen , Yan Song , Hanjing Wang , Linyi Yang , Mark Schmidt , Jun Wang , Weinan Zhang , Shuyue Hu , Ying Wen

Recent advancements in large language models (LLMs) underscore their potential for responding to inquiries in various domains. However, ensuring that generative agents provide accurate and reliable answers remains an ongoing challenge. In…

Computation and Language · Computer Science 2024-07-19 Andries Smit , Paul Duckworth , Nathan Grinsztajn , Thomas D. Barrett , Arnu Pretorius

Remarkable performance of large language models (LLMs) in a variety of tasks brings forth many opportunities as well as challenges of utilizing them in production settings. Towards practical adoption of LLMs, multi-agent systems hold great…

Computation and Language · Computer Science 2024-02-05 Pouya Pezeshkpour , Eser Kandogan , Nikita Bhutani , Sajjadur Rahman , Tom Mitchell , Estevam Hruschka

Scaling test-time computation improves performance across different tasks on large language models (LLMs), which has also been extended to tool-augmented agents. For these agents, scaling involves not only "thinking" in tokens but also…