English
Related papers

Related papers: Revisiting Multi-Agent Debate as Test-Time Scaling…

200 papers

Multi-agent systems (MAS) composed of large language models often exhibit improved problem-solving performance despite operating on identical information. In this work, we provide a formal explanation for this phenomenon grounded in…

Computation and Language · Computer Science 2026-01-22 Christopher Scofield

Multi-agent debate (MAD) systems increasingly rely on shared memory to support long-horizon reasoning, but this convenience opens a critical vulnerability: a single corrupted entry can contaminate the downstream memory-augmented reasoning,…

Artificial Intelligence · Computer Science 2026-05-12 Yuqiao Meng , Sakshi Sunil Narvekar , Luoxi Tang , Rupali Rajendra Vaje , Yingxue Zhang , Muchao Ye , Zhaohan Xi

Large language model (LLM) agents have shown increasing promise for collaborative task completion. However, existing multi-agent frameworks often rely on static workflows, fixed roles, and limited inter-agent communication, reducing their…

Multiagent Systems · Computer Science 2026-02-13 Chengxuan Xia , Qianye Wu , Sixuan Tian , Yilun Hao

Chain-of-thought prompting has popularized step-by-step reasoning in large language models, yet model performance still degrades as problem complexity and context length grow. By decomposing difficult tasks with long contexts into shorter,…

Multiagent Systems · Computer Science 2025-10-17 Michael Rizvi-Martel , Satwik Bhattamishra , Neil Rathi , Guillaume Rabusseau , Michael Hahn

To improve the reasoning and question-answering capabilities of Large Language Models (LLMs), several multi-agent approaches have been introduced. While these methods enhance performance, the application of collective intelligence-based…

Artificial Intelligence · Computer Science 2024-07-10 Ciaran Regan , Alexandre Gournail , Mizuki Oka

By utilizing more computational resources at test-time, large language models (LLMs) can improve without additional training. One common strategy uses verifiers to evaluate candidate outputs. In this work, we propose a novel scaling…

Artificial Intelligence · Computer Science 2025-02-28 Shalev Lifshitz , Sheila A. McIlraith , Yilun Du

Multi-agent systems have demonstrated exceptional performance in downstream tasks beyond diverse single agent baselines. A growing body of work has explored ways to improve their reasoning and collaboration, from vote, debate, to complex…

Artificial Intelligence · Computer Science 2026-02-13 Yu Yao , Jiayi Dong , Yang Yang , Ju Li , Yilun Du

Large Language Model (LLM) agents are increasingly utilized in AI-aided education to support tutoring and learning. Effective communication strategies among LLM agents improve collaborative problem-solving efficiency and facilitate…

Multi-Agent Systems (MAS) with Large Language Model (LLM)-powered agents are gaining attention, yet fewer studies explore their team dynamics. Inspired by human team science, we propose a multi-agent framework to examine core aspects of…

Computation and Language · Computer Science 2025-10-13 Rasika Muralidharan , Haewoon Kwak , Jisun An

Recent breakthroughs in large language model-driven autonomous agents have revealed that multi-agent collaboration often surpasses each individual through collective reasoning. Inspired by the neural scaling law--increasing neurons enhances…

Artificial Intelligence · Computer Science 2025-03-18 Chen Qian , Zihao Xie , YiFei Wang , Wei Liu , Kunlun Zhu , Hanchen Xia , Yufan Dang , Zhuoyun Du , Weize Chen , Cheng Yang , Zhiyuan Liu , Maosong Sun

Multi-agent systems (MAS) decompose complex tasks and delegate subtasks to different large language model (LLM) agents and tools. Prior studies have reported the superior accuracy performance of MAS across diverse domains, enabled by…

Multiagent Systems · Computer Science 2025-05-27 Mingyan Gao , Yanzi Li , Banruo Liu , Yifan Yu , Phillip Wang , Ching-Yu Lin , Fan Lai

Large language model (LLM)-based multi-agent systems have demonstrated remarkable promise for tackling complex tasks by breaking them down into subtasks that are iteratively planned, executed, observed, and refined. Despite their…

Multiagent Systems · Computer Science 2025-07-15 Enhao Zhang , Erkang Zhu , Gagan Bansal , Adam Fourney , Hussein Mozannar , Jack Gerrits

Large Language Model (LLM)-based multi-agent systems are increasingly applied to automate computational workflows in science and engineering. However, how inter-agent dynamics influence reasoning quality and verification reliability remains…

Artificial Intelligence · Computer Science 2025-11-07 Chuan Tian , Yilei Zhang

This survey explores the development of meta-thinking capabilities in Large Language Models (LLMs) from a Multi-Agent Reinforcement Learning (MARL) perspective. Meta-thinking self-reflection, assessment, and control of thinking processes is…

Artificial Intelligence · Computer Science 2025-04-22 Ahsan Bilal , Muhammad Ahmed Mohsin , Muhammad Umer , Muhammad Awais Khan Bangash , Muhammad Ali Jamshed

As large language models (LLMs) are increasingly deployed as autonomous agents, understanding their cooperation and social mechanisms is becoming increasingly important. In particular, how LLMs balance self-interest and collective…

Artificial Intelligence · Computer Science 2025-07-25 David Guzman Piedrahita , Yongjin Yang , Mrinmaya Sachan , Giorgia Ramponi , Bernhard Schölkopf , Zhijing Jin

Large language models (LLMs) have enabled multi-agent systems (MAS) in which multiple agents argue, critique, and coordinate to solve complex tasks, making communication topology a first-class design choice. Yet most existing LLM-based MAS…

Artificial Intelligence · Computer Science 2025-12-23 Boxuan Wang , Zhuoyun Li , Xiaowei Huang , Yi Dong

Large Language Models (LLM) are increasingly being explored for problem-solving tasks. However, their strategic planning capability is often viewed with skepticism. Recent studies have incorporated the Monte Carlo Tree Search (MCTS)…

Artificial Intelligence · Computer Science 2025-02-05 Bingzheng Gan , Yufan Zhao , Tianyi Zhang , Jing Huang , Yusu Li , Shu Xian Teo , Changwang Zhang , Wei Shi

Large Language Model (LLM)-based agents have recently shown impressive capabilities in complex reasoning and tool use via multi-step interactions with their environments. While these agents have the potential to tackle complicated tasks,…

Artificial Intelligence · Computer Science 2025-11-04 Jiaye Lin , Yifu Guo , Yuzhen Han , Sen Hu , Ziyi Ni , Licheng Wang , Mingguang Chen , Hongzhang Liu , Ronghao Chen , Yangfan He , Daxin Jiang , Binxing Jiao , Chen Hu , Huacan Wang

Large Language Model-based Multi-Agent Systems (LLM-based MAS), where multiple LLM agents collaborate to solve complex tasks, have shown impressive performance in many areas. However, MAS are typically distributed across different devices…

Artificial Intelligence · Computer Science 2026-01-09 Zhilun Zhou , Zihan Liu , Jiahe Liu , Qingyu Shao , Yihan Wang , Kun Shao , Depeng Jin , Fengli Xu

This study explores the application of chaos engineering to enhance the robustness of Large Language Model-Based Multi-Agent Systems (LLM-MAS) in production-like environments under real-world conditions. LLM-MAS can potentially improve a…

Multiagent Systems · Computer Science 2025-05-07 Joshua Owotogbe