English
Related papers

Related papers: MARS: toward more efficient multi-agent collaborat…

200 papers

While small language models (SLMs) have shown promise on various reasoning tasks, their ability to judge the correctness of answers remains unclear compared to large language models (LLMs). Prior work on LLM-as-a-judge frameworks typically…

Artificial Intelligence · Computer Science 2025-11-21 Zhenyu Bi , Gaurav Srivastava , Yang Li , Meng Lu , Swastik Roy , Morteza Ziyadi , Xuan Wang

Multi-agent systems (MAS) have shown great potential in executing complex tasks, but coordination and safety remain significant challenges. Multi-Agent Reinforcement Learning (MARL) offers a promising framework for agent collaboration, but…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Ziqi Jia , Junjie Li , Xiaoyang Qu , Jianzong Wang

With advancements in reasoning capabilities, Large Language Models (LLMs) are increasingly employed for automated judgment tasks. While LLMs-as-Judges offer promise in automating evaluations, current approaches often rely on simplistic…

Artificial Intelligence · Computer Science 2025-10-15 Tianyu Hu , Zhen Tan , Song Wang , Huaizhi Qu , Tianlong Chen

LLM-based multi-agent systems (MAS) extend the capabilities of single LLMs by enabling cooperation among multiple specialized agents. However, most existing MAS frameworks rely on a single LLM to drive all agents, constraining the system's…

Artificial Intelligence · Computer Science 2025-05-23 Rui Ye , Xiangrui Liu , Qimin Wu , Xianghe Pang , Zhenfei Yin , Lei Bai , Siheng Chen

Large language models (LLMs) have demonstrated remarkable capabilities in language generation, understanding, and few-shot learning in recent years. An extensive body of work has explored how their performance may be further improved…

Computation and Language · Computer Science 2023-05-24 Yilun Du , Shuang Li , Antonio Torralba , Joshua B. Tenenbaum , Igor Mordatch

Data marketplaces, which mediate the purchase and exchange of data from third parties, have attracted growing attention for reducing the cost and effort of data collection while enabling the trading of diverse datasets. However, a…

Multiagent Systems · Computer Science 2025-11-18 Jun Sashihara , Yukihisa Fujita , Kota Nakamura , Masahiro Kuwahara , Teruaki Hayashi

Multi-agent debate has emerged as a promising approach for improving LLM reasoning on ground-truth tasks, yet current methodologies face certain structural limitations: debate tends to induce a martingale over belief trajectories, majority…

Artificial Intelligence · Computer Science 2026-05-14 Tommaso Giovannelli , Griffin D. Kent

LLM-based Multi-Agent Systems have demonstrated remarkable capabilities in addressing complex, agentic tasks, from generating high-quality presentation slides to even conducting sophisticated scientific research. Meanwhile, RL has been…

Multiagent Systems · Computer Science 2025-11-04 Junwei Liao , Muning Wen , Jun Wang , Weinan Zhang

As foundation models are increasingly deployed as interacting agents in multi-agent systems, their collective behavior raises new challenges for trustworthiness, transparency, and accountability. Traditional coordination mechanisms, such as…

Multiagent Systems · Computer Science 2026-02-24 Brendan Gho , Suman Muppavarapu , Afnan Shaik , Tyson Tsay , Atharva Mohan , James Begin , Kevin Zhu , Archana Vaidheeswaran , Vasu Sharma

Multi-agent systems (MAS) are widely prevalent and crucially important in numerous real-world applications, where multiple agents must make decisions to achieve their objectives in a shared environment. Despite their ubiquity, the…

Multiagent Systems · Computer Science 2024-07-04 Dom Huh , Prasant Mohapatra

Recent progress in LLMs discussion suggests that multi-agent discussion improves the reasoning abilities of LLMs. In this work, we reevaluate this claim through systematic experiments, where we propose a novel group discussion framework to…

Computation and Language · Computer Science 2024-02-29 Qineng Wang , Zihao Wang , Ying Su , Hanghang Tong , Yangqiu Song

LLM-as-Judge has emerged as a scalable alternative to human evaluation, enabling large language models (LLMs) to provide reward signals in trainings. While recent work has explored multi-agent extensions such as multi-agent debate and…

Artificial Intelligence · Computer Science 2025-09-19 Chiyu Ma , Enpei Zhang , Yilun Zhao , Wenjun Liu , Yaning Jia , Peijun Qing , Lin Shi , Arman Cohan , Yujun Yan , Soroush Vosoughi

Multi-agent debate (MAD) systems improve LLM reasoning through iterative deliberation, but remain vulnerable to debate collapse, a failure type where final agent decisions are compromised on erroneous reasoning. Existing methods lack…

Multiagent Systems · Computer Science 2026-02-10 Luoxi Tang , Yuqiao Meng , Joseph Costa , Yingxue Zhang , Muchao Ye , Zhaohan Xi

Recent work reports strong performance from multi-agent LLM systems (MAS), but these gains are often confounded by increased test-time computation. When computation is normalized, single-agent systems (SAS) can match or outperform MAS, yet…

Computation and Language · Computer Science 2026-04-14 Dat Tran , Douwe Kiela

Recent studies on LLM agent scaling have highlighted the potential of Multi-Agent Debate (MAD) to enhance reasoning abilities. However, the critical aspect of role allocation strategies remains underexplored. In this study, we demonstrate…

Artificial Intelligence · Computer Science 2025-11-17 Qian Zhang , Yan Zheng , Jinyi Liu , Hebin Liang , Lanjun Wang

Modern Large Language Models (LLMs) exhibit impressive zero-shot and few-shot generalization capabilities across complex natural language tasks, enabling their widespread use as virtual assistants for diverse applications such as…

Computation and Language · Computer Science 2025-06-19 Arjun Vaithilingam Sudhakar

Tabular anomaly detection is often handled by single detectors or static ensembles, even though strong performance on tabular data typically comes from heterogeneous model families (e.g., tree ensembles, deep tabular networks, and tabular…

Machine Learning · Computer Science 2026-02-17 Pinqiao Wang , Sheng Li

Reinforcement Learning (RL) has shown significant promise in automated portfolio management; however, effectively balancing risk and return remains a central challenge, as many models fail to adapt to dynamically changing market conditions.…

Machine Learning · Computer Science 2025-12-04 Jiayi Chen , Jing Li , Guiling Wang

Advances in multi-agent reinforcement learning (MARL) enable sequential decision making for a range of exciting multi-agent applications such as cooperative AI and autonomous driving. Explaining agent decisions is crucial for improving…

Artificial Intelligence · Computer Science 2022-05-24 Kayla Boggess , Sarit Kraus , Lu Feng

Multiagent reinforcement learning (MARL) has attracted considerable attention due to its potential in addressing complex cooperative tasks. However, existing MARL approaches often rely on frequent exchanges of action or state information…

Machine Learning · Computer Science 2026-01-14 Zhenglong Luo , Zhiyong Chen , Aoxiang Liu , Ke Pan