English
Related papers

Related papers: Agents that Matter: Optimizing Multi-Agent LLMs vi…

200 papers

Large Language Model-based multi-agent systems (MAS) have shown remarkable progress in solving complex tasks through collaborative reasoning and inter-agent critique. However, existing approaches typically treat each task in isolation,…

Computation and Language · Computer Science 2025-05-30 Yilong Li , Chen Qian , Yu Xia , Ruijie Shi , Yufan Dang , Zihao Xie , Ziming You , Weize Chen , Cheng Yang , Weichuan Liu , Ye Tian , Xuantang Xiong , Lei Han , Zhiyuan Liu , Maosong Sun

Multi-agent systems have demonstrated exceptional performance in downstream tasks beyond diverse single agent baselines. A growing body of work has explored ways to improve their reasoning and collaboration, from vote, debate, to complex…

Artificial Intelligence · Computer Science 2026-02-13 Yu Yao , Jiayi Dong , Yang Yang , Ju Li , Yilun Du

Large Language Models (LLMs) have shown remarkable reasoning capabilities in mathematical and scientific tasks. To enhance complex reasoning, multi-agent systems have been proposed to harness the collective intelligence of LLM agents.…

Artificial Intelligence · Computer Science 2025-10-22 Zhenyu Bi , Meng Lu , Yang Li , Swastik Roy , Weijie Guan , Morteza Ziyadi , Xuan Wang

Large Language Model (LLM) based multi-agent systems (MAS) have shown promise in tackling complex tasks, but often rely on predefined roles and centralized coordination, limiting their adaptability to evolving challenges. This paper…

Artificial Intelligence · Computer Science 2025-09-04 Siyuan Lu , Jiaqi Shao , Bing Luo , Tao Lin

We introduce a novel large language model (LLM)-driven agent framework, which iteratively refines queries and filters contextual evidence by leveraging dynamically evolving knowledge. A defining feature of the system is its decoupling of…

Artificial Intelligence · Computer Science 2025-04-02 Seyoung Song

The justice system has increasingly employed AI techniques to enhance efficiency, yet limitations remain in improving the quality of decision-making, particularly regarding transparency and explainability needed to uphold public trust in…

Artificial Intelligence · Computer Science 2024-12-30 Cong Jiang , Xiaolei Yang

Recent work reports strong performance from multi-agent LLM systems (MAS), but these gains are often confounded by increased test-time computation. When computation is normalized, single-agent systems (SAS) can match or outperform MAS, yet…

Computation and Language · Computer Science 2026-04-14 Dat Tran , Douwe Kiela

Integrating Large Language Models (LLMs) with external tools via multi-agent systems offers a promising new paradigm for decomposing and solving complex problems. However, training these systems remains notoriously difficult due to the…

Artificial Intelligence · Computer Science 2026-02-10 Yanming Li , Xuelin Zhang , WenJie Lu , Ziye Tang , Maodong Wu , Haotian Luo , Tongtong Wu , Zijie Peng , Hongze Mi , Yibo Feng , Naiqiang Tan , Chao Huang , Hong Chen , Li Shen

Accurate detection of errors in large language models (LLM) responses is central to the success of scalable oversight, or providing effective supervision to superhuman intelligence. Yet, self-diagnosis is often unreliable on complex tasks…

Machine Learning · Computer Science 2025-10-27 Yongqiang Chen , Gang Niu , James Cheng , Bo Han , Masashi Sugiyama

Large language model multi-agent systems (LLM-MAS) offer a promising paradigm for harnessing collective intelligence to achieve more advanced forms of AI behaviour. While recent studies suggest that LLM-MAS can outperform LLM single-agent…

Artificial Intelligence · Computer Science 2025-10-07 Bohan Tang , Huidong Liang , Keyue Jiang , Xiaowen Dong

Attribution maps are one of the most established tools to explain the functioning of computer vision models. They assign importance scores to input features, indicating how relevant each feature is for the prediction of a deep neural…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Robin Hesse , Simone Schaub-Meyer , Stefan Roth

In the field of cooperative multi-agent reinforcement learning (MARL), the standard paradigm is the use of centralised training and decentralised execution where a central critic conditions the policies of the cooperative agents based on a…

Artificial Intelligence · Computer Science 2023-04-04 Siddarth Singh , Benjamin Rosman

Multi-agent systems (MAS) are increasingly used for open-ended idea generation, driven by the expectation that collective interaction will broaden the exploration diversity. However, when and why such collaboration truly expands the…

Multiagent Systems · Computer Science 2026-04-22 Nuo Chen , Yicheng Tong , Yuzhe Yang , Yufei He , Xueyi Zhang , Qingyun Zou , Qian Wang , Bingsheng He

LLM-based multi-agent systems (LLM-MAS), in which autonomous AI agents cooperate to solve tasks, are gaining increasing attention. For such systems to be deployed in society, agents must be able to establish cooperation and coordination…

Multiagent Systems · Computer Science 2026-02-13 Keita Nishimoto , Kimitaka Asatani , Ichiro Sakata

The transition to open, distributed Multi-Agent Systems (MAS) promises scalable intelligence but introduces a non-trivial tension: maximizing global efficiency requires cooperative, resource-aware scheduling, yet autonomous agents may be…

Networking and Internet Architecture · Computer Science 2026-03-19 Hongze Liu , Chang Guo , Yingzeng Li , Mengru Wang , Jiong Lou , Shijing Yuan , Hefeng Zhou , Chentao Wu , Jie LI

Multi-agent reinforcement learning is an area of rapid advancement in artificial intelligence and machine learning. One of the important questions to be answered is how to conduct credit assignment in a multi-agent system. There have been…

Multiagent Systems · Computer Science 2024-02-26 Jianhong Wang

Large language model (LLM) agents often rely on long sequences of low-level textual actions, resulting in large effective decision horizons and high inference cost. While prior work has focused on improving inference efficiency through…

Artificial Intelligence · Computer Science 2026-05-20 Wenhao Huang , Qingwen Zeng , Qiyue Chen , Zijie Guo , Yu Sun , Cheng Yang , Siru Ouyang , Jiri Gesi , Fang Wu , Jiayi Zhang , Huaming Chen , Bang Liu , Xiangru Tang , Chenglin Wu

In multi-agent systems, agents need to interact and collaborate with other agents in environments. Agent modeling is crucial to facilitate agent interactions and make adaptive cooperation strategies. However, it is challenging for agents to…

Artificial Intelligence · Computer Science 2023-10-20 Baofu Fang , Caiming Zheng , Hao Wang

Multi-Agent Systems (MAS) built on Large Language Models (LLMs) often exhibit high variance in their reasoning trajectories. Process verification, which evaluates intermediate steps in trajectories, has shown promise in general reasoning…

Artificial Intelligence · Computer Science 2026-02-04 Vishal Venkataramani , Haizhou Shi , Zixuan Ke , Austin Xu , Xiaoxiao He , Yingbo Zhou , Semih Yavuz , Hao Wang , Shafiq Joty

This work develops a fully decentralized multi-agent algorithm for policy evaluation. The proposed scheme can be applied to two distinct scenarios. In the first scenario, a collection of agents have distinct datasets gathered following…

Machine Learning · Computer Science 2019-08-13 Lucas Cassano , Kun Yuan , Ali H. Sayed