English
Related papers

Related papers: TeamCraft: A Benchmark for Multi-Modal Multi-Agent…

200 papers

In this work we proposing adapting the Minecraft builder task into an LLM benchmark suitable for evaluating LLM ability in spatially orientated tasks, and informing builder agent design. Previous works have proposed corpora with varying…

Computation and Language · Computer Science 2024-07-18 Chris Madge , Massimo Poesio

Tool-using agents are increasingly expected to operate across realistic professional workflows, where they must interpret multimodal inputs, coordinate external tools, inspect intermediate artifacts, and revise their actions before…

Artificial Intelligence · Computer Science 2026-05-19 Zhiqiang Liu , Wenhui Dong , Yilang Tan , Yuwen Qu , Haochen Yin , Chenyang Si

Among existing online mobile-use benchmarks, AndroidWorld has emerged as the dominant benchmark due to its reproducible environment and deterministic evaluation; however, recent agents achieving over 90% success rates indicate its…

Computation and Language · Computer Science 2026-01-01 Quyu Kong , Xu Zhang , Zhenyu Yang , Nolan Gao , Chen Liu , Panrong Tong , Chenglin Cai , Hanzhang Zhou , Jianan Zhang , Liangyu Chen , Zhidan Liu , Steven Hoi , Yue Wang

Some standardized environments have been designed for partially observable multi-agent cooperation, but we find most current environments are synchronous, whereas real-world agents often have their own action spaces leading to asynchrony.…

Multiagent Systems · Computer Science 2023-05-16 Meng Yao , Xueou Feng , Qiyue Yin

The real world is awash with multi-agent problems that require collective action by self-interested agents, from the routing of packets across a computer network to the management of irrigation systems. Such systems have local incentives…

Multiagent Systems · Computer Science 2021-02-16 Michiel A. Bakker , Richard Everett , Laura Weidinger , Iason Gabriel , William S. Isaac , Joel Z. Leibo , Edward Hughes

Building a general-purpose agent is a long-standing vision in the field of artificial intelligence. Existing agents have made remarkable progress in many domains, yet they still struggle to complete long-horizon tasks in an open world. We…

Artificial Intelligence · Computer Science 2024-10-22 Zaijing Li , Yuquan Xie , Rui Shao , Gongwei Chen , Dongmei Jiang , Liqiang Nie

We propose a new benchmark for planning tasks based on the Minecraft game. Our benchmark contains 45 tasks overall, but also provides support for creating both propositional and numeric instances of new Minecraft tasks automatically. We…

Artificial Intelligence · Computer Science 2024-04-30 William Hill , Ireton Liu , Anita De Mello Koch , Damion Harvey , Nishanth Kumar , George Konidaris , Steven James

Large Language Models (LLMs) are becoming increasingly powerful and capable of handling complex tasks, e.g., building single agents and multi-agent systems. Compared to single agents, multi-agent systems have higher requirements for the…

Computation and Language · Computer Science 2024-08-29 Wei Wang , Dan Zhang , Tao Feng , Boyan Wang , Jie Tang

Large transformer models, trained on diverse datasets, have demonstrated impressive few-shot performance on previously unseen tasks without requiring parameter updates. This capability has also been explored in Reinforcement Learning (RL),…

Multiagent Systems · Computer Science 2026-04-02 Tao Jiang , Zichuan Lin , Lihe Li , Yi-Chen Li , Cong Guan , Lei Yuan , Zongzhang Zhang , Yang Yu , Deheng Ye

Multi-agent reinforcement learning (MARL) has received increasing attention for its applications in various domains. Researchers have paid much attention on its partially observable and cooperative settings for meeting real-world…

Multiagent Systems · Computer Science 2021-12-08 Meng Yao , Qiyue Yin , Jun Yang , Tongtong Yu , Shengqi Shen , Junge Zhang , Bin Liang , Kaiqi Huang

Large language model (LLM) agents are increasingly expected to operate in enterprise environments, where work is distributed across specialized roles, permission-controlled systems, and cross-departmental procedures. However, existing…

While multi-agent interactions can be naturally modeled as a graph, the environment has traditionally been considered as a black box. We propose to create a shared agent-entity graph, where agents and environmental entities form vertices,…

Machine Learning · Computer Science 2019-06-05 Akshat Agarwal , Sumit Kumar , Katia Sycara

The paradigm of agentic AI is shifting from engineered complex workflows to post-training native models. However, existing agents are typically confined to static, predefined action spaces--such as exclusively using APIs, GUI events, or…

Machine Learning · Computer Science 2025-12-11 Kaichen He , Zihao Wang , Muyao Li , Anji Liu , Yitao Liang

World models learn general knowledge from videos and simulate experience for training behaviors in imagination, offering a path towards intelligent agents. However, previous world models have been unable to accurately predict object…

Artificial Intelligence · Computer Science 2025-09-30 Danijar Hafner , Wilson Yan , Timothy Lillicrap

Recent advances in reinforcement learning (RL) heavily rely on a variety of well-designed benchmarks, which provide environmental platforms and consistent criteria to evaluate existing and novel algorithms. Specifically, in multi-agent RL…

Multiagent Systems · Computer Science 2024-06-25 Wenzhe Li , Zihan Ding , Seth Karten , Chi Jin

Evaluating the general abilities of intelligent agents requires complex simulation environments. Existing benchmarks typically evaluate only one narrow task per environment, requiring researchers to perform expensive training runs on many…

Artificial Intelligence · Computer Science 2022-02-15 Danijar Hafner

Discovering causal regularities and applying them to build functional systems--the discovery-to-application loop--is a hallmark of general intelligence, yet evaluating this capacity has been hindered by the vast complexity gap between…

This paper introduces Team-Attention-Actor-Critic (TAAC), a reinforcement learning algorithm designed to enhance multi-agent collaboration in cooperative environments. TAAC employs a Centralized Training/Centralized Execution scheme…

Artificial Intelligence · Computer Science 2025-12-23 Hugo Garrido-Lestache Belinchon , Jeremy Kedziora

Reaching consensus is key to multi-agent coordination. To accomplish a cooperative task, agents need to coherently select optimal joint actions to maximize the team reward. However, current cooperative multi-agent reinforcement learning…

Artificial Intelligence · Computer Science 2024-03-06 Liangzhou Wang , Kaiwen Zhu , Fengming Zhu , Xinghu Yao , Shujie Zhang , Deheng Ye , Haobo Fu , Qiang Fu , Wei Yang

Many artificial intelligence (AI) applications often require multiple intelligent agents to work in a collaborative effort. Efficient learning for intra-agent communication and coordination is an indispensable step towards general AI. In…

Artificial Intelligence · Computer Science 2017-09-15 Peng Peng , Ying Wen , Yaodong Yang , Quan Yuan , Zhenkun Tang , Haitao Long , Jun Wang