English
Related papers

Related papers: When Does Hierarchy Help? Benchmarking Agent Coord…

200 papers

Achieving consensus among noncooperative agents remains challenging in decentralized multi-agent systems, where agents often have conflicting preferences. Existing coordination methods enable agents to reach consensus without a centralized…

Multiagent Systems · Computer Science 2025-11-25 Jaehan Im , John-Paul Clarke , Ufuk Topcu , David Fridovich-Keil

An increasing number of emerging applications, e.g., internet of things, vehicular communications, augmented reality, and the growing complexity due to the interoperability requirements of these systems, lead to the need to change the tools…

Multiagent Systems · Computer Science 2019-01-16 Merim Dzaferagic , M. Majid Butt , Maria Murphy , Nicholas Kaminski , Nicola Marchetti

Large language model-based web agents have demonstrated strong performance on realistic web interaction tasks. However, existing evaluations are predominantly conducted under relatively stable and well-behaved interaction conditions, which…

Software Engineering · Computer Science 2026-04-21 Haoyue Bai , Dong Wang , Long Chen , Bingguang Hao , Pengyang Shao , Yonghui Yang , Yicheng He , Chenyi Zhuang

Decentralized air traffic management requires coordination among self-interested stakeholders operating under shared safety and capacity constraints, where conventional centralized or implicitly cooperative models do not adequately capture…

Systems and Control · Electrical Eng. & Systems 2026-05-26 Jaehan Im

As autonomous AI agents are increasingly deployed in high-stakes environments, ensuring their safety and alignment with human values is becoming a practical deployment concern. Current benchmarks for AI agents primarily evaluate refusal of…

Artificial Intelligence · Computer Science 2026-05-12 Miles Q. Li , Benjamin C. M. Fung , Martin Weiss , Pulei Xiong , Khalil Al-Hussaeni , Claude Fachkha

Supply Chain coordination has become a critical success factor for Supply Chain management (SCM) and effectively improving the performance of organizations in various industries. Companies are increasingly located at the intersection of one…

Artificial Intelligence · Computer Science 2012-10-15 Benaissa Ezzeddine , Benabdelhafid Abdellatif , Benaissa Mounir

Large language models are increasingly deployed in multi-agent systems, yet we lack benchmarks that test whether they can coordinate under resource contention. We introduce DPBench, a benchmark based on the Dining Philosophers problem that…

Artificial Intelligence · Computer Science 2026-02-17 Najmul Hasan , Prashanth BusiReddyGari

The advancement of large language model (LLM) based agents has shifted AI evaluation from single-turn response assessment to multi-step task completion in interactive environments. We present an empirical study evaluating frontier AI models…

Artificial Intelligence · Computer Science 2026-01-15 Logan Ritchie , Sushant Mehta , Nick Heiner , Mason Yu , Edwin Chen

In operations of multi-agent teams ranging from homogeneous robot swarms to heterogeneous human-autonomy teams, unexpected events might occur. While efficiency of operation for multi-agent task allocation problems is the primary objective,…

Multiagent Systems · Computer Science 2022-07-19 Haochen Wu , Amin Ghadami , Alparslan Emrah Bayrak , Jonathon M. Smereka , Bogdan I. Epureanu

Robotic manipulation policies often degrade over extended horizons, yet existing benchmarks provide limited insight into why such failures occur. Most prior benchmarks are either simulation-based or report aggregate success, making it…

Robotics · Computer Science 2026-04-21 Xueyao Chen , Jingkai Jia , Tong Yang , Yibo Fu , Wei Li , Wenqiang Zhang

As the focus in LLM-based coding shifts from static single-step code generation to multi-step agentic interaction with tools and environments, understanding which tasks will challenge agents and why becomes increasingly difficult. This is…

Artificial Intelligence · Computer Science 2026-04-02 Chris Ge , Daria Kryvosheieva , Daniel Fried , Uzay Girit , Kaivalya Hariharan

Multi-agent trajectory planning requires ensuring both safety and efficiency, yet deadlocks remain a significant challenge, especially in obstacle-dense environments. Such deadlocks frequently occur when multiple agents attempt to traverse…

Robotics · Computer Science 2025-07-29 Haoze Dong , Meng Guo , Chengyi He , Zhongkui Li

A significant element of human cooperative intelligence lies in our ability to identify opportunities for fruitful collaboration; and conversely to recognise when the task at hand is better pursued alone. Research on flexible cooperation in…

Multiagent Systems · Computer Science 2026-03-10 Max Taylor-Davies , Neil Bramley , Christopher G. Lucas

This paper addresses the limitations of a single agent in task decomposition and collaboration during complex task execution, and proposes a multi-agent architecture for modular task decomposition and dynamic collaboration based on large…

Artificial Intelligence · Computer Science 2025-11-04 Shuaidong Pan , Di Wu

In multi-agent reinforcement learning systems, the actions of one agent can have a negative impact on the rewards of other agents. One way to combat this problem is to let agents trade their rewards amongst each other. Motivated by this,…

Artificial Intelligence · Computer Science 2022-07-25 Michael Kölle , Lennart Rietdorf , Kyrill Schmid

We propose integrating the edge-computing paradigm into the multi-robot collaborative scheduling to maximize resource utilization for complex collaborative tasks, which many robots must perform together. Examples include collaborative…

Robotics · Computer Science 2023-11-20 Nazish Tahir , Ramviyas Parasuraman

Multi-agent systems cooperation to achieve global goals is usually limited by sensing, actuation, and communication issues. At the local level, continuous measurement and actuation is only approximated by the use of digital mechanisms that…

Optimization and Control · Mathematics 2016-11-18 Eloy Garcia , Yongcan Cao , David W. Casbeer

Recent progress in embodied AI has produced a growing ecosystem of robot policies, foundation models, and modular runtimes. However, current evaluation remains dominated by task success metrics such as completion rate or manipulation…

Robotics · Computer Science 2026-04-14 Xue Qin , Simin Luan , John See , Cong Yang , Zhijun Li

We introduce ETOM, a five-level benchmark for evaluating multi-hop, end-to-end tool orchestration by LLM agents within a hierarchical Model-Context Protocol (MCP) ecosystem. Existing benchmarks often assess tools in isolation, overlooking…

Artificial Intelligence · Computer Science 2026-01-21 Jia-Kai Dong , I-Wei Huang , Chun-Tin Wu , Yi-Tien Tsai

Collaboration requires agents to align their goals on the fly. Underlying the human ability to align goals with other agents is their ability to predict the intentions of others and actively update their own plans. We propose hierarchical…

Multiagent Systems · Computer Science 2020-11-10 Rose E. Wang , J. Chase Kew , Dennis Lee , Tsang-Wei Edward Lee , Tingnan Zhang , Brian Ichter , Jie Tan , Aleksandra Faust