English

Compositional Coordination for Multi-Robot Teams with Large Language Models

Robotics 2025-10-24 v3 Artificial Intelligence Machine Learning Multiagent Systems

Abstract

Multi-robot coordination has traditionally relied on a mission-specific and expert-driven pipeline, where natural language mission descriptions are manually translated by domain experts into mathematical formulation, algorithm design, and executable code. This conventional process is labor-intensive, inaccessible to non-experts, and inflexible to changes in mission requirements. Here, we propose LAN2CB (Language to Collective Behavior), a novel framework that leverages large language models (LLMs) to streamline and generalize the multi-robot coordination pipeline. LAN2CB transforms natural language (NL) mission descriptions into executable Python code for multi-robot systems through two core modules: (1) Mission Analysis, which parses mission descriptions into behavior trees, and (2) Code Generation, which leverages the behavior tree and a structured knowledge base to generate robot control code. We further introduce a dataset of natural language mission descriptions to support development and benchmarking. Experiments in both simulation and real-world environments demonstrate that LAN2CB enables robust and flexible multi-robot coordination from natural language, significantly reducing manual engineering effort and supporting broad generalization across diverse mission types. Website: https://sites.google.com/view/lan-cb

Keywords

Cite

@article{arxiv.2507.16068,
  title  = {Compositional Coordination for Multi-Robot Teams with Large Language Models},
  author = {Zhehui Huang and Guangyao Shi and Yuwei Wu and Vijay Kumar and Gaurav S. Sukhatme},
  journal= {arXiv preprint arXiv:2507.16068},
  year   = {2025}
}

Comments

IEEE International Symposium on Multi-Robot & Multi-Agent Systems (MRS 2025) Oral

R2 v1 2026-07-01T04:12:23.315Z