English

AC-MASAC: An Attentive Curriculum Learning Framework for Heterogeneous UAV Swarm Coordination

Robotics 2026-02-13 v1

Abstract

Cooperative path planning for heterogeneous UAV swarms poses significant challenges for Multi-Agent Reinforcement Learning (MARL), particularly in handling asymmetric inter-agent dependencies and addressing the risks of sparse rewards and catastrophic forgetting during training. To address these issues, this paper proposes an attentive curriculum learning framework (AC-MASAC). The framework introduces a role-aware heterogeneous attention mechanism to explicitly model asymmetric dependencies. Moreover, a structured curriculum strategy is designed, integrating hierarchical knowledge transfer and stage-proportional experience replay to address the issues of sparse rewards and catastrophic forgetting. The proposed framework is validated on a custom multi-agent simulation platform, and the results show that our method has significant advantages over other advanced methods in terms of Success Rate, Formation Keeping Rate, and Success-weighted Mission Time. The code is available at \textcolor{red}{https://github.com/Wanhao-Liu/AC-MASAC}.

Keywords

Cite

@article{arxiv.2602.11735,
  title  = {AC-MASAC: An Attentive Curriculum Learning Framework for Heterogeneous UAV Swarm Coordination},
  author = {Wanhao Liu and Junhong Dai and Yixuan Zhang and Shengyun Yin and Panshuo Li},
  journal= {arXiv preprint arXiv:2602.11735},
  year   = {2026}
}
R2 v1 2026-07-01T10:33:18.598Z