English

Cooperative Target Detection with AUVs: A Dual-Timescale Hierarchical MARDL Approach

Robotics 2025-09-18 v1 Machine Learning Multiagent Systems

Abstract

Autonomous Underwater Vehicles (AUVs) have shown great potential for cooperative detection and reconnaissance. However, collaborative AUV communications introduce risks of exposure. In adversarial environments, achieving efficient collaboration while ensuring covert operations becomes a key challenge for underwater cooperative missions. In this paper, we propose a novel dual time-scale Hierarchical Multi-Agent Proximal Policy Optimization (H-MAPPO) framework. The high-level component determines the individuals participating in the task based on a central AUV, while the low-level component reduces exposure probabilities through power and trajectory control by the participating AUVs. Simulation results show that the proposed framework achieves rapid convergence, outperforms benchmark algorithms in terms of performance, and maximizes long-term cooperative efficiency while ensuring covert operations.

Keywords

Cite

@article{arxiv.2509.13381,
  title  = {Cooperative Target Detection with AUVs: A Dual-Timescale Hierarchical MARDL Approach},
  author = {Zhang Xueyao and Yang Bo and Yu Zhiwen and Cao Xuelin and George C. Alexandropoulos and Merouane Debbah and Chau Yuen},
  journal= {arXiv preprint arXiv:2509.13381},
  year   = {2025}
}

Comments

6 pages