English

Cross-Modal Navigation with Multi-Agent Reinforcement Learning

Robotics 2026-05-08 v1 Artificial Intelligence Machine Learning Multiagent Systems

Abstract

Robust embodied navigation relies on complementary sensory cues. However, high-quality and well-aligned multi-modal data is often difficult to obtain in practice. Training a monolithic model is also challenging as rich multi-modal inputs induce complex representations and substantially enlarge the policy space. Cross-modal collaboration among lightweight modality-specialized agents offers a scalable paradigm. It enables flexible deployment and parallel execution, while preserving the strength of each modality. In this paper, we propose \textbf{CRONA}, a Multi-Agent Reinforcement Learning (MARL) framework for \textbf{Cro}ss-Modal \textbf{Na}vigation. CRONA improves collaboration by leveraging control-relevant auxiliary beliefs and a centralized multi-modal critic with global state. Experiments on visual-acoustic navigation tasks show that multi-agent methods significantly improve performance and efficiency over single-agent baselines. We find that homogeneous collaboration with limited modalities is sufficient for short-range navigation under salient cues; heterogeneous collaboration among agents with complementary modalities is generally efficient and effective; and navigation in large, complex environments requires both richer multi-modal perception and increased model capacity.

Keywords

Cite

@article{arxiv.2605.06595,
  title  = {Cross-Modal Navigation with Multi-Agent Reinforcement Learning},
  author = {Shuo Liu and Xinzichen Li and Christopher Amato},
  journal= {arXiv preprint arXiv:2605.06595},
  year   = {2026}
}
R2 v1 2026-07-01T12:55:39.228Z