English

Bridging Perception and Action: A Lightweight Multimodal Meta-Planner Framework for Robust Earth Observation Agents

Multiagent Systems 2026-05-07 v1

Abstract

Autonomous Earth Observation (EO) agents are transitioning from passive perception to complex, multi-step task execution. However, current architectures that integrate planning and execution within a single model often struggle with combinatorial complexity and reasoning errors in dynamic EO scenarios. To resolve these challenges, we propose the Lightweight Multimodal Meta-Planner (LMMP) framework. LMMP incorporates a dual-awareness mechanism that grounds strategic plans in both multimodal image features and high-level task semantics. Crucially, we introduce a Meta Task Library to inject remote sensing expert knowledge directly into the workflow, which standardizes domain logic and ensures plans are physically feasible. We further implement a two-stage training pipeline, initializing the Meta-Planner via expert-distilled Supervised Fine-Tuning and refining it through Direct Preference Optimization based on execution feedback. Extensive experiments on a dataset derived from EarthBench and ThinkGeo demonstrate that LMMP significantly improves tool-calling accuracy and task success rates. Moreover, the framework exhibits strong ``plug-and-play'' versatility, consistently enhancing the performance of diverse executor backbones across previously unseen EO missions.

Keywords

Cite

@article{arxiv.2605.04777,
  title  = {Bridging Perception and Action: A Lightweight Multimodal Meta-Planner Framework for Robust Earth Observation Agents},
  author = {Jinghui Xu and Boyi Shangguan and Mengke Zhu and Hao Liu and Junhuan Jiang and Guangjun He and Pengming Feng and Shichao Jin and Bin Liang and Yongzhe Chang and Junbo Tan and Tiantian Zhang and Xueqian Wang},
  journal= {arXiv preprint arXiv:2605.04777},
  year   = {2026}
}
R2 v1 2026-07-01T12:52:35.424Z