English

Remote Sensing-Oriented World Model

Machine Learning 2025-12-02 v3

Abstract

World models have shown potential in artificial intelligence by predicting and reasoning about world states beyond direct observations. However, existing approaches are predominantly evaluated in synthetic environments or constrained scene settings, limiting their validation in real-world contexts with broad spatial coverage and complex semantics. Meanwhile, remote sensing applications urgently require spatial reasoning capabilities for disaster response and urban planning. This paper bridges these gaps by introducing the first framework for world modeling in remote sensing. We formulate remote sensing world modeling as direction-conditioned spatial extrapolation, where models generate semantically consistent adjacent image tiles given a central observation and directional instruction. To enable rigorous evaluation, we develop RSWISE (Remote Sensing World-Image Spatial Evaluation), a benchmark containing 1,600 evaluation tasks across four scenarios: general, flood, urban, and rural. RSWISE combines visual fidelity assessment with instruction compliance evaluation using GPT-4o as a semantic judge, ensuring models genuinely perform spatial reasoning rather than simple replication. Afterwards, we present RemoteBAGEL, a unified multimodal model fine-tuned on remote sensing data for spatial extrapolation tasks. Extensive experiments demonstrate that RemoteBAGEL consistently outperforms state-of-the-art baselines on RSWISE.

Keywords

Cite

@article{arxiv.2509.17808,
  title  = {Remote Sensing-Oriented World Model},
  author = {Yuxi Lu and Biao Wu and Zhidong Li and Kunqi Li and Chenya Huang and Huacan Wang and Qizhen Lan and Ronghao Chen and Ling Chen and Bin Liang},
  journal= {arXiv preprint arXiv:2509.17808},
  year   = {2025}
}

Comments

10 pages, 5 figures

R2 v1 2026-07-01T05:49:38.996Z