English
Related papers

Related papers: EO-Gym: A Multimodal, Interactive Environment for …

200 papers

Earth Observation (EO) data analysis is vital for monitoring environmental and human dynamics. Recent Multimodal Large Language Models (MLLMs) show potential in EO understanding but remain restricted to single-sensor inputs, overlooking the…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Yan Shu , Bin Ren , Zhitong Xiong , Danda Pani Paudel , Luc Van Gool , Begüm Demir , Nicu Sebe , Paolo Rota

Recent progress in multimodal reasoning has enabled agents that interpret imagery, connect it with language, and execute structured analytical tasks. Extending these capabilities to remote sensing remains challenging, as models must reason…

This paper presents Prithvi-EO-2.0, a new geospatial foundation model that offers significant improvements over its predecessor, Prithvi-EO-1.0. Trained on 4.2 million global time series samples from NASA's Harmonized Landsat and Sentinel-2…

Understanding 3D spatial relationships remains a major limitation of current Vision-Language Models (VLMs). Prior work has addressed this issue by creating spatial question-answering (QA) datasets based on single images or indoor videos.…

Computer Vision and Pattern Recognition · Computer Science 2025-10-01 Mohsen Gholami , Ahmad Rezaei , Zhou Weimin , Sitong Mao , Shunbo Zhou , Yong Zhang , Mohammad Akbari

Earth observation (EO) data spans a wide range of spatial, spectral, and temporal resolutions, from high-resolution optical imagery to low resolution multispectral products or radar time series. While recent foundation models have improved…

Computer Vision and Pattern Recognition · Computer Science 2025-12-05 Nicolas Houdré , Diego Marcos , Hugo Riffaud de Turckheim , Dino Ienco , Laurent Wendling , Camille Kurtz , Sylvain Lobry

As AI agents increasingly operate in open, real-world environments, they require a deep synergy of multimodal perception, tool invocation with multi-hop reasoning, and dynamic interaction with users. However, existing benchmarks fail to…

Artificial Intelligence · Computer Science 2026-05-28 Yunqi Liu , Tong Niu , Zitong Wang , Zhenlong Dai , Yuqi Qing , Weiqiang Wang , Jian Liu

State-of-the-art generative image and video models rely heavily on tokenizers that compress high-dimensional inputs into more efficient latent representations. While this paradigm has revolutionized RGB generation, Earth observation (EO)…

Computer Vision and Pattern Recognition · Computer Science 2026-03-04 Nils Lehmann , Yi Wang , Zhitong Xiong , Xiaoxiang Zhu

The increasing availability of open Earth Observation (EO) and agricultural datasets holds great potential for supporting sustainable land management. However, their high technical entry barrier limits accessibility for non-expert users.…

Artificial Intelligence · Computer Science 2026-02-19 Juan Cañada , Raúl Alonso , Julio Molleda , Fidel Díez

Earth observation (EO) missions produce petabytes of multispectral imagery, increasingly analyzed using large Geospatial Foundation Models (GeoFMs). Alongside end-to-end adaptation, workflows make growing use of intermediate representations…

Computer Vision and Pattern Recognition · Computer Science 2026-04-09 Luis Gilch , Isabelle Wittmann , Maximilian Nitsche , Johannes Jakubik , Arne Ewald , Thomas Brunschwiler

Earth Observation (EO) systems are essentially designed to support domain experts who often express their requirements through vague natural language rather than precise, machine-friendly instructions. Depending on the specific application…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Liang Yao , Shengxiang Xu , Fan Liu , Chuanyi Zhang , Bishun Yao , Rui Min , Yongjun Li , Chaoqian Ouyang , Shimin Di , Min-Ling Zhang

We present GEM, a Generalizable Ego-vision Multimodal world model that predicts future frames using a reference frame, sparse features, human poses, and ego-trajectories. Hence, our model has precise control over object dynamics, ego-agent…

Modern Vision-Language Models (VLMs) remain poorly characterized in multi-step visual interactions, particularly in how they integrate perception, memory, and action over long horizons. We introduce VisGym, a gymnasium of 17 environments…

Computer Vision and Pattern Recognition · Computer Science 2026-01-26 Zirui Wang , Junyi Zhang , Jiaxin Ge , Long Lian , Letian Fu , Lisa Dunlap , Ken Goldberg , XuDong Wang , Ion Stoica , David M. Chan , Sewon Min , Joseph E. Gonzalez

Modern Earth observation (EO) increasingly leverages deep learning to harness the scale and diversity of satellite imagery across sensors and regions. While recent foundation models have demonstrated promising generalization across EO…

As agentic systems increasingly rely on reinforcement learning from verifiable rewards, standardized ``gym'' infrastructure has become essential for rapid iteration, reproducibility, and fair comparison. Vision agents lack such…

Computer Vision and Pattern Recognition · Computer Science 2026-04-09 Fanqing Meng , Lingxiao Du , Jiawei Gu , Jiaqi Liao , Linjie Li , Zijian Wu , Xiangyan Liu , Ziqi Zhao , Mengkang Hu , Zichen Liu , Jiaheng Zhang , Michael Qizhe Shieh

Deep learning models are increasingly data-hungry, requiring significant resources to collect and compile the datasets needed to train them, with Earth Observation (EO) models being no exception. However, the landscape of datasets in EO is…

Computer Vision and Pattern Recognition · Computer Science 2024-06-24 Alistair Francis , Mikolaj Czerkawski

Advances in Earth observation (EO) foundation models have unlocked the potential of big satellite data to learn generic representations from space, benefiting a wide range of downstream applications crucial to our planet. However, most…

Earth Observation (EO) systems are crucial for cartography, disaster surveillance, and resource administration. Nonetheless, they encounter considerable obstacles in the processing and transmission of extensive data, especially in…

Earth observation (EO) foundation models have emerged as an effective approach to derive latent representations of the Earth system from various remote sensing sensors. These models produce embeddings that can be used as analysis-ready…

Machine Learning · Computer Science 2025-11-21 Julia Peters , Karin Mora , Miguel D. Mahecha , Chaonan Ji , David Montero , Clemens Mosig , Guido Kraemer

Generalizable active mapping in complex unknown environments remains a critical challenge for mobile robots. Existing methods, constrained by insufficient training data and conservative exploration strategies, exhibit limited…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Xiao Chen , Tai Wang , Quanyi Li , Tao Huang , Jiangmiao Pang , Tianfan Xue

A significant amount of remotely sensed data is generated daily by many Earth observation (EO) spaceborne and airborne sensors over different countries of our planet. Different applications use those data, such as natural hazard monitoring,…

Image and Video Processing · Electrical Eng. & Systems 2024-10-23 Alessandro Sebastianelli , Francesco Mauro , Giulia Ciabatti , Dario Spiller , Bertrand Le Saux , Paolo Gamba , Silvia Ullo