English
Related papers

Related papers: TerraMind: Large-Scale Generative Multimodality fo…

200 papers

Earth Observation (EO) data analysis is vital for monitoring environmental and human dynamics. Recent Multimodal Large Language Models (MLLMs) show potential in EO understanding but remain restricted to single-sensor inputs, overlooking the…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Yan Shu , Bin Ren , Zhitong Xiong , Danda Pani Paudel , Luc Van Gool , Begüm Demir , Nicu Sebe , Paolo Rota

Large-scale foundation models in Earth Observation can learn versatile, label-efficient representations by leveraging massive amounts of unlabeled data. However, existing public datasets are often limited in scale, geographic coverage, or…

Multi-modal data in Earth Observation (EO) presents a huge opportunity for improving transfer learning capabilities when pre-training deep learning models. Unlike prior work that often overlooks multi-modal EO data, recent methods have…

Computer Vision and Pattern Recognition · Computer Science 2025-05-22 Jose Sosa , Danila Rukhovich , Anis Kacem , Djamila Aouada

Modern Earth observation (EO) increasingly leverages deep learning to harness the scale and diversity of satellite imagery across sensors and regions. While recent foundation models have demonstrated promising generalization across EO…

The diversity and complementarity of sensors available for Earth Observations (EO) calls for developing bespoke self-supervised multimodal learning approaches. However, current multimodal EO datasets and models typically focus on a single…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Guillaume Astruc , Nicolas Gonthier , Clement Mallet , Loic Landrieu

Multi-modal co-learning is emerging as an effective paradigm in machine learning, enabling models to collaboratively learn from different modalities to enhance single-modality predictions. Earth Observation (EO) represents a quintessential…

Computer Vision and Pattern Recognition · Computer Science 2025-11-20 Francisco Mena , Dino Ienco , Cassio F. Dantas , Roberto Interdonato , Andreas Dengel

Earth observation data presents a unique challenge: it is spatial like images, sequential like video or text, and highly multimodal. We present OlmoEarth: a multimodal, spatio-temporal foundation model that employs a novel self-supervised…

The value of Earth observation foundation models for high-impact ecological applications remains insufficiently characterized. This study is one of the first to systematically evaluate the performance, limitations and practical…

Computer Vision and Pattern Recognition · Computer Science 2026-02-25 Craig Mahlasi , Gciniwe S. Baloyi , Zaheed Gaffoor , Levente Klein , Anne Jones , Etienne Vos , Michal Muszynski , Geoffrey Dawson , Campbell Watson

Multi-modal remote sensing images are vital for Earth observation, yet complete paired observations are often scarce in practice. Existing generative methods commonly address this problem through isolated pairwise modality translation, but…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Zhiping Yu , Chenyang Liu , Jinqi Cao , Qinzhe Yang , Siwei Yu , Zhengxia Zou , Zhenwei Shi

Earth observation (EO) foundation models have emerged as an effective approach to derive latent representations of the Earth system from various remote sensing sensors. These models produce embeddings that can be used as analysis-ready…

Machine Learning · Computer Science 2025-11-21 Julia Peters , Karin Mora , Miguel D. Mahecha , Chaonan Ji , David Montero , Clemens Mosig , Guido Kraemer

State-of-the-art generative image and video models rely heavily on tokenizers that compress high-dimensional inputs into more efficient latent representations. While this paradigm has revolutionized RGB generation, Earth observation (EO)…

Computer Vision and Pattern Recognition · Computer Science 2026-03-04 Nils Lehmann , Yi Wang , Zhitong Xiong , Xiaoxiang Zhu

Floods are among the most damaging weather-related hazards, and in 2024, the warmest year on record, extreme flood events affected communities across five continents. Earth observation (EO) satellites provide critical, frequent coverage for…

Computer Vision and Pattern Recognition · Computer Science 2025-12-03 Mirela G. Tulbure , Julio Caineta , Mark Broich , Mollie D. Gaines , Philippe Rufin , Leon-Friedrich Thomas , Hamed Alemohammad , Jan Hemmerling , Patrick Hostert

We propose TerraFlow, a novel approach to multimodal, multitemporal learning for Earth observation. TerraFlow builds on temporal training objectives that enable sequence-aware learning across space, time, and modality, while remaining…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 Nazar Puriy , Johannes Jakubik , Benedikt Blumenstiel , Konrad Schindler

Effective foundation modeling in remote sensing requires spatially aligned heterogeneous modalities coupled with semantically grounded supervision, yet such resources remain limited at scale. We present GeoMeld, a large-scale multimodal…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Maram Hasan , Md Aminur Hossain , Savitra Roy , Souparna Bhowmik , Ayush V. Patel , Mainak Singha , Subhasis Chaudhuri , Muhammad Haris Khan , Biplab Banerjee

Deep learning models are increasingly data-hungry, requiring significant resources to collect and compile the datasets needed to train them, with Earth Observation (EO) models being no exception. However, the landscape of datasets in EO is…

Computer Vision and Pattern Recognition · Computer Science 2024-06-24 Alistair Francis , Mikolaj Czerkawski

The volume of unlabelled Earth observation (EO) data is huge, but many important applications lack labelled training data. However, EO data offers the unique opportunity to pair data from different modalities and sensors automatically based…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Vishal Nedungadi , Ankit Kariryaa , Stefan Oehmcke , Serge Belongie , Christian Igel , Nico Lang

Earth observation (EO) satellites produce massive streams of multispectral image time series, posing pressing challenges for storage and transmission. Yet, learned EO compression remains fragmented and lacks publicly available, large-scale…

Computer Vision and Pattern Recognition · Computer Science 2026-03-06 Julen Costa-Watanabe , Isabelle Wittmann , Benedikt Blumenstiel , Konrad Schindler

High spectral resolution imagery of the Earth's surface enables users to monitor changes over time in fine-grained scale, playing an increasingly important role in agriculture, defense, and emergency response. However, most current…

Computer Vision and Pattern Recognition · Computer Science 2023-04-19 Meiqi Hu , Chen Wu , Liangpei Zhang

Vision-language models (VLMs) have shown promise in earth observation (EO), yet they struggle with tasks that require grounding complex spatial reasoning in precise pixel-level visual representations. To address this problem, we introduce…

Computer Vision and Pattern Recognition · Computer Science 2026-03-20 Yan Shu , Bin Ren , Zhitong Xiong , Xiao Xiang Zhu , Begüm Demir , Nicu Sebe , Paolo Rota

Terrain-aware perception holds the potential to improve the robustness and accuracy of autonomous robot navigation in the wilds, thereby facilitating effective off-road traversals. However, the lack of multi-modal perception across various…

Robotics · Computer Science 2024-03-26 Chen Yao , Yangtao Ge , Guowei Shi , Zirui Wang , Ningbo Yang , Zheng Zhu , Hexiang Wei , Yuntian Zhao , Jing Wu , Zhenzhong Jia
‹ Prev 1 2 3 10 Next ›