English
Related papers

Related papers: OlmoEarth: Stable Latent Image Modeling for Multim…

200 papers

Large-scale foundation models in Earth Observation can learn versatile, label-efficient representations by leveraging massive amounts of unlabeled data. However, existing public datasets are often limited in scale, geographic coverage, or…

Multi-modal data in Earth Observation (EO) presents a huge opportunity for improving transfer learning capabilities when pre-training deep learning models. Unlike prior work that often overlooks multi-modal EO data, recent methods have…

Computer Vision and Pattern Recognition · Computer Science 2025-05-22 Jose Sosa , Danila Rukhovich , Anis Kacem , Djamila Aouada

Multi-modal co-learning is emerging as an effective paradigm in machine learning, enabling models to collaboratively learn from different modalities to enhance single-modality predictions. Earth Observation (EO) represents a quintessential…

Computer Vision and Pattern Recognition · Computer Science 2025-11-20 Francisco Mena , Dino Ienco , Cassio F. Dantas , Roberto Interdonato , Andreas Dengel

We present TerraMind, the first any-to-any generative, multimodal foundation model for Earth observation (EO). Unlike other multimodal models, TerraMind is pretrained on dual-scale representations combining both token-level and pixel-level…

The diversity and complementarity of sensors available for Earth Observations (EO) calls for developing bespoke self-supervised multimodal learning approaches. However, current multimodal EO datasets and models typically focus on a single…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Guillaume Astruc , Nicolas Gonthier , Clement Mallet , Loic Landrieu

Recent research in geospatial machine learning has demonstrated that models pretrained with self-supervised learning on Earth observation data can perform well on downstream tasks with limited training data. However, most of the existing…

Computer Vision and Pattern Recognition · Computer Science 2026-02-09 Lucia Gordon , Serge Belongie , Christian Igel , Nico Lang

Modern Earth observation (EO) increasingly leverages deep learning to harness the scale and diversity of satellite imagery across sensors and regions. While recent foundation models have demonstrated promising generalization across EO…

We present the Transparent Earth, a transformer-based architecture for reconstructing subsurface properties from heterogeneous datasets that vary in sparsity, resolution, and modality, where each modality represents a distinct type of…

Machine Learning · Computer Science 2025-09-24 Arnab Mazumder , Javier E. Santos , Noah Hobbs , Mohamed Mehana , Daniel O'Malley

The increasing frequency and severity of climate related disasters have intensified the need for real time monitoring, early warning, and informed decision-making. Earth Observation (EO), powered by satellite data and Machine Learning (ML),…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Stella Girtsou , Konstantinos Alexis , Giorgos Giannopoulos , Charalambos Kontoes

The volume of unlabelled Earth observation (EO) data is huge, but many important applications lack labelled training data. However, EO data offers the unique opportunity to pair data from different modalities and sensors automatically based…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Vishal Nedungadi , Ankit Kariryaa , Stefan Oehmcke , Serge Belongie , Christian Igel , Nico Lang

Vision-Language Models (VLMs) have demonstrated effective perception and reasoning capabilities on general-domain tasks, leading to growing interest in their application to Earth observation. However, a systematic benchmark for…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Ronghao Fu , Haoran Liu , Weijie Zhang , Zhiwen Lin , Xiao Yang , Peng Zhang , Bo Yang

Earth observation (EO) foundation models have emerged as an effective approach to derive latent representations of the Earth system from various remote sensing sensors. These models produce embeddings that can be used as analysis-ready…

Machine Learning · Computer Science 2025-11-21 Julia Peters , Karin Mora , Miguel D. Mahecha , Chaonan Ji , David Montero , Clemens Mosig , Guido Kraemer

Advances in Earth observation (EO) foundation models have unlocked the potential of big satellite data to learn generic representations from space, benefiting a wide range of downstream applications crucial to our planet. However, most…

Managing natural resources and mitigating risks from floods, droughts, wildfires, and landslides require models that can accurately predict climate-driven land-surface responses. Traditional models often struggle with spatial generalization…

Machine Learning · Computer Science 2026-02-03 Nicholas Kraabel , Jiangtao Liu , Yuchen Bian , Daniel Kifer , Chaopeng Shen

This paper reviews the most important information fusion data-driven algorithms based on Machine Learning (ML) techniques for problems in Earth observation. Nowadays we observe and model the Earth with a wealth of observations, from a…

Computer Vision and Pattern Recognition · Computer Science 2020-12-11 S. Salcedo-Sanz , P. Ghamisi , M. Piles , M. Werner , L. Cuadra , A. Moreno-Martínez , E. Izquierdo-Verdiguier , J. Muñoz-Marí , Amirhosein Mosavi , G. Camps-Valls

We propose TerraFlow, a novel approach to multimodal, multitemporal learning for Earth observation. TerraFlow builds on temporal training objectives that enable sequence-aware learning across space, time, and modality, while remaining…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 Nazar Puriy , Johannes Jakubik , Benedikt Blumenstiel , Konrad Schindler

Existing benchmarks for multimodal learning in Earth science offer limited, siloed coverage of Earth's spheres and their cross-sphere interactions, typically restricting evaluation to the human-activity sphere of atmosphere and to at most…

Computer Vision and Pattern Recognition · Computer Science 2026-02-17 Fengxiang Wang , Mingshuo Chen , Xuming He , Yi-Fan Zhang , Yueying Li , Feng Liu , Zijie Guo , Zhenghao Hu , Jiong Wang , Jingyi Xu , Zhangrui Li , Junchao Gong , Di Wang , Fenghua Ling , Ben Fei , Weijia Li , Long Lan , Wenjing Yang

This work presents SSL4EO-S12 v1.1, a multimodal, multitemporal Earth Observation dataset designed for pretraining large-scale foundation models. Building on the success of SSL4EO-S12, this extension updates the previous version to fix…

Computer Vision and Pattern Recognition · Computer Science 2026-02-18 Benedikt Blumenstiel , Nassim Ait Ali Braham , Conrad M Albrecht , Stefano Maurogiovanni , Paolo Fraccaro

Foundation models characterized by extensive parameters and trained on large-scale datasets have demonstrated remarkable efficacy across various downstream tasks for remote sensing data. Current remote sensing foundation models typically…

Computer Vision and Pattern Recognition · Computer Science 2024-05-29 Zhitong Xiong , Yi Wang , Fahong Zhang , Xiao Xiang Zhu

Unprecedented volumes of Earth observation data are continually collected around the world, but high-quality labels remain scarce given the effort required to make physical measurements and observations. This has led to considerable…

‹ Prev 1 2 3 10 Next ›