English
Related papers

Related papers: OlmoEarth: Stable Latent Image Modeling for Multim…

200 papers

When we are primarily interested in solving several problems jointly with a given prescribed high performance accuracy for each target application, then Foundation Models should for most cases be used rather than problem-specific models. We…

Computer Vision and Pattern Recognition · Computer Science 2024-06-27 Nikolaos Dionelis , Casper Fibaek , Luke Camilleri , Andreas Luyts , Jente Bosmans , Bertrand Le Saux

There is an increasing number of real-world problems in computer vision and machine learning requiring to take into consideration multiple interpretation layers (modalities or views) of the world and learn how they relate to each other. For…

Computer Vision and Pattern Recognition · Computer Science 2024-02-14 Alexandru-Raul Todoran , Marius Leordeanu

Earth observation (EO) in open-world settings presents a unique challenge: different applications rely on diverse sensor modalities, each with varying ground sampling distances, spectral ranges, and numbers of spectral bands. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-10-17 Zhitong Xiong , Yi Wang , Fahong Zhang , Adam J. Stewart , Joëlle Hanna , Damian Borth , Ioannis Papoutsis , Bertrand Le Saux , Gustau Camps-Valls , Xiao Xiang Zhu

Remote Sensing (RS) is a crucial technology for observing, monitoring, and interpreting our planet, with broad applications across geoscience, economics, humanitarian fields, etc. While artificial intelligence (AI), particularly deep…

Computer Vision and Pattern Recognition · Computer Science 2025-06-04 Aoran Xiao , Weihao Xuan , Junjue Wang , Jiaxing Huang , Dacheng Tao , Shijian Lu , Naoto Yokoya

Foundation models are rapidly transforming Earth Observation data mining by enabling generalizable and scalable solutions for key tasks such as scene classification and semantic segmentation. While most efforts in the geospatial domain have…

Computer Vision and Pattern Recognition · Computer Science 2025-06-27 Man Duc Chuc

Masked Image Modeling has been one of the most popular self-supervised learning paradigms to learn representations from large-scale, unlabeled Earth Observation images. While incorporating multi-modal and multi-temporal Earth Observation…

Computer Vision and Pattern Recognition · Computer Science 2026-03-04 Liang Zeng , Valerio Marsocci , Wufan Zhao , Andrea Nascetti , Maarten Vergauwen

The rapid advancement of multimodal large language models (MLLMs) offers new opportunities for complex scientific challenges, yet their application in earth science-especially at the graduate level-remains underexplored due to a lack of…

Artificial Intelligence · Computer Science 2026-05-05 Xiangyu Zhao , Wanghan Xu , Bo Liu , Yuhao Zhou , Fenghua Ling , Ben Fei , Xiaoyu Yue , Lei Bai , Wenlong Zhang , Xiao-Ming Wu

Earth Observation (EO) data analysis is vital for monitoring environmental and human dynamics. Recent Multimodal Large Language Models (MLLMs) show potential in EO understanding but remain restricted to single-sensor inputs, overlooking the…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Yan Shu , Bin Ren , Zhitong Xiong , Danda Pani Paudel , Luc Van Gool , Begüm Demir , Nicu Sebe , Paolo Rota

The Multimodal Learning for Earth and Environment Workshop (MultiEarth 2023) is the second annual CVPR workshop aimed at the monitoring and analysis of the health of Earth ecosystems by leveraging the vast amount of remote sensing data that…

Computer Vision and Pattern Recognition · Computer Science 2023-06-09 Miriam Cha , Gregory Angelides , Mark Hamilton , Andy Soszynski , Brandon Swenson , Nathaniel Maidel , Phillip Isola , Taylor Perron , Bill Freeman

Healthcare data now span EHRs, medical imaging, genomics, and wearable sensors, but most diagnostic models still process these modalities in isolation. This limits their ability to capture early, cross-modal disease signatures. This paper…

Machine Learning · Computer Science 2025-12-18 Md Talha Mohsin , Ismail Abdulrashid

Foundation models offer a promising route to transferable remote sensing representations, but many current approaches depend on very large pretraining datasets and fixed sensor configurations, limiting their suitability for ecological and…

Earth observation (EO) is crucial for monitoring environmental changes, responding to disasters, and managing natural resources. In this context, foundation models facilitate remote sensing image analysis to retrieve relevant geoinformation…

Computer Vision and Pattern Recognition · Computer Science 2025-06-16 Francesc Marti-Escofet , Benedikt Blumenstiel , Linus Scheibenreif , Paolo Fraccaro , Konrad Schindler

Earth observation (EO), aiming at monitoring the state of planet Earth using remote sensing data, is critical for improving our daily lives and living environment. With a growing number of satellites in orbit, an increasing number of…

Computer Vision and Pattern Recognition · Computer Science 2024-04-04 Zhitong Xiong , Fahong Zhang , Yi Wang , Yilei Shi , Xiao Xiang Zhu

The Landsat program is the longest-running Earth observation program in history, with 50+ years of data acquisition by 8 satellites. The multispectral imagery captured by sensors onboard these satellites is critical for a wide range of…

Geospatial foundation models generate high-dimensional embeddings that achieve strong predictive performance, yet their internal organization remains obscure, limiting their scientific use. Recent interpretability studies relate Google…

Earth observation (EO) foundation models (FMs) are increasingly trained on multisensor data, spanning multispectral imagery (MSI), synthetic aperture radar (SAR), and derived geospatial layers, but hyperspectral imagery (HSI) remains…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Nassim Ait Ali Braham , Aaron Banze , Conrad M. Albrecht , Julien Mairal , Jocelyn Chanussot , Xiao Xiang Zhu

Remote Sensing (RS) data encapsulates rich multi-dimensional information essential for Earth observation. Its vast volume, diverse sources, and temporal continuity make it particularly well-suited for developing large Visual Foundation…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Xuyang Li , Chenyu Li , Gemine Vivone , Danfeng Hong

We present AiTLAS: Benchmark Arena -- an open-source benchmark suite for evaluating state-of-the-art deep learning approaches for image classification in Earth Observation (EO). To this end, we present a comprehensive comparative analysis…

Computer Vision and Pattern Recognition · Computer Science 2023-02-02 Ivica Dimitrovski , Ivan Kitanovski , Dragi Kocev , Nikola Simidjievski

Recent progress in self-supervision shows that pre-training large neural networks on vast amounts of unsupervised data can lead to impressive increases in generalisation for downstream tasks. Such models, recently coined as foundation…

Recent progress in self-supervision has shown that pre-training large neural networks on vast amounts of unsupervised data can lead to substantial increases in generalization to downstream tasks. Such models, recently coined foundation…