English
Related papers

Related papers: SSL4EO-S12 v1.1: A Multimodal, Multiseasonal Datas…

200 papers

In this paper we present a curated dataset from the NASA Solar Dynamics Observatory (SDO) mission in a format suitable for machine learning research. Beginning from level 1 scientific products we have processed various instrumental…

Satellite image time series (SITS) segmentation is crucial for many applications like environmental monitoring, land cover mapping and agricultural crop type classification. However, training models for SITS segmentation remains a…

Computer Vision and Pattern Recognition · Computer Science 2024-06-28 Jayanth Shenoy , Xingjian Davis Zhang , Shlok Mehrotra , Bill Tao , Rem Yang , Han Zhao , Deepak Vasisht

Efficiently modeling spatio-temporal (ST) physical processes and observations presents a challenging problem for the deep learning community. Many recent studies have concentrated on meticulously reconciling various advantages, leading to…

Artificial Intelligence · Computer Science 2024-06-04 Hao Wu , Yuxuan Liang , Wei Xiong , Zhengyang Zhou , Wei Huang , Shilong Wang , Kun Wang

Remote Sensing (RS) data encapsulates rich multi-dimensional information essential for Earth observation. Its vast volume, diverse sources, and temporal continuity make it particularly well-suited for developing large Visual Foundation…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Xuyang Li , Chenyu Li , Gemine Vivone , Danfeng Hong

We introduce OpenEvents V1a large-scale benchmark dataset designed to advance event-centric vision-language understanding. Unlike conventional image captioning and retrieval datasets that focus on surface-level descriptions, OpenEvents V1…

Computer Vision and Pattern Recognition · Computer Science 2025-08-27 Hieu Nguyen , Phuc-Tan Nguyen , Thien-Phuc Tran , Minh-Quang Nguyen , Tam V. Nguyen , Minh-Triet Tran , Trung-Nghia Le

Earth Observation (EO) analysis is inherently interactive: resolving uncertainty often requires expanding the region of interest, retrieving historical observations, and switching across sensors such as optical and Synthetic Aperture Radar.…

Artificial Intelligence · Computer Science 2026-05-05 Sai Ma , Zhuang Li , Sichao Li , Xinyue Xu , Ruibiao Zhu , Tony Boston , John A. Taylor

Foundation models and self-supervised learning (SSL) have become central to modern AI, yet research in this area remains hindered by complex codebases, redundant re-implementations, and the heavy engineering burden of scaling experiments.…

Software Engineering · Computer Science 2025-11-26 Randall Balestriero , Hugues Van Assel , Sami BuGhanem , Lucas Maes

The performance of unified multimodal models for image generation and editing is fundamentally constrained by the quality and comprehensiveness of their training data. While existing datasets have covered basic tasks like style transfer and…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Zhihong Chen , Xuehai Bai , Yang Shi , Chaoyou Fu , Huanyu Zhang , Haotian Wang , Xiaoyan Sun , Zhang Zhang , Liang Wang , Yuanxing Zhang , Pengfei Wan , Yi-Fan Zhang

Effective foundation modeling in remote sensing requires spatially aligned heterogeneous modalities coupled with semantically grounded supervision, yet such resources remain limited at scale. We present GeoMeld, a large-scale multimodal…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Maram Hasan , Md Aminur Hossain , Savitra Roy , Souparna Bhowmik , Ayush V. Patel , Mainak Singha , Subhasis Chaudhuri , Muhammad Haris Khan , Biplab Banerjee

While existing time series foundation models primarily rely on large-scale unimodal pretraining, they lack complementary modalities to enhance time series understanding. Building multimodal foundation models is a natural next step, but it…

Machine Learning · Computer Science 2026-02-06 Peng Chen , Siyuan Wang , Shiyan Hu , Xingjian Wu , Yang Shu , Zhongwen Rao , Meng Wang , Yijie Li , Bin Yang , Chenjuan Guo

While annotated images for change detection using satellite imagery are scarce and costly to obtain, there is a wealth of unlabeled images being generated every day. In order to leverage these data to learn an image representation more…

Computer Vision and Pattern Recognition · Computer Science 2021-04-13 Marrit Leenstra , Diego Marcos , Francesca Bovolo , Devis Tuia

The availability of temporal geospatial data in multiple modalities has been extensively leveraged to enhance the performance of machine learning models. While efforts on the design of adequate model architectures are approaching a level of…

Machine Learning · Computer Science 2024-08-22 Hiba Najjar , Marlon Nuske , Andreas Dengel

Deep learning methods have significantly advanced the development of intelligent rinterpretation in remote sensing (RS), with foundational model research based on large-scale pre-training paradigms rapidly reshaping various domains of Earth…

Computer Vision and Pattern Recognition · Computer Science 2025-07-02 Zhiwei Yi , Xin Cheng , Jingyu Ma , Ruifei Zhu , Junwei Tian , Yuanxiu Zhou , Xinge Zhao , Hongzhe Li

The rapid advancement of autonomous systems, including self-driving vehicles and drones, has intensified the need to forge true Spatial Intelligence from multi-modal onboard sensor data. While foundation models excel in single-modal…

Computer Vision and Pattern Recognition · Computer Science 2026-01-09 Song Wang , Lingdong Kong , Xiaolu Liu , Hao Shi , Wentong Li , Jianke Zhu , Steven C. H. Hoi

Advances in Earth observation (EO) foundation models have unlocked the potential of big satellite data to learn generic representations from space, benefiting a wide range of downstream applications crucial to our planet. However, most…

We introduce Timer-S1, a strong Mixture-of-Experts (MoE) time series foundation model with 8.3B total parameters, 0.75B activated parameters for each token, and a context length of 11.5K. To overcome the scalability bottleneck in existing…

Artificial Intelligence · Computer Science 2026-04-10 Yong Liu , Xingjian Su , Shiyu Wang , Haoran Zhang , Haixuan Liu , Yuxuan Wang , Zhou Ye , Yang Xiang , Jianmin Wang , Mingsheng Long

A significant amount of remotely sensed data is generated daily by many Earth observation (EO) spaceborne and airborne sensors over different countries of our planet. Different applications use those data, such as natural hazard monitoring,…

Image and Video Processing · Electrical Eng. & Systems 2024-10-23 Alessandro Sebastianelli , Francesco Mauro , Giulia Ciabatti , Dario Spiller , Bertrand Le Saux , Paolo Gamba , Silvia Ullo

Satellite images are snapshots of the Earth surface. We propose to forecast them. We frame Earth surface forecasting as the task of predicting satellite imagery conditioned on future weather. EarthNet2021 is a large dataset suitable for…

Machine Learning · Computer Science 2021-04-21 Christian Requena-Mesa , Vitus Benson , Markus Reichstein , Jakob Runge , Joachim Denzler

Spatiotemporal forecasting techniques are significant for various domains such as transportation, energy, and weather. Accurate prediction of spatiotemporal series remains challenging due to the complex spatiotemporal heterogeneity. In…

Machine Learning · Computer Science 2024-10-01 Haotian Gao , Renhe Jiang , Zheng Dong , Jinliang Deng , Yuxin Ma , Xuan Song

Earth observation (EO) foundation models have emerged as an effective approach to derive latent representations of the Earth system from various remote sensing sensors. These models produce embeddings that can be used as analysis-ready…

Machine Learning · Computer Science 2025-11-21 Julia Peters , Karin Mora , Miguel D. Mahecha , Chaonan Ji , David Montero , Clemens Mosig , Guido Kraemer