English
Related papers

Related papers: AlphaEarth Foundations: An embedding field model f…

200 papers

Geospatial foundation models increasingly expose pixel-level embedding products that can be downloaded and reused without access to the underlying encoder. In this setting, downstream tasks with patch- or region-level labels require a…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Isaac Corley , Caleb Robinson , Inbal Becker-Reshef , Juan M. Lavista Ferres

We present the Transparent Earth, a transformer-based architecture for reconstructing subsurface properties from heterogeneous datasets that vary in sparsity, resolution, and modality, where each modality represents a distinct type of…

Machine Learning · Computer Science 2025-09-24 Arnab Mazumder , Javier E. Santos , Noah Hobbs , Mohamed Mehana , Daniel O'Malley

Geospatial Foundation Models (GFMs) provide powerful representations, but high compute costs hinder their widespread use. Pre-computed embedding data products offer a practical "frozen" alternative, yet they currently exist in a fragmented…

Software Engineering · Computer Science 2026-02-25 Heng Fang , Adam J. Stewart , Isaac Corley , Xiao Xiang Zhu , Hossein Azizpour

Modern Earth observation (EO) increasingly leverages deep learning to harness the scale and diversity of satellite imagery across sensors and regions. While recent foundation models have demonstrated promising generalization across EO…

Mobile sensing systems have long faced a fundamental trade-off between sensing quality and efficiency due to constraints in computation, power, and other limitations. Sparse sensing, which aims to acquire and process only a subset of sensor…

Computer Vision and Pattern Recognition · Computer Science 2025-11-05 Yiqin Zhao , Tian Guo

Earth observation foundation models encode land surface information into dense embedding vectors, yet the geometric structure of these representations and its implications for downstream reasoning remain underexplored. We characterize the…

Computation and Language · Computer Science 2026-04-22 Mashrekur Rahman , Samuel J. Barrett , Christina Last

In this work we pretrain a CLIP/ViT based model using three different modalities of satellite imagery across five AOIs covering over ~10\% of Earth's total landmass, namely Sentinel 2 RGB optical imagery, Sentinel 1 SAR radar amplitude and…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Matt Allen , Francisco Dorr , Joseph A. Gallego-Mejia , Laura Martínez-Ferrer , Anna Jungbluth , Freddie Kalaitzis , Raúl Ramos-Pollán

Global forest cover is critical to the provision of certain ecosystem services. With the advent of the google earth engine cloud platform, fine resolution global land cover mapping task could be accomplished in a matter of days instead of…

Computer Vision and Pattern Recognition · Computer Science 2021-08-10 Qian Shi , Xiaolei Qin , Lingyu Sun , Zitao Shen , Xiaoping Liu , Xiaocong Xu , Jiaxin Tian , Rong Liu , Andrea Marinoni

We present DeepEarth, a self-supervised multi-modal world model with Earth4D, a novel planetary-scale 4D space-time positional encoder. Earth4D extends 3D multi-resolution hash encoding to include time, efficiently scaling across the planet…

Earth system science is producing increasingly large, high-dimensional datasets from physics based Earth system models to AI-based weather and climate models. Embedding-based representations can make these data searchable through similarity…

Data Analysis, Statistics and Probability · Physics 2026-05-05 Nihanth W. Cherukuru , Matt Rehme , Kirsten J. Mayer , David John Gagne , John Schreck , John Clyne , Charlie Becker

Modeling environmental ecosystems is essential for effective resource management, sustainable development, and understanding complex ecological processes. However, traditional methods frequently struggle with the inherent complexity,…

Machine Learning · Computer Science 2025-03-06 Runlong Yu , Shengyu Chen , Yiqun Xie , Xiaowei Jia

Foundation models have triggered a paradigm shift in computer vision and are increasingly being adopted in remote sensing, particularly for multispectral imagery. Yet, their potential in hyperspectral imaging (HSI) remains untapped due to…

Computer Vision and Pattern Recognition · Computer Science 2025-08-14 Nassim Ait Ali Braham , Conrad M Albrecht , Julien Mairal , Jocelyn Chanussot , Yi Wang , Xiao Xiang Zhu

Recent progress in self-supervision has shown that pre-training large neural networks on vast amounts of unsupervised data can lead to substantial increases in generalization to downstream tasks. Such models, recently coined foundation…

Large foundation models (FMs) are transforming Earth science by integrating heterogeneous multimodal data, such as multi-platform imagery, gridded reanalysis data, diverse geophysical and geochemical observations, and domain-specific text,…

Instrumentation and Methods for Astrophysics · Physics 2026-05-14 Xiangyu Zhao , Bo Liu , Yuehan Zhang , Zelin Song , Wanghan Xu , Feng Liu , Fengxiang Wang , Ben Fei , Fenghua Ling , Wangxu Wei , Wenlong Zhang , Xiao-Ming Wu

Accurate and up-to-date land cover maps are essential for understanding land use change, a key driver of climate change. Geospatial embeddings offer a more efficient and accessible way to map landscape features, yet their use in real-world…

Computer Vision and Pattern Recognition · Computer Science 2025-11-06 Ivan Zvonkov , Gabriel Tseng , Inbal Becker-Reshef , Hannah Kerner

We take the perspective in which we want to design a downstream task (such as estimating vegetation coverage) on a certain area of interest (AOI) with a limited labeling budget. By leveraging an existing Foundation Model (FM) we must decide…

Computer Vision and Pattern Recognition · Computer Science 2024-09-16 Raul Ramos-Pollan , Freddie Kalaitzis , Karthick Panner Selvam

Kilometer-scale Earth system models are essential for capturing local climate change. However, these models are computationally expensive and produce petabyte-scale outputs, which limits their utility for applications such as probabilistic…

Machine Learning · Computer Science 2026-01-22 Johannes Meuer , Maximilian Witte , Étiénne Plésiat , Thomas Ludwig , Christopher Kadow

When we are primarily interested in solving several problems jointly with a given prescribed high performance accuracy for each target application, then Foundation Models should for most cases be used rather than problem-specific models. We…

Computer Vision and Pattern Recognition · Computer Science 2024-06-27 Nikolaos Dionelis , Casper Fibaek , Luke Camilleri , Andreas Luyts , Jente Bosmans , Bertrand Le Saux

Estimating building footprint maps from geospatial data is of paramount importance in urban planning, development, disaster management, and various other applications. Deep learning methodologies have gained prominence in building…

Computer Vision and Pattern Recognition · Computer Science 2024-05-07 Anuja Vats , David Völgyes , Martijn Vermeer , Marius Pedersen , Kiran Raja , Daniele S. M. Fantin , Jacob Alexander Hay

Semantic segmentation of land cover classes is fundamental for agricultural and economic development work, from sustainable forestry to urban planning, yet existing training datasets have significant limitations. To generate an open and…

Computer Vision and Pattern Recognition · Computer Science 2018-11-21 Yoni Nachmany , Hamed Alemohammad