English
Related papers

Related papers: Scaling Laws for Geospatial Foundation Models: A c…

200 papers

Large-scale maps of field boundaries are essential for agricultural monitoring tasks. Existing deep learning approaches for satellite-based field mapping are sensitive to illumination, spatial scale, and changes in geographic location. We…

We explore the scaling behaviors of artificial intelligence to establish practical techniques for training foundation models on high-resolution electro-optical (EO) datasets that exceed the current state-of-the-art scale by orders of…

Computer Vision and Pattern Recognition · Computer Science 2026-01-15 Charith Wickrema , Eliza Mace , Hunter Brown , Heidys Cabrera , Nick Krall , Matthew O'Neill , Shivangi Sarkar , Lowell Weissman , Eric Hughes , Guido Zarrella

Foundation models are rapidly transforming Earth Observation data mining by enabling generalizable and scalable solutions for key tasks such as scene classification and semantic segmentation. While most efforts in the geospatial domain have…

Computer Vision and Pattern Recognition · Computer Science 2025-06-27 Man Duc Chuc

When we are primarily interested in solving several problems jointly with a given prescribed high performance accuracy for each target application, then Foundation Models should for most cases be used rather than problem-specific models. We…

Computer Vision and Pattern Recognition · Computer Science 2024-06-27 Nikolaos Dionelis , Casper Fibaek , Luke Camilleri , Andreas Luyts , Jente Bosmans , Bertrand Le Saux

Accurate and timely crop yield prediction is crucial for global food security and modern agricultural management. Traditional methods often lack the scalability and granularity required for precision farming. This paper introduces FARM:…

Computer Vision and Pattern Recognition · Computer Science 2026-01-06 Shayan Nejadshamsi , Yuanyuan Zhang , Shadi Zaki , Brock Porth , Lysa Porth , Vahab Khoshdel

Large Foundation Models (LFMs) have demonstrated significant advantages in civil engineering, but they primarily focus on textual and visual data, overlooking the rich semantic, spatial, and topological features in BIM (Building Information…

Machine Learning · Computer Science 2025-09-30 Jin Han , Xin-Zheng Lu , Jia-Rui Lin

Spatial intelligence, encompassing 3D reconstruction, perception, and reasoning, is fundamental to applications such as robotics, aerial imaging, and extended reality. A key enabler is the real-time, accurate estimation of core 3D…

Computer Vision and Pattern Recognition · Computer Science 2025-07-11 Wenyan Cong , Yiqing Liang , Yancheng Zhang , Ziyi Yang , Yan Wang , Boris Ivanovic , Marco Pavone , Chen Chen , Zhangyang Wang , Zhiwen Fan

The value of Earth observation foundation models for high-impact ecological applications remains insufficiently characterized. This study is one of the first to systematically evaluate the performance, limitations and practical…

Computer Vision and Pattern Recognition · Computer Science 2026-02-25 Craig Mahlasi , Gciniwe S. Baloyi , Zaheed Gaffoor , Levente Klein , Anne Jones , Etienne Vos , Michal Muszynski , Geoffrey Dawson , Campbell Watson

Recent advancements in foundation models have significantly impacted various fields, including natural language processing, computer vision, and multi-modal tasks. One area that stands to benefit greatly is Earth observation, where these…

Computer Vision and Pattern Recognition · Computer Science 2024-10-21 Yohei Nakayama , Jiawei Su , Luis M. Pazos-Outón

We explore adapting foundation models (FMs) from the computer vision domain to geoscience. FMs, large neural networks trained on massive datasets, excel in diverse tasks with remarkable adaptability and generality. However, geoscience faces…

Computer Vision and Pattern Recognition · Computer Science 2024-08-23 Zhixiang Guo , Xinming Wu , Luming Liang , Hanlin Sheng , Nuo Chen , Zhengfa Bi

This paper presents Prithvi-EO-2.0, a new geospatial foundation model that offers significant improvements over its predecessor, Prithvi-EO-1.0. Trained on 4.2 million global time series samples from NASA's Harmonized Landsat and Sentinel-2…

Foundation models have made rapid advances in many domains including Earth observation, where Geospatial Foundation Models (GFMs) can help address global challenges such as climate change, agriculture, and disaster response. Previous work…

Machine Learning · Computer Science 2025-01-23 Mirali Purohit , Gedeon Muhawenayo , Esther Rolf , Hannah Kerner

Global climate models parameterize a range of atmospheric-oceanic processes like gravity waves, clouds, moist convection, and turbulence that cannot be sufficiently resolved. These subgrid-scale closures for unresolved processes are a…

Atmospheric and Oceanic Physics · Physics 2025-09-05 Aman Gupta , Aditi Sheshadri , Sujit Roy , Johannes Schmude , Vishal Gaur , Wei Ji Leong , Manil Maskey , Rahul Ramachandran

Multimodal foundation models (MFMs), such as GPT-4o, have recently made remarkable progress. However, their detailed visual understanding beyond question answering remains unclear. In this paper, we benchmark popular MFMs (GPT-4o, o4-mini,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-04 Rahul Ramachandran , Ali Garjani , Roman Bachmann , Andrei Atanov , Oğuzhan Fatih Kar , Amir Zamir

Structured data is widely used in domains such as healthcare, finance, and scientific data management. Recent studies on structured data foundation models (SFMs) aim to support data analysis and mining tasks over such data, but still face…

Machine Learning · Computer Science 2026-05-21 Zhenghang Song , Tang Qian , Lu Chen , Yushuai Li , Zhengke Hu , Bingbing Fang , Yumeng Song , Junbo Zhao , Sheng Zhang , Tianyi Li

High-quality labeled geospatial datasets are essential for extracting insights and understanding our planet. Unfortunately, these datasets often do not span the entire globe and are limited to certain geographic regions where data was…

Foundation Models (FMs) serve as a general class for the development of artificial intelligence systems, offering broad potential for generalization across a spectrum of downstream tasks. Despite extensive research into self-supervised…

Machine Learning · Computer Science 2024-06-17 Yuhao Xu , Xinqi Liu , Keyu Duan , Yi Fang , Yu-Neng Chuang , Daochen Zha , Qiaoyu Tan

We present our work on developing and training scalable, trustworthy, and energy-efficient predictive graph foundation models (GFMs) using HydraGNN, a multi-headed graph convolutional neural network architecture. HydraGNN expands the…

Comprehensive evaluation of geospatial foundation models (Geo-FMs) requires benchmarking across diverse tasks, sensors, and geographic regions. However, most existing benchmark datasets are limited to segmentation or classification tasks,…

Computer Vision and Pattern Recognition · Computer Science 2025-06-16 Aaron Banze , Timothée Stassin , Nassim Ait Ali Braham , Rıdvan Salih Kuzu , Simon Besnard , Michael Schmitt

Foundation models leverage large-scale pretraining to capture extensive knowledge, demonstrating generalization in a wide range of language tasks. By comparison, vision foundation models (VFMs) often exhibit uneven improvements across…

Computer Vision and Pattern Recognition · Computer Science 2026-01-23 Shiqi Huang , Yipei Wang , Natasha Thorley , Alexander Ng , Shaheer Saeed , Mark Emberton , Shonit Punwani , Veeru Kasivisvanathan , Dean Barratt , Daniel Alexander , Yipeng Hu