English
Related papers

Related papers: Evaluating and Benchmarking Foundation Models for …

200 papers

Earth observation (EO) data such as satellite imagery can have far-reaching impacts on our understanding of the geography of poverty, especially when coupled with machine learning (ML) and computer vision. Early research used computer…

Machine Learning · Computer Science 2025-04-23 Kazuki Sakamoto , Connor T. Jerzak , Adel Daoud

Foundation models, i.e., very large deep learning models, have demonstrated impressive performances in various language and vision tasks that are otherwise difficult to reach using smaller-size models. The major success of GPT-type of…

Computer Vision and Pattern Recognition · Computer Science 2024-04-19 Yiqun Xie , Zhihao Wang , Weiye Chen , Zhili Li , Xiaowei Jia , Yanhua Li , Ruichen Wang , Kangyang Chai , Ruohan Li , Sergii Skakun

We present GeoGrid-Bench, a benchmark designed to evaluate the ability of foundation models to understand geo-spatial data in the grid structure. Geo-spatial datasets pose distinct challenges due to their dense numerical values, strong…

Computation and Language · Computer Science 2025-05-27 Bowen Jiang , Yangxinyu Xie , Xiaomeng Wang , Jiashu He , Joshua Bergerson , John K Hutchison , Jordan Branham , Camillo J Taylor , Tanwi Mallick

Earth observation (EO) applications involving complex and heterogeneous data sources are commonly approached with machine learning models. However, there is a common assumption that data sources will be persistently available. Different…

Machine Learning · Computer Science 2024-10-15 Francisco Mena , Diego Arenas , Marcela Charfuelan , Marlon Nuske , Andreas Dengel

Artificial General Intelligence (AGI) is closer than ever to becoming a reality, sparking widespread enthusiasm in the research community to collect and work with various modalities, including text, image, video, and audio. Despite recent…

Computer Vision and Pattern Recognition · Computer Science 2025-08-11 Mojtaba Valipour , Kelly Zheng , James Lowman , Spencer Szabados , Mike Gartner , Bobby Braswell

Multi-modal co-learning is emerging as an effective paradigm in machine learning, enabling models to collaboratively learn from different modalities to enhance single-modality predictions. Earth Observation (EO) represents a quintessential…

Computer Vision and Pattern Recognition · Computer Science 2025-11-20 Francisco Mena , Dino Ienco , Cassio F. Dantas , Roberto Interdonato , Andreas Dengel

Earth Observation (EO) data analysis has been significantly revolutionized by deep learning (DL), with applications typically limited to grid-like data structures. Graph Neural Networks (GNNs) emerge as an important innovation, propelling…

Machine Learning · Computer Science 2024-11-07 Shan Zhao , Zhaiyu Chen , Zhitong Xiong , Yilei Shi , Sudipan Saha , Xiao Xiang Zhu

Food security remains a global concern as population grows and climate change intensifies, demanding innovative solutions for sustainable agricultural productivity. Recent advances in foundation models have demonstrated remarkable…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Vishal Nedungadi , Xingguo Xiong , Aike Potze , Ron Van Bree , Tao Lin , Marc Rußwurm , Ioannis N. Athanasiadis

We introduce EarthPT -- an Earth Observation (EO) pretrained transformer. EarthPT is a 700 million parameter decoding transformer foundation model trained in an autoregressive self-supervised manner and developed specifically with EO…

Machine Learning · Computer Science 2024-01-12 Michael J. Smith , Luke Fleming , James E. Geach

Modeling environmental ecosystems is essential for effective resource management, sustainable development, and understanding complex ecological processes. However, traditional data-driven methods face challenges in capturing inherently…

Machine Learning · Computer Science 2025-04-08 Runlong Yu , Shengyu Chen , Yiqun Xie , Huaxiu Yao , Jared Willard , Xiaowei Jia

Large Vision-Language Models (VLMs) have demonstrated impressive performance on complex tasks involving visual input with natural language instructions. However, it remains unclear to what extent capabilities on natural images transfer to…

Computation and Language · Computer Science 2024-02-01 Chenhui Zhang , Sherrie Wang

Artificial Intelligence (AI) technologies have profoundly transformed the field of remote sensing, revolutionizing data collection, processing, and analysis. Traditionally reliant on manual interpretation and task-specific models, remote…

Computer Vision and Pattern Recognition · Computer Science 2025-02-13 Siqi Lu , Junlin Guo , James R Zimmer-Dauphinee , Jordan M Nieusma , Xiao Wang , Parker VanValkenburgh , Steven A Wernke , Yuankai Huo

Multimodal large language models (MLLMs) have altered the landscape of computer vision, obtaining impressive results across a wide range of tasks, especially in zero-shot settings. Unfortunately, their strong performance does not always…

Computer Vision and Pattern Recognition · Computer Science 2025-04-16 Darryl Hannan , John Cooper , Dylan White , Timothy Doster , Henry Kvinge , Yijing Watkins

Deep learning models are increasingly data-hungry, requiring significant resources to collect and compile the datasets needed to train them, with Earth Observation (EO) models being no exception. However, the landscape of datasets in EO is…

Computer Vision and Pattern Recognition · Computer Science 2024-06-24 Alistair Francis , Mikolaj Czerkawski

Recent developments and research in modern machine learning have led to substantial improvements in the geospatial field. Although numerous deep learning architectures and models have been proposed, the majority of them have been solely…

Land cover classification and change detection are two important applications of remote sensing and Earth observation (EO) that have benefited greatly from the advances of deep learning. Convolutional and transformer-based U-net models are…

Computer Vision and Pattern Recognition · Computer Science 2024-04-15 Martin Willbo , Aleksis Pirinen , John Martinsson , Edvin Listo Zec , Olof Mogren , Mikael Nilsson

Label noise poses a significant challenge in Earth Observation (EO), often degrading the performance and reliability of supervised Machine Learning (ML) models. Yet, given the critical nature of several EO applications, developing robust…

Benchmark experiments are required to test, compare, tune, and understand optimization algorithms. Ideally, benchmark problems closely reflect real-world problem behavior. Yet, real-world problems are not always readily available for…

Neural and Evolutionary Computing · Computer Science 2020-08-17 Martin Zaefferer , Frederik Rehbach

Landslides cause severe damage to lives, infrastructure, and the environment, making accurate and timely mapping essential for disaster preparedness and response. However, conventional deep learning models often struggle when applied across…

Computer Vision and Pattern Recognition · Computer Science 2025-11-07 Wenwen Li , Sizhe Wang , Hyunho Lee , Chenyan Lu , Sujit Roy , Rahul Ramachandran , Chia-Yu Hsu

Geospatial Foundation Models (GFMs) have emerged as powerful tools for extracting representations from Earth observation data, but their evaluation remains inconsistent and narrow. Existing works often evaluate on suboptimal downstream…