中文
相关论文

相关论文: Evaluating and Benchmarking Foundation Models for …

200 篇论文

Earth observation (EO) data such as satellite imagery can have far-reaching impacts on our understanding of the geography of poverty, especially when coupled with machine learning (ML) and computer vision. Early research used computer…

机器学习 · 计算机科学 2025-04-23 Kazuki Sakamoto , Connor T. Jerzak , Adel Daoud

Foundation models, i.e., very large deep learning models, have demonstrated impressive performances in various language and vision tasks that are otherwise difficult to reach using smaller-size models. The major success of GPT-type of…

计算机视觉与模式识别 · 计算机科学 2024-04-19 Yiqun Xie , Zhihao Wang , Weiye Chen , Zhili Li , Xiaowei Jia , Yanhua Li , Ruichen Wang , Kangyang Chai , Ruohan Li , Sergii Skakun

We present GeoGrid-Bench, a benchmark designed to evaluate the ability of foundation models to understand geo-spatial data in the grid structure. Geo-spatial datasets pose distinct challenges due to their dense numerical values, strong…

Earth observation (EO) applications involving complex and heterogeneous data sources are commonly approached with machine learning models. However, there is a common assumption that data sources will be persistently available. Different…

机器学习 · 计算机科学 2024-10-15 Francisco Mena , Diego Arenas , Marcela Charfuelan , Marlon Nuske , Andreas Dengel

Artificial General Intelligence (AGI) is closer than ever to becoming a reality, sparking widespread enthusiasm in the research community to collect and work with various modalities, including text, image, video, and audio. Despite recent…

计算机视觉与模式识别 · 计算机科学 2025-08-11 Mojtaba Valipour , Kelly Zheng , James Lowman , Spencer Szabados , Mike Gartner , Bobby Braswell

Multi-modal co-learning is emerging as an effective paradigm in machine learning, enabling models to collaboratively learn from different modalities to enhance single-modality predictions. Earth Observation (EO) represents a quintessential…

计算机视觉与模式识别 · 计算机科学 2025-11-20 Francisco Mena , Dino Ienco , Cassio F. Dantas , Roberto Interdonato , Andreas Dengel

Earth Observation (EO) data analysis has been significantly revolutionized by deep learning (DL), with applications typically limited to grid-like data structures. Graph Neural Networks (GNNs) emerge as an important innovation, propelling…

机器学习 · 计算机科学 2024-11-07 Shan Zhao , Zhaiyu Chen , Zhitong Xiong , Yilei Shi , Sudipan Saha , Xiao Xiang Zhu

Food security remains a global concern as population grows and climate change intensifies, demanding innovative solutions for sustainable agricultural productivity. Recent advances in foundation models have demonstrated remarkable…

计算机视觉与模式识别 · 计算机科学 2025-07-29 Vishal Nedungadi , Xingguo Xiong , Aike Potze , Ron Van Bree , Tao Lin , Marc Rußwurm , Ioannis N. Athanasiadis

We introduce EarthPT -- an Earth Observation (EO) pretrained transformer. EarthPT is a 700 million parameter decoding transformer foundation model trained in an autoregressive self-supervised manner and developed specifically with EO…

机器学习 · 计算机科学 2024-01-12 Michael J. Smith , Luke Fleming , James E. Geach

Modeling environmental ecosystems is essential for effective resource management, sustainable development, and understanding complex ecological processes. However, traditional data-driven methods face challenges in capturing inherently…

机器学习 · 计算机科学 2025-04-08 Runlong Yu , Shengyu Chen , Yiqun Xie , Huaxiu Yao , Jared Willard , Xiaowei Jia

Large Vision-Language Models (VLMs) have demonstrated impressive performance on complex tasks involving visual input with natural language instructions. However, it remains unclear to what extent capabilities on natural images transfer to…

计算与语言 · 计算机科学 2024-02-01 Chenhui Zhang , Sherrie Wang

Artificial Intelligence (AI) technologies have profoundly transformed the field of remote sensing, revolutionizing data collection, processing, and analysis. Traditionally reliant on manual interpretation and task-specific models, remote…

计算机视觉与模式识别 · 计算机科学 2025-02-13 Siqi Lu , Junlin Guo , James R Zimmer-Dauphinee , Jordan M Nieusma , Xiao Wang , Parker VanValkenburgh , Steven A Wernke , Yuankai Huo

Multimodal large language models (MLLMs) have altered the landscape of computer vision, obtaining impressive results across a wide range of tasks, especially in zero-shot settings. Unfortunately, their strong performance does not always…

计算机视觉与模式识别 · 计算机科学 2025-04-16 Darryl Hannan , John Cooper , Dylan White , Timothy Doster , Henry Kvinge , Yijing Watkins

Deep learning models are increasingly data-hungry, requiring significant resources to collect and compile the datasets needed to train them, with Earth Observation (EO) models being no exception. However, the landscape of datasets in EO is…

计算机视觉与模式识别 · 计算机科学 2024-06-24 Alistair Francis , Mikolaj Czerkawski

Recent developments and research in modern machine learning have led to substantial improvements in the geospatial field. Although numerous deep learning architectures and models have been proposed, the majority of them have been solely…

Land cover classification and change detection are two important applications of remote sensing and Earth observation (EO) that have benefited greatly from the advances of deep learning. Convolutional and transformer-based U-net models are…

计算机视觉与模式识别 · 计算机科学 2024-04-15 Martin Willbo , Aleksis Pirinen , John Martinsson , Edvin Listo Zec , Olof Mogren , Mikael Nilsson

Label noise poses a significant challenge in Earth Observation (EO), often degrading the performance and reliability of supervised Machine Learning (ML) models. Yet, given the critical nature of several EO applications, developing robust…

Benchmark experiments are required to test, compare, tune, and understand optimization algorithms. Ideally, benchmark problems closely reflect real-world problem behavior. Yet, real-world problems are not always readily available for…

神经与进化计算 · 计算机科学 2020-08-17 Martin Zaefferer , Frederik Rehbach

Landslides cause severe damage to lives, infrastructure, and the environment, making accurate and timely mapping essential for disaster preparedness and response. However, conventional deep learning models often struggle when applied across…

计算机视觉与模式识别 · 计算机科学 2025-11-07 Wenwen Li , Sizhe Wang , Hyunho Lee , Chenyan Lu , Sujit Roy , Rahul Ramachandran , Chia-Yu Hsu

Geospatial Foundation Models (GFMs) have emerged as powerful tools for extracting representations from Earth observation data, but their evaluation remains inconsistent and narrow. Existing works often evaluate on suboptimal downstream…