English
Related papers

Related papers: Foundation Models for Generalist Geospatial Artifi…

200 papers

We survey applications of pretrained foundation models in robotics. Traditional deep learning models in robotics are trained on small datasets tailored for specific tasks, which limits their adaptability across diverse applications. In…

High-quality labeled geospatial datasets are essential for extracting insights and understanding our planet. Unfortunately, these datasets often do not span the entire globe and are limited to certain geographic regions where data was…

The increasing availability of geospatial foundation models has the potential to transform remote sensing applications such as land cover classification, environmental monitoring, and change detection. Despite promising benchmark results,…

Data-driven artificial intelligence (AI) models have made significant advancements in weather forecasting, particularly in medium-range and nowcasting. However, most data-driven weather forecasting models are black-box systems that focus on…

Machine Learning · Computer Science 2025-01-14 Wanghan Xu , Fenghua Ling , Wenlong Zhang , Tao Han , Hao Chen , Wanli Ouyang , Lei Bai

Foundation models can be disruptive for future AI development by scaling up deep learning in terms of model size and training data's breadth and size. These models achieve state-of-the-art performance (often through further adaptation) on a…

Artificial Intelligence · Computer Science 2022-12-20 Johannes Schneider

The pre-training and fine-tuning paradigm has revolutionized satellite remote sensing applications. However, this approach remains largely underexplored for airborne laser scanning (ALS), an important technology for applications such as…

Computer Vision and Pattern Recognition · Computer Science 2025-01-10 Haoyi Xiu , Xin Liu , Taehoon Kim , Kyoung-Sook Kim

Geometric machine learning models such as graph neural networks have achieved remarkable success in recent years in chemical and materials science research for applications such as high-throughput virtual screening and atomistic…

Materials Science · Physics 2025-04-16 Lingyu Kong , Nima Shoghi , Guoxiang Hu , Pan Li , Victor Fung

Foundation models refer to artificial intelligence (AI) models that are trained on massive amounts of data and demonstrate broad generalizability across various tasks with high accuracy. These models offer versatile, one-for-many or…

Image and Video Processing · Electrical Eng. & Systems 2024-11-06 Rina Bao , Erfan Darzi , Sheng He , Chuan-Heng Hsiao , Mohammad Arafat Hussain , Jingpeng Li , Atle Bjornerud , Ellen Grant , Yangming Ou

Large pre-trained models, or foundation models, have shown impressive performance when adapted to a variety of downstream tasks, often out-performing specialized models. Hypernetworks, neural networks that generate some or all of the…

Machine Learning · Computer Science 2025-03-04 Jeffrey Gu , Serena Yeung-Levy

Recent research in geospatial machine learning has demonstrated that models pretrained with self-supervised learning on Earth observation data can perform well on downstream tasks with limited training data. However, most of the existing…

Computer Vision and Pattern Recognition · Computer Science 2026-02-09 Lucia Gordon , Serge Belongie , Christian Igel , Nico Lang

Foundation models are predominantly trained in an unsupervised or self-supervised manner on highly diverse and large-scale datasets, making them broadly applicable to various downstream tasks. In this work, we investigate for the first time…

Computer Vision and Pattern Recognition · Computer Science 2025-02-10 Tahar Chettaoui , Naser Damer , Fadi Boutros

The rise of large language models (LLMs), such as ChatGPT, Gemini, and Grok, has reshaped the AI landscape. As prominent instances of foundational models (FMs), they exhibit remarkable capabilities in generating human-like content, pushing…

Artificial Intelligence · Computer Science 2026-05-19 Yu Qiao , Huy Q. Le , Avi Deb Raha , Phuong-Nam Tran , Apurba Adhikary , Mengchun Zhang , Loc X. Nguyen , Eui-Nam Huh , Dusit Niyato , Choong Seon Hong

Foundation models have demonstrated a great ability to achieve general human-level intelligence far beyond traditional approaches. As the technique keeps attracting attention from the AI community, an increasing number of foundation models…

Computation and Language · Computer Science 2024-05-07 Shizhe Diao , Rui Pan , Hanze Dong , Ka Shun Shum , Jipeng Zhang , Wei Xiong , Tong Zhang

Recent advances in AI weather forecasting have led to the emergence of so-called "foundation models", typically defined by expensive pretraining and minimal fine-tuning for downstream tasks. However, in the natural sciences, a desirable…

Machine Learning · Computer Science 2025-06-25 Fanny Lehmann , Firat Ozdemir , Benedikt Soja , Torsten Hoefler , Siddhartha Mishra , Sebastian Schemm

Existing deep learning methods for remote sensing image fusion often suffer from poor generalization when applied to unseen datasets due to the limited availability of real training data and the domain gap between different satellite…

Computer Vision and Pattern Recognition · Computer Science 2025-12-03 Yongchuan Cui , Peng Liu , Yi Zeng

Geospatial Foundation Models (GeoFMs) are transforming Earth Observation (EO), but evaluation lacks standardized protocols. GEO-Bench-2 addresses this with a comprehensive framework spanning classification, segmentation, regression, object…

Foundation models have advanced machine learning across various modalities, including images. Recently multiple teams trained foundation models specialized for remote sensing applications. This line of research is motivated by the distinct…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Ani Vanyan , Alvard Barseghyan , Hakob Tamazyan , Tigran Galstyan , Vahan Huroyan , Naira Hovakimyan , Hrant Khachatrian

Foundation models are transformative in artificial intelligence, but building them from scratch, especially for mobility trajectories, is not yet clear or documented. This tutorial bridges this gap by demonstrating the steps and code of a…

Artificial Intelligence · Computer Science 2025-11-26 Gaspard Merten , Mahmoud Sakr , Gilles Dejaegere

Foundation models (FMs) are a popular topic of research in AI. Their ability to generalize to new tasks and datasets without retraining or needing an abundance of data makes them an appealing candidate for applications on specialist…

Computer Vision and Pattern Recognition · Computer Science 2024-09-06 Marga Don , Stijn Pinson , Blanca Guillen Cebrian , Yuki M. Asano

As the potential of foundation models in visual tasks has garnered significant attention, pretraining these models before downstream tasks has become a crucial step. The three key factors in pretraining foundation models are the pretraining…

Computer Vision and Pattern Recognition · Computer Science 2024-08-13 Keumgang Cha , Junghoon Seo , Taekyung Lee