English
Related papers

Related papers: Evaluating and Benchmarking Foundation Models for …

200 papers

Recent advances in self-supervised learning and neural network scaling have enabled the creation of large models, known as foundation models, which can be easily adapted to a wide range of downstream tasks. The current paradigm for…

Machine Learning · Computer Science 2024-01-09 Brandon Duderstadt , Hayden S. Helm , Carey E. Priebe

Small Earth data are geoscience observations with limited short-term monitoring variability, providing sparse but meaningful measurements, typically exhibiting spatiotemporal correlations. Spatiotemporal forecasting on such data is crucial…

Machine Learning · Computer Science 2025-10-13 Yuting Yang , Gang Mei , Zhengjing Ma , Nengxiong Xu , Jianbing Peng

Great labels make great models. However, traditional labeling approaches for tasks like object detection have substantial costs at scale. Furthermore, alternatives to fully-supervised object detection either lose functionality or require…

Computer Vision and Pattern Recognition · Computer Science 2025-06-04 Brent A. Griffin , Manushree Gangwar , Jacob Sela , Jason J. Corso

Recent advances in machine learning have been supported by the emergence of domain-specific software libraries, enabling streamlined workflows and increased reproducibility. For geospatial machine learning (GeoML), the availability of Earth…

Machine Learning · Computer Science 2025-11-19 Adam J. Stewart , Caleb Robinson , Arindam Banerjee

We present GLEE in this work, an object-level foundation model for locating and identifying objects in images and videos. Through a unified framework, GLEE accomplishes detection, segmentation, tracking, grounding, and identification of…

Computer Vision and Pattern Recognition · Computer Science 2023-12-15 Junfeng Wu , Yi Jiang , Qihao Liu , Zehuan Yuan , Xiang Bai , Song Bai

To improve the trustworthiness of an AI model, finding consistent, understandable representations of its inference process is essential. This understanding is particularly important in high-stakes operations such as weather forecasting,…

Artificial Intelligence · Computer Science 2025-04-02 Soyeon Kim , Junho Choi , Subeen Lee , Jaesik Choi

Foundation models pretrained on diverse data at scale have demonstrated extraordinary capabilities in a wide range of vision and language tasks. When such models are deployed in real world environments, they inevitably interface with other…

Artificial Intelligence · Computer Science 2023-03-08 Sherry Yang , Ofir Nachum , Yilun Du , Jason Wei , Pieter Abbeel , Dale Schuurmans

Geoscience intelligence is expected to understand, reason about, and predict earth system changes to support human decision-making in critical domains such as disaster response, climate adaptation and environmental protection. Although…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Yushuo Zheng , Zicheng Zhang , Huiyu Duan , Chunyi Li , Zijian Chen , Ziheng Jia , Yue Shi , Ke Gu , Xiongkuo Min , Guangtao Zhai

We address the problem of learning observation models end-to-end for estimation. Robots operating in partially observable environments must infer latent states from multiple sensory inputs using observation models that capture the joint…

Robotics · Computer Science 2022-04-12 Paloma Sodhi , Eric Dexheimer , Mustafa Mukadam , Stuart Anderson , Michael Kaess

Computer models are indispensable tools for understanding the Earth system. While high-resolution operational models have achieved many successes, they exhibit persistent biases, particularly in simulating extreme events and statistical…

Machine Learning · Computer Science 2025-10-16 Pouria Behnoudfar , Charlotte Moser , Marc Bocquet , Sibo Cheng , Nan Chen

Advances in foundation modeling have reshaped computational pathology. However, the increasing number of available models and lack of standardized benchmarks make it increasingly complex to assess their strengths, limitations, and potential…

Computer Vision and Pattern Recognition · Computer Science 2025-02-11 Andrew Zhang , Guillaume Jaume , Anurag Vaidya , Tong Ding , Faisal Mahmood

Knowledge of search-landscape features of BlackBox Optimization (BBO) problems offers valuable information in light of the Algorithm Selection and/or Configuration problems. Exploratory Landscape Analysis (ELA) models have gained success in…

Artificial Intelligence · Computer Science 2022-06-29 Boris Yazmir , Ofer M. Shir

Quantitative remote sensing inversion aims to estimate continuous surface variables-such as biomass, vegetation indices, and evapotranspiration-from satellite observations, supporting applications in ecosystem monitoring, carbon accounting,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-15 Zhenyu Yu , Mohd Yamani Idna Idris , Hua Wang , Pei Wang , Junyi Chen , Kun Wang

Earth Observation (EO) systems are crucial for cartography, disaster surveillance, and resource administration. Nonetheless, they encounter considerable obstacles in the processing and transmission of extensive data, especially in…

We propose a novel convolutional neural network architecture for estimating geospatial functions such as population density, land cover, or land use. In our approach, we combine overhead and ground-level images in an end-to-end trainable…

Computer Vision and Pattern Recognition · Computer Science 2017-08-11 Scott Workman , Menghua Zhai , David J. Crandall , Nathan Jacobs

Geospatial technologies are becoming increasingly essential in our world for a wide range of applications, including agriculture, urban planning, and disaster response. To help improve the applicability and performance of deep learning…

Computer Vision and Pattern Recognition · Computer Science 2023-09-04 Matias Mendieta , Boran Han , Xingjian Shi , Yi Zhu , Chen Chen

Earth system predictability is challenged by the complexity of environmental dynamics and the multitude of variables involved. Current AI foundation models, although advanced by leveraging large and heterogeneous data, are often constrained…

Atmospheric and Oceanic Physics · Physics 2024-08-20 Xiao Wang , Siyan Liu , Aristeidis Tsaris , Jong-Youl Choi , Ashwin Aji , Ming Fan , Wei Zhang , Junqi Yin , Moetasim Ashfaq , Dan Lu , Prasanna Balaprakash

State-of-the-art generative image and video models rely heavily on tokenizers that compress high-dimensional inputs into more efficient latent representations. While this paradigm has revolutionized RGB generation, Earth observation (EO)…

Computer Vision and Pattern Recognition · Computer Science 2026-03-04 Nils Lehmann , Yi Wang , Zhitong Xiong , Xiaoxiang Zhu

The increasing accessibility of remotely sensed data and their potential to support large-scale decision-making have driven the development of deep learning models for many Earth Observation tasks. Traditionally, such models rely on large…

Time series forecasting drives operational decisions in areas like finance, transportation, and energy. While supervised learning approaches achieve strong performance, they require domain-specific training, feature engineering, and ongoing…

Machine Learning · Computer Science 2026-05-26 Kavin Soni , Debanshu Das , Vamshi Guduguntla