English
Related papers

Related papers: GeoGrid-Bench: Can Foundation Models Understand Mu…

200 papers

The advent of Unified Multimodal Models (UMMs) signals a paradigm shift in artificial intelligence, moving from passive perception to active, cross-modal generation. Despite their unprecedented ability to synthesize information, a critical…

Artificial Intelligence · Computer Science 2026-01-15 Jingxuan Wei , Caijun Jia , Xi Bai , Xinglong Xu , Siyuan Li , Linzhuang Sun , Bihui Yu , Conghui He , Lijun Wu , Cheng Tan

The rapid growth of spatiotemporal data volumes needs to be handled by database systems capable of efficiently managing and querying such data. Existing systems such as PostGIS, SpaceTime, and MobilityDB offer partial solutions but differ…

Databases · Computer Science 2026-05-01 Tim C. Rese , Nils Japke , Diana Baumann , Natalie Carl , David Bermbach

Driven by the transition towards a climate-neutral energy system, accurate energy time series forecasting is critical for planning and operation. Yet, it remains largely a dataset-specific task, requiring comprehensive training data,…

Machine Learning · Computer Science 2026-04-27 Marco Obermeier , Marco Pruckner , Florian Haselbeck , Andreas Zeiselmair

Worldwide geo-localization involves determining the exact geographic location of images captured globally, typically guided by geographic cues such as climate, landmarks, and architectural styles. Despite advancements in geo-localization…

Computer Vision and Pattern Recognition · Computer Science 2025-09-08 Furong Jia , Lanxin Liu , Ce Hou , Fan Zhang , Xinyan Liu , Yu Liu

Recent progress in self-supervision shows that pre-training large neural networks on vast amounts of unsupervised data can lead to impressive increases in generalisation for downstream tasks. Such models, recently coined as foundation…

Recent research in geospatial machine learning has demonstrated that models pretrained with self-supervised learning on Earth observation data can perform well on downstream tasks with limited training data. However, most of the existing…

Computer Vision and Pattern Recognition · Computer Science 2026-02-09 Lucia Gordon , Serge Belongie , Christian Igel , Nico Lang

We explore adapting foundation models (FMs) from the computer vision domain to geoscience. FMs, large neural networks trained on massive datasets, excel in diverse tasks with remarkable adaptability and generality. However, geoscience faces…

Computer Vision and Pattern Recognition · Computer Science 2024-08-23 Zhixiang Guo , Xinming Wu , Luming Liang , Hanlin Sheng , Nuo Chen , Zhengfa Bi

Large-scale foundation models in Earth Observation can learn versatile, label-efficient representations by leveraging massive amounts of unlabeled data. However, existing public datasets are often limited in scale, geographic coverage, or…

Understanding environmental ecosystems is vital for the sustainable management of our planet. However,existing physics-based and data-driven models often fail to generalize to varying spatial regions and scales due to the inherent data…

Machine Learning · Computer Science 2025-10-13 Shiyuan Luo , Runlong Yu , Shengyu Chen , Yingda Fan , Yiqun Xie , Yanhua Li , Xiaowei Jia

The availability of temporal geospatial data in multiple modalities has been extensively leveraged to enhance the performance of machine learning models. While efforts on the design of adequate model architectures are approaching a level of…

Machine Learning · Computer Science 2024-08-22 Hiba Najjar , Marlon Nuske , Andreas Dengel

This paper introduces MISS-QA, the first benchmark specifically designed to evaluate the ability of models to interpret schematic diagrams within scientific literature. MISS-QA comprises 1,500 expert-annotated examples over 465 scientific…

Computation and Language · Computer Science 2025-07-16 Yilun Zhao , Chengye Wang , Chuhan Li , Arman Cohan

While numerous recent benchmarks focus on evaluating generic Vision-Language Models (VLMs), they do not effectively address the specific challenges of geospatial applications. Generic VLM benchmarks are not designed to handle the…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Muhammad Sohail Danish , Muhammad Akhtar Munir , Syed Roshaan Ali Shah , Kartik Kuckreja , Fahad Shahbaz Khan , Paolo Fraccaro , Alexandre Lacoste , Salman Khan

To tackle the global climate challenge, it urgently needs to develop a collaborative platform for comprehensive weather forecasting on large-scale meteorological data. Despite urgency, heterogeneous meteorological sensors across countries…

Machine Learning · Computer Science 2023-05-30 Shengchao Chen , Guodong Long , Tao Shen , Jing Jiang

Benchmarking 3D spatial understanding of foundation models is essential for real-world applications such as robotics and autonomous driving. Existing evaluations often rely on downstream fine-tuning with linear heads or task-specific…

Computer Vision and Pattern Recognition · Computer Science 2026-01-19 Valentina Lilova , Toyesh Chakravorty , Julian I. Bibo , Emma Boccaletti , Brandon Li , Lívia Baxová , Cees G. M. Snoek , Mohammadreza Salehi

Earth observation foundation models have shown strong generalization across multiple Earth observation tasks, but their robustness under real-world perturbations remains underexplored. To bridge this gap, we introduce REOBench, the first…

Computer Vision and Pattern Recognition · Computer Science 2025-10-24 Xiang Li , Yong Tao , Siyuan Zhang , Siwei Liu , Zhitong Xiong , Chunbo Luo , Lu Liu , Mykola Pechenizkiy , Xiao Xiang Zhu , Tianjin Huang

Seismic geobody interpretation is crucial for structural geology studies and various engineering applications. Existing deep learning methods show promise but lack support for multi-modal inputs and struggle to generalize to different…

Geophysics · Physics 2024-09-17 Hang Gao , Xinming Wu , Luming Liang , Hanlin Sheng , Xu Si , Gao Hui , Yaxing Li

Large-scale pretraining on Earth observation imagery has yielded powerful representations of the natural and built environment. However, most existing geospatial foundation models do not directly model the structured socioeconomic…

Machine Learning · Computer Science 2026-05-15 Yuhao Liu , Sadeer Al-Kindi , Ashok Veeraraghavan , Guha Balakrishnan

Data-driven approaches, most prominently deep learning, have become powerful tools for prediction in many domains. A natural question to ask is whether data-driven methods could also be used to predict global weather patterns days in…

Atmospheric and Oceanic Physics · Physics 2020-12-30 Stephan Rasp , Peter D. Dueben , Sebastian Scher , Jonathan A. Weyn , Soukayna Mouatadid , Nils Thuerey

This article introduces a benchmark designed to evaluate the capabilities of multimodal models in analyzing and interpreting images. The benchmark focuses on seven key visual aspects: main object, additional objects, background, detail,…

Computer Vision and Pattern Recognition · Computer Science 2025-01-15 Evgenii Evstafev

Multimodal large language models (MLLMs) have made significant progress in integrating visual and linguistic understanding. Existing benchmarks typically focus on high-level semantic capabilities, such as scene understanding and visual…

Computation and Language · Computer Science 2025-02-18 Shangyu Xing , Changhao Xiang , Yuteng Han , Yifan Yue , Zhen Wu , Xinyu Liu , Zhangtai Wu , Fei Zhao , Xinyu Dai