English
Related papers

Related papers: Cryo-Bench: Benchmarking Foundation Models for Cry…

200 papers

Massive amounts of unlabelled data are captured by Earth Observation (EO) satellites, with the Sentinel-2 constellation generating 1.6 TB of data daily. This makes Remote Sensing a data-rich domain well suited to Machine Learning (ML)…

Computer Vision and Pattern Recognition · Computer Science 2024-01-17 Casper Fibaek , Luke Camilleri , Andreas Luyts , Nikolaos Dionelis , Bertrand Le Saux

Foundation models characterized by extensive parameters and trained on large-scale datasets have demonstrated remarkable efficacy across various downstream tasks for remote sensing data. Current remote sensing foundation models typically…

Computer Vision and Pattern Recognition · Computer Science 2024-05-29 Zhitong Xiong , Yi Wang , Fahong Zhang , Xiao Xiang Zhu

This paper demonstrates the potential of vibration-based Foundation Models (FMs), pre-trained with unlabeled sensing data, to improve the robustness of run-time inference in (a class of) IoT applications. A case study is presented featuring…

While numerous recent benchmarks focus on evaluating generic Vision-Language Models (VLMs), they do not effectively address the specific challenges of geospatial applications. Generic VLM benchmarks are not designed to handle the…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Muhammad Sohail Danish , Muhammad Akhtar Munir , Syed Roshaan Ali Shah , Kartik Kuckreja , Fahad Shahbaz Khan , Paolo Fraccaro , Alexandre Lacoste , Salman Khan

Pixel grounding, encompassing tasks such as Referring Expression Segmentation (RES), has garnered considerable attention due to its immense potential for bridging the gap between vision and language modalities. However, advancements in this…

Computer Vision and Pattern Recognition · Computer Science 2025-07-16 Rui Hu , Lianghui Zhu , Yuxuan Zhang , Tianheng Cheng , Lei Liu , Heng Liu , Longjin Ran , Xiaoxin Chen , Wenyu Liu , Xinggang Wang

Geospatial foundation models (GFMs) have been proposed as generalizable backbones for disaster response, land-cover mapping, food-security monitoring, and other high-stakes Earth-observation tasks. Yet the published work about these models…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Isaac Corley , Nils Lehmann , Caleb Robinson , Gabriel Tseng , Anthony Fuller , Hamed Alemohammad , Evan Shelhamer , Jennifer Marcus , Hannah Kerner

Although large-scale visual foundation models (VFMs) achieve remarkable performance in semantic understanding, they still underperform in instance-aware dense prediction tasks. They exhibit different biases in representation: for instance,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Yachan Guo , JoseLuis Gomez Zurita , Danna Xue , Yi Xiao , AntonioManuel Lopez Pena

Foundation models (FMs) for the Earth system learn statistical relationships between physical variables across massive datasets to enable versatile downstream applications through finetuning, separating them from task-specific weather…

Modern climate projections often suffer from inadequate spatial and temporal resolution due to computational limitations, resulting in inaccurate representations of sub-grid processes. A promising technique to address this is the Multiscale…

As AI workloads increase in scope, generalization capability becomes challenging for small task-specific models and their demand for large amounts of labeled training samples increases. On the contrary, Foundation Models (FMs) are trained…

Artificial Intelligence · Computer Science 2024-04-19 Aristeidis Tsaris , Philipe Ambrozio Dias , Abhishek Potnis , Junqi Yin , Feiyi Wang , Dalton Lunga

Foundation models (FMs) have achieved significant success across various tasks, leading to research on benchmarks for reasoning abilities. However, there is a lack of studies on FMs performance in exceptional scenarios, which we define as…

Artificial Intelligence · Computer Science 2024-12-06 Suho Kang , Jungyang Park , Joonseo Ha , SoMin Kim , JinHyeong Kim , Subeen Park , Kyungwoo Song

Recent research in geospatial machine learning has demonstrated that models pretrained with self-supervised learning on Earth observation data can perform well on downstream tasks with limited training data. However, most of the existing…

Computer Vision and Pattern Recognition · Computer Science 2026-02-09 Lucia Gordon , Serge Belongie , Christian Igel , Nico Lang

Geoscience intelligence is expected to understand, reason about, and predict earth system changes to support human decision-making in critical domains such as disaster response, climate adaptation and environmental protection. Although…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Yushuo Zheng , Zicheng Zhang , Huiyu Duan , Chunyi Li , Zijian Chen , Ziheng Jia , Yue Shi , Ke Gu , Xiongkuo Min , Guangtao Zhai

Nucleotide sequences constitute the fundamental genetic basis of biological systems, rendering viral genomic analysis critical for biomedical advancement. Despite progress in biological foundation models, specifically nucleotide foundation…

Machine Learning · Computer Science 2026-05-26 Dongxin Ye , Fang Hu , Han Hu , Shu Hu , Yang Tan , Wanli Ouyang , Stan Z. Li , Jie Cui , Nanqing Dong

The reliability of routine health data in low and middle-income countries (LMICs) is often constrained by reporting delays and incomplete coverage, necessitating the exploration of novel data sources and analytics. Geospatial Foundation…

Differentiating signals from the background in micrographs is a critical initial step for cryogenic electron microscopy (cryo-EM), yet it remains laborious due to low signal-to-noise ratio (SNR), the presence of contaminants and densely…

Image and Video Processing · Electrical Eng. & Systems 2025-09-30 Szu-Chi Chung , Po-Cheng Chou

The number and diversity of remote sensing satellites grows over time, while the vast majority of labeled data comes from older satellites. As the foundation models for Earth observation scale up, the cost of (re-)training to support new…

Machine Learning · Computer Science 2025-11-05 Hakob Tamazyan , Ani Vanyan , Alvard Barseghyan , Anna Khosrovyan , Evan Shelhamer , Hrant Khachatrian

Vision Foundation Models (VFMs) have delivered remarkable performance in Domain Generalized Semantic Segmentation (DGSS). However, recent methods often overlook the fact that visual cues are susceptible, whereas the underlying geometry…

Computer Vision and Pattern Recognition · Computer Science 2025-07-16 Siyu Chen , Ting Han , Changshe Zhang , Xin Luo , Meiliu Wu , Guorong Cai , Jinhe Su

Accurate regional climate forecast calls for high-resolution downscaling of Global Climate Models (GCMs). This work presents a deep-learning-based multi-model evaluation and downscaling framework ranking 32 Coupled Model Intercomparison…

Machine Learning · Computer Science 2025-03-03 Parthiban Loganathan , Elias Zea , Ricardo Vinuesa , Evelyn Otero

While computer science has seen remarkable advancements in foundation models, which remain underexplored in geoscience. Addressing this gap, we introduce a workflow to develop geophysical foundation models, including data preparation, model…

Geophysics · Physics 2023-12-18 Hanlin Sheng , Xinming Wu , Xu Si , Jintao Li , Sibo Zhang , Xudong Duan