English
Related papers

Related papers: Scaling Remote Sensing Foundation Models: Data Dom…

200 papers

While Vision-Language-Action (VLA) models show strong promise for generalist robot control, it remains unclear whether -- and under what conditions -- the standard "scale data" recipe translates to robotics, where training data is…

We investigate the utility of in-domain self-supervised pre-training of vision models in the analysis of remote sensing imagery. Self-supervised learning (SSL) has emerged as a promising approach for remote sensing image classification due…

Computer Vision and Pattern Recognition · Computer Science 2024-02-06 Ivica Dimitrovski , Ivan Kitanovski , Nikola Simidjievski , Dragi Kocev

Vision foundation models are increasingly moving beyond 2D to volumetric domains such as 3D medical imaging, where unified pretraining across different imaging modalities (i.e. CT, MRI, and PET) could provide foundational models for diverse…

Computer Vision and Pattern Recognition · Computer Science 2026-05-11 Ho Hin Lee , Dongna Du , Chu Wang , Yuankai Huo , Shi Gu , James C. Gee , Yifan Wu

Effective foundation modeling in remote sensing requires spatially aligned heterogeneous modalities coupled with semantically grounded supervision, yet such resources remain limited at scale. We present GeoMeld, a large-scale multimodal…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Maram Hasan , Md Aminur Hossain , Savitra Roy , Souparna Bhowmik , Ayush V. Patel , Mainak Singha , Subhasis Chaudhuri , Muhammad Haris Khan , Biplab Banerjee

Nowadays the use of Machine Learning (ML) algorithms is spreading in the field of Remote Sensing, with applications ranging from detection and classification of land use and monitoring to the prediction of many natural or anthropic…

Image and Video Processing · Electrical Eng. & Systems 2020-08-05 Alessandro Sebastianelli , Maria Pia Del Rosso , Silvia Liberata Ullo

The rapid advancement of foundation models has revolutionized visual representation learning in a self-supervised manner. However, their application in remote sensing (RS) remains constrained by a fundamental gap: existing models…

Computer Vision and Pattern Recognition · Computer Science 2025-12-11 Hanbo Bi , Yingchao Feng , Boyuan Tong , Mengyu Wang , Haichen Yu , Yongqiang Mao , Hao Chang , Wenhui Diao , Peijin Wang , Yue Yu , Hanyang Peng , Yehong Zhang , Kun Fu , Xian Sun

With the extremely rapid advances in remote sensing (RS) technology, a great quantity of Earth observation (EO) data featuring considerable and complicated heterogeneity is readily available nowadays, which renders researchers an…

Computer Vision and Pattern Recognition · Computer Science 2022-05-04 Jiaxin Li , Danfeng Hong , Lianru Gao , Jing Yao , Ke Zheng , Bing Zhang , Jocelyn Chanussot

Recent advances in reinforcement learning (RL) have delivered strong reasoning capabilities in natural image domains, yet their potential for Earth Observation (EO) remains largely unexplored. EO tasks introduce unique challenges, spanning…

Computer Vision and Pattern Recognition · Computer Science 2025-10-15 Mustansar Fiaz , Hiyam Debary , Paolo Fraccaro , Danda Paudel , Luc Van Gool , Fahad Khan , Salman Khan

Foundation models refer to artificial intelligence (AI) models that are trained on massive amounts of data and demonstrate broad generalizability across various tasks with high accuracy. These models offer versatile, one-for-many or…

Image and Video Processing · Electrical Eng. & Systems 2024-11-06 Rina Bao , Erfan Darzi , Sheng He , Chuan-Heng Hsiao , Mohammad Arafat Hussain , Jingpeng Li , Atle Bjornerud , Ellen Grant , Yangming Ou

In the realm of self-supervised learning (SSL), conventional wisdom has gravitated towards the utility of massive, general domain datasets for pretraining robust backbones. In this paper, we challenge this idea by exploring if it is…

Computer Vision and Pattern Recognition · Computer Science 2024-07-08 Jesús M Rodríguez-de-Vera , Imanol G Estepa , Ignacio Sarasúa , Bhalaji Nagarajan , Petia Radeva

Large-scale foundation models (FMs) in remote sensing (RS) are developed based on the paradigms established in computer vision (CV) and have shown promise for various Earth observation applications. However, the direct transfer of scaling…

Computer Vision and Pattern Recognition · Computer Science 2026-02-02 Leonard Hackel , Tom Burgert , Begüm Demir

Massive amounts of unlabelled data are captured by Earth Observation (EO) satellites, with the Sentinel-2 constellation generating 1.6 TB of data daily. This makes Remote Sensing a data-rich domain well suited to Machine Learning (ML)…

Computer Vision and Pattern Recognition · Computer Science 2024-01-17 Casper Fibaek , Luke Camilleri , Andreas Luyts , Nikolaos Dionelis , Bertrand Le Saux

The multi-modal remote sensing foundation model (MM-RSFM) has significantly advanced various Earth observation tasks, such as urban planning, environmental monitoring, and natural disaster management. However, most existing approaches…

Computer Vision and Pattern Recognition · Computer Science 2025-07-21 Yingying Zhang , Lixiang Ru , Kang Wu , Lei Yu , Lei Liang , Yansheng Li , Jingdong Chen

Synthetic-to-real transfer learning is a framework in which a synthetically generated dataset is used to pre-train a model to improve its performance on real vision tasks. The most significant advantage of using synthetic images is that the…

Machine Learning · Computer Science 2021-10-12 Hiroaki Mikami , Kenji Fukumizu , Shogo Murai , Shuji Suzuki , Yuta Kikuchi , Taiji Suzuki , Shin-ichi Maeda , Kohei Hayashi

Neural network-based emulators for the inference of stellar parameters and elemental abundances represent an increasingly popular methodology in modern spectroscopic surveys. However, these approaches are often constrained by their…

Instrumentation and Methods for Astrophysics · Physics 2025-06-10 Tomasz Różański , Yuan-Sen Ting

Remote sensing data is commonly used for tasks such as flood mapping, wildfire detection, or land-use studies. For each task, scientists carefully choose appropriate modalities or leverage data from purpose-built instruments. Recent work on…

Computer Vision and Pattern Recognition · Computer Science 2025-07-11 Joelle Hanna , Linus Scheibenreif , Damian Borth

Despite remarkable progress, multimodal foundation models still exhibit surprising deficiencies in spatial intelligence. In this work, we explore scaling up multimodal foundation models to cultivate spatial intelligence within the…

AI accelerator processing capabilities and memory constraints largely dictate the scale in which machine learning workloads (e.g., training and inference) can be executed within a desirable time frame. Training a state of the art,…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-10-12 Michael Benington , Leo Phan , Chris Pierre Paul , Evan Shoemaker , Priyanka Ranade , Torstein Collett , Grant Hodgson Perez , Christopher Krieger

As AI workloads increase in scope, generalization capability becomes challenging for small task-specific models and their demand for large amounts of labeled training samples increases. On the contrary, Foundation Models (FMs) are trained…

Artificial Intelligence · Computer Science 2024-04-19 Aristeidis Tsaris , Philipe Ambrozio Dias , Abhishek Potnis , Junqi Yin , Feiyi Wang , Dalton Lunga

Recent Artificial Intelligence (AI) models have matched or exceeded human experts in several benchmarks of biomedical task performance, but surgical benchmarks in particular are often missing from prominent medical benchmark suites. Since…