English
Related papers

Related papers: Low-Rank Adaptation of Geospatial Foundation Model…

200 papers

FORUM (Far-infrared Outgoing Radiation Understanding and Monitoring) was selected in 2019 as the ninth Earth Explorer mission by the European Space Agency (ESA). Its primary objective is to collect interferometric measurements in the…

Atmospheric and Oceanic Physics · Physics 2024-10-31 Cristina Sgattoni , Luca Sgheri , Matthias Chung

Foundation Models (FMs) have achieved state-of-the-art performance across domains by leveraging large-scale pretraining. In Earth Observation (EO), the availability of petabyte-scale satellite archives has recently enabled the development…

The explosive growth of spatial data and extensive utilization of spatial databases emphasize the necessity for the automated discovery of spatial knowledge. In modern times, spatial data mining has emerged as an area of voluminous…

Other Computer Science · Computer Science 2010-02-11 K. Angayarkkani , N. Radhakrishnan

With the increasing number of parameters in large pre-trained models, LoRA as a parameter-efficient fine-tuning(PEFT) method is widely used for not adding inference overhead. The LoRA method assumes that weight changes during fine-tuning…

Machine Learning · Computer Science 2024-08-07 Jihao Gu , Shuai Chen , Zelin Wang , Yibo Zhang , Ping Gong

Adapting large language models (LLMs) trained on broad organic chemistry to smaller, domain-specific reaction datasets is a key challenge in chemical and pharmaceutical R&D. Effective specialisation requires learning new reaction knowledge…

Machine Learning · Computer Science 2026-02-12 Jiayun Pang , Ahmed M. Zaitoun , Xacobe Couso Cambeiro , Ivan Vulić

Low-Rank Adaptation (LoRA) has emerged as a widely adopted parameter-efficient fine-tuning (PEFT) technique for foundation models. Recent work has highlighted an inherent asymmetry in the initialization of LoRA's low-rank factors, which has…

Machine Learning · Statistics 2025-06-18 Anastasis Kratsios , Tin Sum Cheng , Aurelien Lucchi , Haitz Sáez de Ocáriz Borde

Wildfires are increasingly impacting the environment, human health and safety. Among the top 20 California wildfires, those in 2020-2021 burned more acres than the last century combined. California's 2018 wildfire season caused damages of…

Machine Learning · Computer Science 2022-08-22 Rohan Tan Bhowmik

Predicting the extent of massive wildfires once ignited is essential to reduce the subsequent socioeconomic losses and environmental damage, but challenging because of the complexity of fire behaviour. Existing physics-based models are…

Machine Learning · Computer Science 2024-12-12 Bo Pang , Sibo Cheng , Yuhan Huang , Yufang Jin , Yike Guo , I. Colin Prentice , Sandy P. Harrison , Rossella Arcucci

Utilizing satellite imagery for wildfire detection presents substantial potential for practical applications. To advance the development of machine learning algorithms in this domain, our study introduces the \textit{Sen2Fire} dataset--a…

Computer Vision and Pattern Recognition · Computer Science 2024-12-11 Yonghao Xu , Amanda Berg , Leif Haglund

One of the impacts of climate change is the difficulty of tree regrowth after wildfires over areas that traditionally were covered by certain tree species. Here a deep learning model is customized to classify land covers from four-band…

Computer Vision and Pattern Recognition · Computer Science 2020-11-13 Wang Zhou , Levente Klein

Wildfires are becoming increasingly frequent and devastating, and therefore the technology to combat them must adapt accordingly. Modern predictive models have failed to balance predictive accuracy and operational viability, resulting in…

Physics and Society · Physics 2025-10-14 Connor Weinhouse , Jameson Augustin

The increasing frequency and intensity of natural disasters call for rapid and accurate damage assessment. In response, disaster benchmark datasets from high-resolution satellite imagery have been constructed to develop methods for…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Kyeongjin Ahn , Sungwon Han , Sungwon Park , Jihee Kim , Sangyoon Park , Meeyoung Cha

Cross-view geo-localization is a task of matching the same geographic image from different views, e.g., unmanned aerial vehicle (UAV) and satellite. The most difficult challenges are the position shift and the uncertainty of distance and…

Computer Vision and Pattern Recognition · Computer Science 2022-01-25 Ming Dai , Jianhong Hu , Jiedong Zhuang , Enhui Zheng

In order to streamline the fine-tuning of foundation models, Low-Rank Adapters (LoRAs) have been substantially adopted across various fields, including instruction tuning and domain adaptation. The underlying concept of LoRA involves…

Machine Learning · Computer Science 2025-02-25 Mengyang Sun , Yihao Wang , Tao Feng , Dan Zhang , Yifan Zhu , Jie Tang

Motivated by the Extreme Value Analysis 2021 (EVA 2021) data challenge we propose a method based on statistics and machine learning for the spatial prediction of extreme wildfire frequencies and sizes. This method is tailored to handle…

Methodology · Statistics 2023-04-04 Daniela Cisneros , Yan Gong , Rishikesh Yadav , Arnab Hazra , Raphael Huser

Purpose: Depth estimation in robotic surgery is vital in 3D reconstruction, surgical navigation and augmented reality visualization. Although the foundation model exhibits outstanding performance in many vision tasks, including depth…

Computer Vision and Pattern Recognition · Computer Science 2024-01-15 Beilei Cui , Mobarakol Islam , Long Bai , Hongliang Ren

Low-rank adaptation (LoRA) is a widely used parameter-efficient fine-tuning (PEFT) method that learns weight updates $\Delta W = AB$ for pretrained weights $W$ through low-rank adapters $A$ and $B$. While LoRA ensures hardware efficiency,…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Yibo Zhong , Jinman Zhao , Yao Zhou

Retrieval of vegetation properties from satellite and airborne optical data usually takes place after atmospheric correction, yet it is also possible to develop retrieval algorithms directly from top-of-atmosphere (TOA) radiance data. One…

Natural and anthropogenic disturbances are impacting the health of forests worldwide. Monitoring forest disturbances at scale is important to inform conservation efforts. Here, we present a scalable approach for country-wide mapping of…

Open-access multispectral imagery from missions like Landsat 8-9 and Sentinel-2 has fueled the development of geospatial foundation models (GFMs) for humanitarian and environmental applications. Yet, their deployment remains limited by (i)…

Computer Vision and Pattern Recognition · Computer Science 2025-10-08 Ibrahim Salihu Yusuf , Iffanice Houndayi , Rym Oualha , Mohamed Aziz Cherif , Kobby Panford-Quainoo , Arnu Pretorius