中文
相关论文

相关论文: Low-Rank Adaptation of Geospatial Foundation Model…

200 篇论文

Low-Rank Adaptation (LoRA) has recently gained attention for fine-tuning foundation models by incorporating trainable low-rank matrices, thereby reducing the number of trainable parameters. While LoRA offers numerous advantages, its…

机器学习 · 计算机科学 2024-04-29 Yeming Wen , Swarat Chaudhuri

Classifying Non-Functional Requirements (NFRs) in software development life cycle is critical. Inspired by the theory of transfer learning, researchers apply powerful pre-trained models for NFR classification. However, full fine-tuning by…

软件工程 · 计算机科学 2025-03-12 Xia Li , Allen Kim

As sadly known, forest fires are part of a set of natural disasters that have always affected regions of the world typically characterized by a tropical climate with long periods of drought. However, due to climate changes of the recent…

图像与视频处理 · 电气工程与系统科学 2021-01-27 Domenico A. G. Dell'Aglio , Massimiliano Gargiulo , Antonio Iodice , Daniele Riccio , Giuseppe Ruello

Geospatial Foundation Models (GeoFMs) are transforming Earth Observation (EO), but evaluation lacks standardized protocols. GEO-Bench-2 addresses this with a comprehensive framework spanning classification, segmentation, regression, object…

Wildfire risk prediction remains a critical yet challenging task due to the complex interactions among fuel conditions, meteorology, topography, and human activity. Despite growing interest in data-driven approaches, publicly available…

计算机视觉与模式识别 · 计算机科学 2026-01-01 Zhengsen Xu , Sibo Cheng , Lanying Wang , Hongjie He , Wentao Sun , Jonathan Li , Lincoln Linlin Xu

Large Language Models (LLMs) such as ChatGPT demonstrate strong few-shot adaptability without requiring fine-tuning, positioning them ideal for data-limited and real-time applications. However, this adaptability has not yet been replicated…

计算机视觉与模式识别 · 计算机科学 2024-12-04 Zixuan Hu , Yongxian Wei , Li Shen , Chun Yuan , Dacheng Tao

Accurate prediction of wildfire spread is crucial for effective risk management, emergency response, and strategic resource allocation. In this study, we present a deep learning (DL)-based framework for forecasting the final extent of…

机器学习 · 计算机科学 2026-04-10 Nikolaos Anastasiou , Spyros Kondylatos , Ioannis Papoutsis

In recent years, increased wildfires have caused irreversible damage to forest resources worldwide, threatening wildlives and human living conditions. The lack of accurate frontline information in real-time can pose great risks to…

机器人学 · 计算机科学 2021-12-07 Tai Yang , Shumeng Zhang , Yong Wang , Jialei Liu

Reinforcement Learning with Verifiable Rewards (RLVR) is a key paradigm for improving large-scale reasoning models. Unlike supervised fine-tuning (SFT), RLVR exhibits distinct optimization dynamics and is sensitive to the preservation of…

机器学习 · 计算机科学 2026-04-24 Jiaying Zhang , Lei Shi , Jiguo Li , Jun Xu , Jiuchong Gao , Jinghua Hao , Renqing He

Monitoring and managing Earth's forests in an informed manner is an important requirement for addressing challenges like biodiversity loss and climate change. While traditional in situ or aerial campaigns for forest assessments provide…

计算机视觉与模式识别 · 计算机科学 2022-12-13 Alexander Becker , Stefania Russo , Stefano Puliti , Nico Lang , Konrad Schindler , Jan Dirk Wegner

While Low-Rank Adaptation (LoRA) has proven beneficial for efficiently fine-tuning large models, LoRA fine-tuned text-to-image diffusion models lack diversity in the generated images, as the model tends to copy data from the observed…

Low-Rank Adaptation (LoRA) has become a widely used method for parameter-efficient fine-tuning of large-scale, pre-trained neural networks. However, LoRA and its extensions face several challenges, including the need for rank adaptivity,…

机器学习 · 计算机科学 2024-10-25 Steffen Schotthöfer , Emanuele Zangrando , Gianluca Ceruti , Francesco Tudisco , Jonas Kusch

Spatio-temporal forecasting is essential for understanding future dynamics within real-world systems by leveraging historical data from multiple locations. Existing methods often prioritize the development of intricate neural networks to…

机器学习 · 计算机科学 2025-07-08 Weilin Ruan , Wei Chen , Xilin Dang , Jianxiang Zhou , Weichuang Li , Xu Liu , Yuxuan Liang

Climate change results in an increased probability of extreme weather events that put societies and businesses at risk on a global scale. Therefore, near real-time mapping of natural hazards is an emerging priority for the support of…

计算机视觉与模式识别 · 计算机科学 2023-06-02 Johannes Jakubik , Michal Muszynski , Michael Vössing , Niklas Kühl , Thomas Brunschwiler

Parameter-efficient fine-tuning (PEFT) methods, particularly Low-Rank Adaptation (LoRA), offer an efficient way to adapt large language models with reduced computational costs. However, their performance is limited by the small number of…

计算与语言 · 计算机科学 2025-09-23 Hengyuan Zhang , Xinrong Chen , Yingmin Qiu , Xiao Liang , Ziyue Li , Guanyu Wang , Weiping Li , Tong Mo , Hayden Kwok-Hay So , Ngai Wong

The value of Earth observation foundation models for high-impact ecological applications remains insufficiently characterized. This study is one of the first to systematically evaluate the performance, limitations and practical…

计算机视觉与模式识别 · 计算机科学 2026-02-25 Craig Mahlasi , Gciniwe S. Baloyi , Zaheed Gaffoor , Levente Klein , Anne Jones , Etienne Vos , Michal Muszynski , Geoffrey Dawson , Campbell Watson

Low-rank adaptation (LoRA) has emerged as the de facto standard for parameter-efficient fine-tuning (PEFT) of foundation models, enabling the adaptation of billion-parameter networks with minimal computational and memory overhead. Despite…

机器学习 · 计算机科学 2026-04-24 Bingcong Li , Yilang Zhang , Georgios B. Giannakis

Since frequent severe droughts are lengthening the dry season in the Amazon Rainforest, it is important to detect wildfires promptly and forecast possible spread for effective suppression response. Current wildfire detection models are not…

机器学习 · 计算机科学 2022-08-09 Christopher Sun

Wildfire monitoring and prediction are essential for understanding wildfire behaviour. With extensive Earth observation data, these tasks can be integrated and enhanced through multi-task deep learning models. We present a comprehensive…

计算机视觉与模式识别 · 计算机科学 2024-12-17 Yu Zhao , Sebastian Gerard , Yifang Ban

Artificial Intelligence (AI) Foundation models (FMs), pre-trained on massive unlabelled datasets, have the potential to drastically change AI applications in ocean science, where labelled data are often sparse and expensive to collect. In…