English
Related papers

Related papers: ROSA: Random Subspace Adaptation for Efficient Fin…

200 papers

Parameter-Efficient FineTuning (PEFT) methods have recently gained significant popularity thanks to the widespread availability of large-scale pretrained models. These methods allow for quick adaptation to downstream tasks with minimal…

Machine Learning · Computer Science 2025-05-20 Massimo Bini , Leander Girrbach , Zeynep Akata

Low-rank Adaptation (LoRA) has gained popularity as a fine-tuning approach for Large Language Models (LLMs) due to its low resource requirements and good performance. While a plethora of work has investigated improving LoRA serving…

Machine Learning · Computer Science 2025-08-06 Minghao Yan , Zhuang Wang , Zhen Jia , Shivaram Venkataraman , Yida Wang

Parameter Efficient Fine-Tuning (PEFT) techniques have drawn significant attention due to their ability to yield competitive results while updating only a small portion of the adjustable parameters. However, existing PEFT methods pose…

Machine Learning · Computer Science 2024-06-04 Muling Wu , Wenhao Liu , Xiaohua Wang , Tianlong Li , Changze Lv , Zixuan Ling , Jianhao Zhu , Cenyuan Zhang , Xiaoqing Zheng , Xuanjing Huang

Continual learning requires the model to learn multiple tasks sequentially. In continual learning, the model should possess the ability to maintain its performance on old tasks (stability) and the ability to adapt to new tasks continuously…

Machine Learning · Computer Science 2024-04-04 Yan-Shuo Liang , Wu-Jun Li

Adapting pre-trained models has become an effective strategy in artificial intelligence, offering a scalable and efficient alternative to training models from scratch. In the context of remote sensing (RS), where visual grounding(VG)…

Computer Vision and Pattern Recognition · Computer Science 2025-06-02 Hasan Moughnieh , Mohamad Chalhoub , Hasan Nasrallah , Cristiano Nattero , Paolo Campanella , Giovanni Nico , Ali J. Ghandour

Among the widely used parameter-efficient fine-tuning (PEFT) methods, LoRA and its variants have gained considerable popularity because of avoiding additional inference costs. However, there still often exists an accuracy gap between these…

Computation and Language · Computer Science 2024-07-10 Shih-Yang Liu , Chien-Yi Wang , Hongxu Yin , Pavlo Molchanov , Yu-Chiang Frank Wang , Kwang-Ting Cheng , Min-Hung Chen

Parameter-efficient fine-tuning (PEFT) has become the standard approach for adapting large language models under limited compute and memory budgets. Although previous methods improve efficiency through low-rank updates, quantization, or…

Machine Learning · Computer Science 2025-10-21 Zhuxuanzi Wang , Mingqiao Mo , Xi Xiao , Chen Liu , Chenrui Ma , Yunbei Zhang , Xiao Wang , Smita Krishnaswamy , Tianyang Wang

Compared to Full-Model Fine-Tuning (FMFT), Parameter Efficient Fine-Tuning (PEFT) has demonstrated superior performance and lower computational overhead in several code understanding tasks, such as code summarization and code search. This…

Software Engineering · Computer Science 2024-02-12 Shuo Liu , Jacky Keung , Zhen Yang , Fang Liu , Qilin Zhou , Yihan Liao

This paper introduces a novel Parameter-Efficient Fine-Tuning (PEFT) framework for multi-modal, multi-task transfer learning with pre-trained language models. PEFT techniques such as LoRA, BitFit and IA3 have demonstrated comparable…

Machine Learning · Computer Science 2023-12-15 Avelina Asada Hadji-Kyriacou , Ognjen Arandjelovic

Parameter-efficient fine-tuning (PEFT) methods, such as LoRA, reduce adaptation cost by injecting low-rank updates into pretrained weights. However, LoRA's down-projection is randomly initialized and data-agnostic, discarding potentially…

Machine Learning · Computer Science 2026-01-07 Yuan Yin , Shashanka Venkataramanan , Tuan-Hung Vu , Andrei Bursuc , Matthieu Cord

As large language models continue to grow in size, parameter-efficient fine-tuning (PEFT) has become increasingly crucial. While low-rank adaptation (LoRA) offers a solution through low-rank updates, its static rank allocation may yield…

Machine Learning · Computer Science 2025-04-14 Hao Nan Sheng , Zhi-yong Wang , Mingrui Yang , Hing Cheung So

The Parameter-Efficient Fine-Tuning (PEFT) methods have been extensively researched for large language models in downstream tasks. Among all the existing approaches, the Low-Rank Adaptation (LoRA) has gained popularity for its streamlined…

Computer Vision and Pattern Recognition · Computer Science 2025-06-05 Tangyu Jiang , Haodi Wang , Chun Yuan

Fine-tuning pre-trained large language models in a parameter-efficient manner is widely studied for its effectiveness and efficiency. LoRA is one of the most widely used methods, which assumes that the optimization process is essentially…

Computation and Language · Computer Science 2024-12-16 Changqun Li , Chaofan Ding , Kexin Luan , Xinhan Di

Fine-tuning helps large language models (LLM) recover degraded information and enhance task performance. Although Low-Rank Adaptation (LoRA) is widely used and effective for fine-tuning, we have observed that its scaling factor can limit or…

Machine Learning · Computer Science 2025-01-14 Jun Liu , Zhenglun Kong , Peiyan Dong , Changdi Yang , Xuan Shen , Pu Zhao , Hao Tang , Geng Yuan , Wei Niu , Wenbin Zhang , Xue Lin , Dong Huang , Yanzhi Wang

Fine-tuning is a key approach for adapting language models to specific downstream tasks, but updating all model parameters becomes impractical as model sizes increase. Parameter-Efficient Fine-Tuning (PEFT) methods, such as Low-Rank…

Computation and Language · Computer Science 2025-02-10 Jiayang Yu , Yihang Zhang , Bin Wang , Peiqin Lin , Yongkang Liu , Shi Feng

Pre-trained language models (PLMs) show impressive performance in various downstream NLP tasks. However, pre-training large language models demands substantial memory and training compute. Furthermore, due to the substantial resources…

Computation and Language · Computer Science 2024-04-01 HyunJin Kim , Young Jin Kim , JinYeong Bak

Parameter-efficient fine-tuning (PEFT) is essential for adapting large language models (LLMs), with low-rank adaptation (LoRA) being the most popular approach. However, LoRA suffers from slow convergence, and some recent LoRA variants, such…

Computation and Language · Computer Science 2025-02-21 Chenlu Guo , Yuan Wu , Yi Chang

In fine-tuning large language models (LLMs), conserving computational resources while maintaining effectiveness and improving outcomes within the same computational constraints is crucial. The Low-Rank Adaptation (LoRA) strategy balances…

Machine Learning · Computer Science 2024-09-05 Xiaojun Xiao , Sen Shen , Qiming Bao , Hongfei Rong , Kairui Liu , Zhongsheng Wang , Jiamou Liu

LoRA and its variants have become popular parameter-efficient fine-tuning (PEFT) methods due to their ability to avoid excessive computational costs. However, an accuracy gap often exists between PEFT methods and full fine-tuning (FT), and…

Computation and Language · Computer Science 2025-05-20 Haoze He , Juncheng Billy Li , Xuan Jiang , Heather Miller

Adapting Large Language Models (LLMs) to new tasks through fine-tuning has been made more efficient by the introduction of Parameter-Efficient Fine-Tuning (PEFT) techniques, such as LoRA. However, these methods often underperform compared…

Computation and Language · Computer Science 2024-05-24 Chunlin Tian , Zhan Shi , Zhijiang Guo , Li Li , Chengzhong Xu