English
Related papers

Related papers: RoSA: Accurate Parameter-Efficient Fine-Tuning via…

200 papers

Parameter-efficient fine-tuning (PEFT) is an effective method for adapting pre-trained vision models to downstream tasks by tuning a small subset of parameters. Among PEFT methods, sparse tuning achieves superior performance by only…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Shufan Shen , Junshu Sun , Xiangyang Ji , Qingming Huang , Shuhui Wang

Parameter-Efficient Fine-Tuning (PEFT) is widely used for adapting Large Language Models (LLMs) for various tasks. Recently, there has been an increasing demand for fine-tuning a single LLM for multiple tasks because it requires overall…

Computation and Language · Computer Science 2026-05-15 Anjir Ahmed Chowdhury , Syed Zawad , Xiaolong Ma , Xu Dong , Feng Yan

This paper introduces Quantum-PEFT that leverages quantum computations for parameter-efficient fine-tuning (PEFT). Unlike other additive PEFT methods, such as low-rank adaptation (LoRA), Quantum-PEFT exploits an underlying full-rank yet…

Machine Learning · Computer Science 2025-03-10 Toshiaki Koike-Akino , Francesco Tonin , Yongtao Wu , Frank Zhengqing Wu , Leyla Naz Candogan , Volkan Cevher

Fine-tuning large-scale pretrained models is prohibitively expensive in terms of computational and memory costs. LoRA, as one of the most popular Parameter-Efficient Fine-Tuning (PEFT) methods, offers a cost-effective alternative by…

Machine Learning · Computer Science 2024-07-17 Shaowen Wang , Linxi Yu , Jian Li

Low-rank adapters (LoRA) and their variants are popular parameter-efficient fine-tuning (PEFT) techniques that closely match full model fine-tune performance while requiring only a small number of additional parameters. These additional…

Machine Learning · Computer Science 2024-05-28 Runqian Wang , Soumya Ghosh , David Cox , Diego Antognini , Aude Oliva , Rogerio Feris , Leonid Karlinsky

Fine-tuning is a key approach for adapting language models to specific downstream tasks, but updating all model parameters becomes impractical as model sizes increase. Parameter-Efficient Fine-Tuning (PEFT) methods, such as Low-Rank…

Computation and Language · Computer Science 2025-02-10 Jiayang Yu , Yihang Zhang , Bin Wang , Peiqin Lin , Yongkang Liu , Shi Feng

This review examines recent advances in Parameter-Efficient Fine-Tuning (PEFT), with a focus on Low-Rank Adaptation (LoRA), to optimize Retrieval-Augmented Generation (RAG) systems like Qwen3, DeepSeek, and Kimi. These systems face…

Computation and Language · Computer Science 2025-08-13 David Santandreu Calonge , Linda Smail

Existing low-rank adaptation (LoRA) methods face challenges on sparse large language models (LLMs) due to the inability to maintain sparsity. Recent works introduced methods that maintain sparsity by augmenting LoRA techniques with…

Computation and Language · Computer Science 2025-01-16 Yuxuan Hu , Jing Zhang , Xiaodong Chen , Zhe Zhao , Cuiping Li , Hong Chen

Adapting deep learning models to new domains often requires computationally intensive retraining and risks catastrophic forgetting. While fine-tuning enables domain-specific adaptation, it can reduce robustness to distribution shifts,…

Computer Vision and Pattern Recognition · Computer Science 2025-01-28 Reza Akbarian Bafghi , Carden Bagwell , Avinash Ravichandran , Ashish Shrivastava , Maziar Raissi

Large pre-trained models achieve remarkable success across diverse domains, yet fully fine-tuning incurs prohibitive computational and memory costs. Parameter-efficient fine-tuning (PEFT) has thus become a mainstream paradigm. Among them,…

Machine Learning · Computer Science 2026-02-02 Muqing Liu , Chongjie Si , Yuheng Jia

Robust Fine-Tuning (RFT) is a low-cost strategy to obtain adversarial robustness in downstream applications, without requiring a lot of computational resources and collecting significant amounts of data. This paper uncovers an issue with…

Machine Learning · Computer Science 2023-10-04 Xilie Xu , Jingfeng Zhang , Mohan Kankanhalli

Federated Parameter-Efficient Fine-Tuning (FedPEFT) has emerged as a promising paradigm for privacy-preserving and efficient adaptation of Pre-trained Language Models (PLMs) in Federated Learning (FL) settings. It preserves data privacy by…

Cryptography and Security · Computer Science 2024-12-20 Shenghui Li , Edith C. -H. Ngai , Fanghua Ye , Thiemo Voigt

Low-Rank Adaptation (LoRA) is currently the most commonly used Parameter-efficient fine-tuning (PEFT) method, it introduces auxiliary parameters for each layer to fine-tune the pre-trained model under limited computing resources. However,…

Machine Learning · Computer Science 2024-06-19 Hongyun Zhou , Xiangyu Lu , Wang Xu , Conghui Zhu , Tiejun Zhao , Muyun Yang

Training large foundation models from scratch for domain-specific applications is almost impossible due to data limits and long-tailed distributions -- taking remote sensing (RS) as an example. Fine-tuning natural image pre-trained models…

Machine Learning · Computer Science 2026-03-03 Zichen Tian , Yaoyao Liu , Qianru Sun

Adapting pretrained language models to novel domains, such as clinical applications, traditionally involves retraining their entire set of parameters. Parameter-Efficient Fine-Tuning (PEFT) techniques for fine-tuning language models…

Computation and Language · Computer Science 2024-06-11 Aryo Pradipta Gema , Pasquale Minervini , Luke Daines , Tom Hope , Beatrice Alex

Low-rank adaptation (LoRA) and its mixture-of-experts (MOE) variants are highly effective parameter-efficient fine-tuning (PEFT) methods. However, they introduce significant latency in multi-tenant settings due to the LoRA modules and MOE…

Computation and Language · Computer Science 2024-10-24 Jingfan Zhang , Yi Zhao , Dan Chen , Xing Tian , Huanran Zheng , Wei Zhu

Large pre-trained models (LPMs) have demonstrated exceptional performance in diverse natural language processing and computer vision tasks. However, fully fine-tuning these models poses substantial memory challenges, particularly in…

Machine Learning · Computer Science 2024-09-12 Chengwei Sun , Jiwei Wei , Yujia Wu , Yiming Shi , Shiyuan He , Zeyu Ma , Ning Xie , Yang Yang

The rapid expansion of large foundation models within the pre-training and fine-tuning framework has underscored that larger models often yield better results. However, the scaling up of large foundation models has led to soaring costs in…

Machine Learning · Computer Science 2024-12-30 Chongjie Si , Xiaokang Yang , Wei Shen

Parameter efficient fine tuning (PEFT) is a versatile and extensible approach for adapting a Large Language Model (LLM) for newer tasks. One of the most prominent PEFT approaches, Low Rank Adaptation (LoRA), primarily focuses on adjusting…

Machine Learning · Computer Science 2025-07-22 Harsh Nilesh Pathak , Randy Paffenroth

Parameter-efficient fine-tuning methods like Low-Rank Adaptation (LoRA) have become essential for deploying large language models, yet their static parameter allocation remains suboptimal for inputs of varying complexity. We present…

Machine Learning · Computer Science 2026-05-05 Zongqian Li , Yixuan Su , Han Zhou , Zihao Fu , Nigel Collier