English
Related papers

Related papers: Parameter-Efficient Fine-Tuning of Multispectral F…

200 papers

Parameter-efficient fine-tuning (PEFT) of powerful pre-trained models for complex downstream tasks has proven effective in vision and language processing, yet this paradigm remains unexplored in scientific machine learning, where the…

Machine Learning · Computer Science 2025-10-20 Hangwei Zhang , Chun Kang , Yan Wang , Difan Zou

Parameter-Efficient Fine-Tuning (PEFT) methods like Low-Rank Adaptation (LoRA) optimize federated training by reducing computational and communication costs. We propose RoLoRA, a federated framework using alternating optimization to…

Machine Learning · Computer Science 2025-11-06 Shuangyi Chen , Yuanxin Guo , Yue Ju , Harik Dalal , Zhongwen Zhu , Ashish Khisti

Foundation models pre-trained on large-scale data have been widely witnessed to achieve success in various natural imaging downstream tasks. Parameter-efficient fine-tuning (PEFT) methods aim to adapt foundation models to new domains by…

Computer Vision and Pattern Recognition · Computer Science 2025-03-24 Wenqiang Zu , Shenghao Xie , Qing Zhao , Guoqi Li , Lei Ma

Previous research has shown that the principal singular vectors of a pre-trained model's weight matrices capture critical knowledge. In contrast, those associated with small singular values may contain noise or less reliable information. As…

Audio and Speech Processing · Electrical Eng. & Systems 2025-02-10 Zhe Li , Man-wai Mak , Mert Pilanci , Hung-yi Lee , Helen Meng

The hippocampus is an important brain structure involved in various psychiatric disorders, and its automatic and accurate segmentation is vital for studying these diseases. Recently, deep learning-based methods have made significant…

Computer Vision and Pattern Recognition · Computer Science 2025-10-01 Guanghua He , Wangang Cheng , Hancan Zhu , Gaohang Yu

Adapting pre-trained foundation models for diverse downstream tasks is a core practice in artificial intelligence. However, the wide range of tasks and high computational costs make full fine-tuning impractical. To overcome this,…

Machine Learning · Computer Science 2025-06-27 Chongjie Si , Zhiyi Shi , Xuehui Wang , Yichen Xiao , Xiaokang Yang , Wei Shen

Parameter-efficient fine-tuning (PEFT) methods have emerged as a practical solution for adapting large foundation models to downstream tasks, reducing computational and memory costs by updating only a small subset of parameters. Among them,…

Machine Learning · Computer Science 2025-12-30 Guoan Wan , Tianyu Chen , Fangzheng Feng , Haoyi Zhou , Runhua Xu

Fine-tuning pre-trained vision models for specific tasks is a common practice in computer vision. However, this process becomes more expensive as models grow larger. Recently, parameter-efficient fine-tuning (PEFT) methods have emerged as a…

Computer Vision and Pattern Recognition · Computer Science 2025-02-11 Yue Zhu , Haiwen Diao , Shang Gao , Long Chen , Huchuan Lu

This paper introduces a novel Parameter-Efficient Fine-Tuning (PEFT) framework for multi-modal, multi-task transfer learning with pre-trained language models. PEFT techniques such as LoRA, BitFit and IA3 have demonstrated comparable…

Machine Learning · Computer Science 2023-12-15 Avelina Asada Hadji-Kyriacou , Ognjen Arandjelovic

Parameter-Efficient FineTuning (PEFT) methods have recently gained significant popularity thanks to the widespread availability of large-scale pretrained models. These methods allow for quick adaptation to downstream tasks with minimal…

Machine Learning · Computer Science 2025-05-20 Massimo Bini , Leander Girrbach , Zeynep Akata

Parameter-efficient fine-tuning (PEFT) methods, which fine-tune only a subset of model parameters, offer a promising solution by reducing the computational costs of tuning large language models (LLMs) while maintaining their performance.…

Software Engineering · Computer Science 2025-11-25 André Storhaug , Jingyue Li

Parameter-efficient fine-tuning (PEFT) is an effective methodology to unleash the potential of large foundation models in novel scenarios with limited training data. In the computer vision community, PEFT has shown effectiveness in image…

Computer Vision and Pattern Recognition · Computer Science 2024-03-29 Zelin Peng , Zhengqin Xu , Zhilin Zeng , Lingxi Xie , Qi Tian , Wei Shen

Parameter-efficient fine-tuning (PEFT) is a popular method for tailoring pre-trained large language models (LLMs), especially as the models' scale and the diversity of tasks increase. Low-rank adaptation (LoRA) is based on the idea that the…

Computation and Language · Computer Science 2025-05-27 Pengjie Ren , Chengshun Shi , Shiguang Wu , Mengqi Zhang , Zhaochun Ren , Maarten de Rijke , Zhumin Chen , Jiahuan Pei

We present a novel Parameter-Efficient Fine-Tuning (PEFT) method, dubbed as Adaptive Freezing of Low Rank Adaptation (AFLoRA). Specifically, for each pre-trained frozen weight tensor, we add a parallel path of trainable low-rank matrices,…

Computation and Language · Computer Science 2024-04-17 Zeyu Liu , Souvik Kundu , Anni Li , Junrui Wan , Lianghao Jiang , Peter Anthony Beerel

Low-Rank Adaptation (LoRA) emerges as a popular parameter-efficient fine-tuning (PEFT) method, which proposes to freeze pretrained model weights and update an additive low-rank trainable matrix. In this work, we study the enhancement of…

Machine Learning · Computer Science 2024-06-06 Fangzhao Zhang , Mert Pilanci

Recent developments in Parameter-Efficient Fine-Tuning (PEFT) methods for pretrained deep neural networks have captured widespread interest. In this work, we study the enhancement of current PEFT methods by incorporating the spectral…

Machine Learning · Computer Science 2024-11-05 Fangzhao Zhang , Mert Pilanci

The power of foundation models (FMs) lies in their capacity to learn highly expressive representations that can be adapted to a broad spectrum of tasks. However, these pretrained models require additional training stages to become effective…

Machine Learning · Computer Science 2025-10-24 Jacob L. Block , Sundararajan Srinivasan , Liam Collins , Aryan Mokhtari , Sanjay Shakkottai

Adapting Large Language Models (LLMs) to new tasks through fine-tuning has been made more efficient by the introduction of Parameter-Efficient Fine-Tuning (PEFT) techniques, such as LoRA. However, these methods often underperform compared…

Computation and Language · Computer Science 2024-05-24 Chunlin Tian , Zhan Shi , Zhijiang Guo , Li Li , Chengzhong Xu

Parameter-efficient fine-tuning (PEFT) is an effective method for adapting pre-trained vision models to downstream tasks by tuning a small subset of parameters. Among PEFT methods, sparse tuning achieves superior performance by only…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Shufan Shen , Junshu Sun , Xiangyang Ji , Qingming Huang , Shuhui Wang

Parameter-efficient fine-tuning (PEFT) has attracted significant attention due to the growth of pre-trained model sizes and the need to fine-tune (FT) them for superior downstream performance. Despite a surge in new PEFT methods, a…

Machine Learning · Computer Science 2025-03-26 Zheda Mai , Ping Zhang , Cheng-Hao Tu , Hong-You Chen , Li Zhang , Wei-Lun Chao