English
Related papers

Related papers: Parameter-Efficient Fine-Tuning Design Spaces

200 papers

This paper delves into the pressing need in Parameter-Efficient Fine-Tuning (PEFT) for Large Language Models (LLMs). While LLMs possess remarkable capabilities, their extensive parameter requirements and associated computational demands…

Computation and Language · Computer Science 2023-11-23 Chengyu Wang , Junbing Yan , Wei Zhang , Jun Huang

Parameter-efficient tuning (PEFT) techniques like low-rank adaptation (LoRA) offer training efficiency on Large Language Models, but their impact on model performance remains limited. Recent efforts integrate LoRA and Mixture-of-Experts…

Computation and Language · Computer Science 2024-02-14 Chongyang Gao , Kezhen Chen , Jinmeng Rao , Baochen Sun , Ruibo Liu , Daiyi Peng , Yawen Zhang , Xiaoyuan Guo , Jie Yang , VS Subrahmanian

To fully leverage the advantages of large-scale pre-trained language models (PLMs) on downstream tasks, it has become a ubiquitous adaptation paradigm to fine-tune the entire parameters of PLMs. However, this paradigm poses issues of…

Computation and Language · Computer Science 2023-05-09 Anchun Gui , Han Xiao

Fine-tuning large pre-trained language models on various downstream tasks with whole parameters is prohibitively expensive. Hence, Parameter-efficient fine-tuning has attracted attention that only optimizes a few task-specific parameters…

Computation and Language · Computer Science 2023-05-25 Zhen-Ru Zhang , Chuanqi Tan , Haiyang Xu , Chengyu Wang , Jun Huang , Songfang Huang

Fine-tuning from pre-trained ImageNet models has become the de-facto standard for various computer vision tasks. Current practices for fine-tuning typically involve selecting an ad-hoc choice of hyperparameters and keeping them fixed to…

Computer Vision and Pattern Recognition · Computer Science 2020-02-28 Hao Li , Pratik Chaudhari , Hao Yang , Michael Lam , Avinash Ravichandran , Rahul Bhotika , Stefano Soatto

Evolving amendments of 802.11 standards feature a large set of physical and MAC layer control parameters to support the increasing communication objectives spanning application requirements and network dynamics. The significant growth and…

Networking and Internet Architecture · Computer Science 2020-02-11 Hannaneh Barahouei Pasandi , Tamer Nadeem

Packing, initially utilized in the pre-training phase, is an optimization technique designed to maximize hardware resource efficiency by combining different training sequences to fit the model's maximum input length. Although it has…

Machine Learning · Computer Science 2024-11-07 Shuhe Wang , Guoyin Wang , Yizhong Wang , Jiwei Li , Eduard Hovy , Chen Guo

Foundation models, with a vast number of parameters and pretraining on massive datasets, achieve state-of-the-art performance across various applications. However, efficiently adapting them to downstream tasks with minimal computational…

Machine Learning · Computer Science 2025-04-07 Van-Anh Nguyen , Thanh-Toan Do , Mehrtash Harandi , Dinh Phung , Trung Le

Adapting models pre-trained on large-scale datasets is a proven way to reach strong performance quickly for down-stream tasks. However, the growth of state-of-the-art mod-els makes traditional full fine-tuning unsuitable and difficult,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Maxime Fontana , Michael Spratling , Miaojing Shi

Efficiently adapting large foundation models is critical, especially with tight compute and memory budgets. Parameter-Efficient Fine-Tuning (PEFT) methods such as LoRA offer limited granularity and effectiveness in few-parameter regimes. We…

Computer Vision and Pattern Recognition · Computer Science 2025-06-05 Ahmet Bilican , M. Akın Yılmaz , A. Murat Tekalp , R. Gökberk Cinbiş

Foundation models have shown superior performance for speech emotion recognition (SER). However, given the limited data in emotion corpora, finetuning all parameters of large pre-trained models for SER can be both resource-intensive and…

Audio and Speech Processing · Electrical Eng. & Systems 2024-04-02 Nineli Lashkarashvili , Wen Wu , Guangzhi Sun , Philip C. Woodland

We introduce a novel method that enables parameter-efficient transfer and multi-task learning with deep neural networks. The basic approach is to learn a model patch - a small set of parameters - that will specialize to each task, instead…

Machine Learning · Computer Science 2019-02-26 Pramod Kaushik Mudrakarta , Mark Sandler , Andrey Zhmoginov , Andrew Howard

Recently, we have observed that Large Multi-modal Models (LMMs) are revolutionizing the way machines interact with the world, unlocking new possibilities across various multi-modal applications. To adapt LMMs for downstream tasks,…

Computation and Language · Computer Science 2024-11-04 Donghoon Kim , Gusang Lee , Kyuhong Shim , Byonghyo Shim

Fine-tuning visual models has been widely shown promising performance on many downstream visual tasks. With the surprising development of pre-trained visual foundation models, visual tuning jumped out of the standard modus operandi that…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Bruce X. B. Yu , Jianlong Chang , Haixin Wang , Lingbo Liu , Shijie Wang , Zhiyu Wang , Junfan Lin , Lingxi Xie , Haojie Li , Zhouchen Lin , Qi Tian , Chang Wen Chen

LoRA-based large model parameter-efficient fine-tuning (PEFT) methods use low-rank de- composition to approximate updates to model parameters. However, compared to full- parameter fine-tuning, low-rank updates often lead to a performance…

Computation and Language · Computer Science 2025-08-26 Haojie Zhang

With the dramatically increased number of parameters in language models, sparsity methods have received ever-increasing research focus to compress and accelerate the models. While most research focuses on how to accurately retain…

Artificial Intelligence · Computer Science 2022-05-24 Yuchao Li , Fuli Luo , Chuanqi Tan , Mengdi Wang , Songfang Huang , Shen Li , Junjie Bai

Fine-tuning large language models (LLM) can be costly. Parameter-efficient fine-tuning (PEFT) addresses the problems by training a fraction of the parameters, whose success reveals the expressiveness and flexibility of pretrained models.…

Machine Learning · Computer Science 2024-05-07 Jing Xu , Jingzhao Zhang

The rapid advancements in Large Language Models (LLMs) have revolutionized natural language processing (NLP) and related fields. However, fine-tuning these models for specific tasks remains computationally expensive and risks degrading…

Computation and Language · Computer Science 2024-12-17 Md Kowsher , Nusrat Jahan Prottasha , Prakash Bhat

Although pretrained language models can be fine-tuned to produce state-of-the-art results for a very wide range of language understanding tasks, the dynamics of this process are not well understood, especially in the low data regime. Why…

Machine Learning · Computer Science 2020-12-25 Armen Aghajanyan , Luke Zettlemoyer , Sonal Gupta

Prompt tuning attempts to update few task-specific parameters in pre-trained models. It has achieved comparable performance to fine-tuning of the full parameter set on both language understanding and generation tasks. In this work, we study…

Computation and Language · Computer Science 2022-07-15 Weng Lam Tam , Xiao Liu , Kaixuan Ji , Lilong Xue , Xingjian Zhang , Yuxiao Dong , Jiahua Liu , Maodi Hu , Jie Tang