English
Related papers

Related papers: Advancing Parameter Efficiency in Fine-tuning via …

200 papers

Full fine-tuning is a popular approach to adapt Transformer-based pre-trained large language models to a specific downstream task. However, the substantial requirements for computational power and storage have discouraged its widespread…

Computation and Language · Computer Science 2024-05-02 Samir Arora , Liangliang Wang

Parameter-Efficient Fine-Tuning (PEFT) has become the standard for customising Foundation Models (FMs) to user-specific downstream tasks. However, typical PEFT methods require storing multiple task-specific adapters, creating scalability…

Machine Learning · Computer Science 2024-11-04 Abhinav Jain , Swarat Chaudhuri , Thomas Reps , Chris Jermaine

The popularity of pre-trained large models has revolutionized downstream tasks across diverse fields, such as language, vision, and multi-modality. To minimize the adaption cost for downstream tasks, many Parameter-Efficient Fine-Tuning…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Yiwen Tang , Ray Zhang , Zoey Guo , Dong Wang , Zhigang Wang , Bin Zhao , Xuelong Li

LoRA and its variants have become popular parameter-efficient fine-tuning (PEFT) methods due to their ability to avoid excessive computational costs. However, an accuracy gap often exists between PEFT methods and full fine-tuning (FT), and…

Computation and Language · Computer Science 2025-05-20 Haoze He , Juncheng Billy Li , Xuan Jiang , Heather Miller

Popular parameter-efficient fine-tuning (PEFT) methods, such as LoRA and its variants, freeze pre-trained model weights \(W\) and inject learnable matrices \(\Delta W\). These \(\Delta W\) matrices are structured for efficient…

Standard fine-tuning of large pre-trained language models (PLMs) for downstream tasks requires updating hundreds of millions to billions of parameters, and storing a large copy of the PLM weights for every task resulting in increased cost…

Computation and Language · Computer Science 2022-11-03 Yaqing Wang , Sahaj Agarwal , Subhabrata Mukherjee , Xiaodong Liu , Jing Gao , Ahmed Hassan Awadallah , Jianfeng Gao

Standard fine-tuning of large pre-trained language models (PLMs) for downstream tasks requires updating hundreds of millions to billions of parameters, and storing a large copy of the PLM weights for every task resulting in increased cost…

Computation and Language · Computer Science 2022-11-07 Yaqing Wang , Sahaj Agarwal , Subhabrata Mukherjee , Xiaodong Liu , Jing Gao , Ahmed Hassan Awadallah , Jianfeng Gao

Fine-tuning pre-trained language models for downstream tasks has achieved impressive results in NLP. However, fine-tuning all parameters becomes impractical due to the rapidly increasing size of model parameters. To address this, Parameter…

Computation and Language · Computer Science 2024-09-23 Geyuan Zhang , Xiaofei Zhou , Chuheng Chen

The power of foundation models (FMs) lies in their capacity to learn highly expressive representations that can be adapted to a broad spectrum of tasks. However, these pretrained models require additional training stages to become effective…

Machine Learning · Computer Science 2025-10-24 Jacob L. Block , Sundararajan Srinivasan , Liam Collins , Aryan Mokhtari , Sanjay Shakkottai

Large pre-trained models (LPMs) have demonstrated exceptional performance in diverse natural language processing and computer vision tasks. However, fully fine-tuning these models poses substantial memory challenges, particularly in…

Machine Learning · Computer Science 2024-09-12 Chengwei Sun , Jiwei Wei , Yujia Wu , Yiming Shi , Shiyuan He , Zeyu Ma , Ning Xie , Yang Yang

Adapting pre-trained models has become an effective strategy in artificial intelligence, offering a scalable and efficient alternative to training models from scratch. In the context of remote sensing (RS), where visual grounding(VG)…

Computer Vision and Pattern Recognition · Computer Science 2025-06-02 Hasan Moughnieh , Mohamad Chalhoub , Hasan Nasrallah , Cristiano Nattero , Paolo Campanella , Giovanni Nico , Ali J. Ghandour

Adapting vision transformer foundation models through parameter-efficient fine-tuning (PEFT) methods has become increasingly popular. These methods optimize a limited subset of parameters, enabling efficient adaptation without the need to…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Son Thai Ly , Hien V. Nguyen

Fine-tuning pre-trained models has recently yielded remarkable performance gains in graph neural networks (GNNs). In addition to pre-training techniques, inspired by the latest work in the natural language fields, more recent work has…

Machine Learning · Computer Science 2023-12-12 Shengrui Li , Xueting Han , Jing Bai

Deep State Space Models (SSMs), such as Mamba (Gu & Dao, 2024), have become powerful tools for language modeling, offering high performance and linear scalability with sequence length. However, the application of parameter-efficient…

Machine Learning · Computer Science 2025-06-10 Kevin Galim , Wonjun Kang , Yuchen Zeng , Hyung Il Koo , Kangwook Lee

We systematically evaluate Parameter-Efficient Fine-Tuning (PEFT) methods under the paradigm of Reinforcement Learning with Verifiable Rewards (RLVR). RLVR incentivizes language models to enhance their reasoning capabilities through…

Machine Learning · Computer Science 2026-01-01 Qingyu Yin , Yulun Wu , Zhennan Shen , Sunbowen Li , Zhilin Wang , Yanshu Li , Chak Tou Leong , Jiale Kang , Jinjin Gu

Parameter-Efficient Fine-Tuning (PEFT) has gained prominence through low-rank adaptation methods like LoRA. In this paper, we focus on sparsity-based PEFT (SPEFT), which introduces trainable sparse adaptations to the weight matrices in the…

Computation and Language · Computer Science 2025-06-30 Xinxin Liu , Aaron Thomas , Cheng Zhang , Jianyi Cheng , Yiren Zhao , Xitong Gao

With the rapid development of Large Language Models (LLMs), Parameter-Efficient Fine-Tuning (PEFT) methods have gained significant attention, which aims to achieve efficient fine-tuning of LLMs with fewer parameters. As a representative…

Machine Learning · Computer Science 2025-05-30 Dacao Zhang , Kun Zhang , Shimao Chu , Le Wu , Xin Li , Si Wei

Parameter-efficient fine-tuning (PEFT) has become a popular way to adapt large pre-trained models to new tasks. Most PEFT methods update only a small subset of parameters while freezing the rest, avoiding redundant computation. As they…

Machine Learning · Computer Science 2025-08-25 Sungmin Kang , Jisoo Kim , Salman Avestimehr , Sunwoo Lee

Low-rank adaptation (LoRA) has emerged as the de facto standard for parameter-efficient fine-tuning (PEFT) of foundation models, enabling the adaptation of billion-parameter networks with minimal computational and memory overhead. Despite…

Machine Learning · Computer Science 2026-04-24 Bingcong Li , Yilang Zhang , Georgios B. Giannakis

Text-rich graphs, which exhibit rich textual information on nodes and edges, are prevalent across a wide range of real-world business applications. Large Language Models (LLMs) have demonstrated remarkable abilities in understanding text,…

Computation and Language · Computer Science 2024-04-30 Qi Zhu , Da Zheng , Xiang Song , Shichang Zhang , Bowen Jin , Yizhou Sun , George Karypis