English
Related papers

Related papers: Hybrid and Unitary PEFT for Resource-Efficient Lar…

200 papers

Recent literature on fine-tuning Large Language Models highlights a fundamental debate. While Full Fine-Tuning (FFT) provides the representational plasticity required for high-entropy knowledge injection, Low-Rank Adaptation (LoRA) can…

Computation and Language · Computer Science 2026-05-19 Haozhan Tang , Xiuqi Zhu , Xinyin Zhang , Boxun Li , Virginia Smith , Kevin Kuo

Adapting pretrained large language models (LLMs) to various downstream tasks in tens or hundreds of human languages is computationally expensive. Parameter-efficient fine-tuning (PEFT) significantly reduces the adaptation cost, by tuning…

Computation and Language · Computer Science 2024-08-02 Chu-Cheng Lin , Xinyi Wang , Jonathan H. Clark , Han Lu , Yun Zhu , Chenxi Whitehouse , Hongkun Yu

This paper presents an extensive examination of Parameter-Efficient Fine-Tuning (PEFT) for embedding domain specific facts into Large Language Models (LLMs), focusing on improving the fine-tuning process by categorizing question-answer (QA)…

Computation and Language · Computer Science 2025-10-28 Shivam Ratnakar , Abhiroop Talasila , Raghav Chamadiya , Nikhil Agarwal , Vinayak K Doifode

In the realm of Medical Visual Language Models (Med-VLMs), the quest for universal efficient fine-tuning mechanisms remains paramount, especially given researchers in interdisciplinary fields are often extremely short of training resources,…

Computer Vision and Pattern Recognition · Computer Science 2024-04-26 Jiawei Chen , Dingkang Yang , Yue Jiang , Mingcheng Li , Jinjie Wei , Xiaolu Hou , Lihua Zhang

Parameter Efficient Fine-Tuning (PEFT) techniques have drawn significant attention due to their ability to yield competitive results while updating only a small portion of the adjustable parameters. However, existing PEFT methods pose…

Machine Learning · Computer Science 2024-06-04 Muling Wu , Wenhao Liu , Xiaohua Wang , Tianlong Li , Changze Lv , Zixuan Ling , Jianhao Zhu , Cenyuan Zhang , Xiaoqing Zheng , Xuanjing Huang

This paper introduces Quantum-PEFT that leverages quantum computations for parameter-efficient fine-tuning (PEFT). Unlike other additive PEFT methods, such as low-rank adaptation (LoRA), Quantum-PEFT exploits an underlying full-rank yet…

Machine Learning · Computer Science 2025-03-10 Toshiaki Koike-Akino , Francesco Tonin , Yongtao Wu , Frank Zhengqing Wu , Leyla Naz Candogan , Volkan Cevher

Low-Rank Adaptation (LoRA) and other parameter-efficient fine-tuning (PEFT) methods provide low-memory, storage-efficient solutions for personalizing text-to-image models. However, these methods offer little to no improvement in wall-clock…

Machine Learning · Computer Science 2024-12-04 Ethan Smith , Rami Seid , Alberto Hojel , Paramita Mishra , Jianbo Wu

State-of-the-art computer vision tasks, like monocular depth estimation (MDE), rely heavily on large, modern Transformer-based architectures. However, their application in safety-critical domains demands reliable predictive performance and…

Computer Vision and Pattern Recognition · Computer Science 2024-09-26 Richard D. Paul , Alessio Quercia , Vincent Fortuin , Katharina Nöh , Hanno Scharr

Model training requires significantly more memory, compared with inference. Parameter efficient fine-tuning (PEFT) methods provide a means of adapting large models to downstream tasks using less memory. However, existing methods such as…

Machine Learning · Computer Science 2024-07-11 Marawan Gamal Abdel Hameed , Aristides Milios , Siva Reddy , Guillaume Rabusseau

Parameter-Efficient Fine-Tuning (PEFT) has become an essential approach for adapting large-scale pre-trained models while reducing computational costs. Among PEFT methods, LoRA significantly reduces trainable parameters by decomposing…

Computation and Language · Computer Science 2025-03-31 Jiancheng Zhao , Xingda Yu , Zhen Yang

Parameter-efficient fine-tuning (PEFT) has become a standard approach for adapting large pre-trained models. Amongst PEFT methods, low-rank adaptation (LoRA) has achieved notable success. However, recent studies have highlighted its…

Machine Learning · Computer Science 2025-08-04 Paul Albert , Frederic Z. Zhang , Hemanth Saratchandran , Anton van den Hengel , Ehsan Abbasnejad

Parameter efficient fine tuning (PEFT) is a versatile and extensible approach for adapting a Large Language Model (LLM) for newer tasks. One of the most prominent PEFT approaches, Low Rank Adaptation (LoRA), primarily focuses on adjusting…

Machine Learning · Computer Science 2025-07-22 Harsh Nilesh Pathak , Randy Paffenroth

Large language models (LLMs) have demonstrated remarkable performance across various downstream tasks. However, the high computational and memory requirements of LLMs are a major bottleneck. To address this, parameter-efficient fine-tuning…

Computation and Language · Computer Science 2024-10-29 Rambod Azimi , Rishav Rishav , Marek Teichmann , Samira Ebrahimi Kahou

Personalized large language models (LLMs) tailor content to individual preferences using user profiles or histories. However, existing parameter-efficient fine-tuning (PEFT) methods, such as the ``One-PEFT-Per-User'' (OPPU) paradigm,…

Computation and Language · Computer Science 2025-10-21 Zhaoxuan Tan , Zixuan Zhang , Haoyang Wen , Zheng Li , Rongzhi Zhang , Pei Chen , Fengran Mo , Zheyuan Liu , Qingkai Zeng , Qingyu Yin , Meng Jiang

Finetuning language models (LMs) is crucial for adapting the models to downstream data and tasks. However, full finetuning is usually costly. Existing work, such as parameter-efficient finetuning (PEFT), often focuses on \textit{how to…

Computation and Language · Computer Science 2025-06-03 Jian Gu , Aldeida Aleti , Chunyang Chen , Hongyu Zhang

Fine-tuning large language models (LLMs) often causes overfitting to specific prompt wording, where minor phrasing variations drastically reduce performance. To address this, we propose Prompt-Agnostic Fine-Tuning (PAFT), a method that…

Computation and Language · Computer Science 2025-10-20 Chenxing Wei , Yao Shu , Mingwen Ou , Ying Tiffany He , Fei Richard Yu

This paper introduces an efficient strategy to transform Large Language Models (LLMs) into Multi-Modal Large Language Models (MLLMs). By conceptualizing this transformation as a domain adaptation process, i.e., transitioning from text…

Computation and Language · Computer Science 2023-12-19 Bingchen Zhao , Haoqin Tu , Chen Wei , Jieru Mei , Cihang Xie

Large Language Models (LLMs) have transformed both everyday life and scientific research. However, adapting LLMs from general-purpose models to specialized tasks remains challenging, particularly in resource-constrained environments.…

Machine Learning · Computer Science 2025-09-12 Hao Zhang , Bo Huang , Zhenjia Li , Xi Xiao , Hui Yi Leong , Zumeng Zhang , Xinwei Long , Tianyang Wang , Hao Xu

Federated fine-tuning (FedFT) has been proposed to fine-tune the pre-trained language models in a distributed manner. However, there are two critical challenges for efficient FedFT in practical applications, i.e., resource constraints and…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-12-31 Jun Liu , Yunming Liao , Hongli Xu , Yang Xu , Jianchun Liu , Chen Qian

Large models represent a groundbreaking advancement in multiple application fields, enabling remarkable achievements across various tasks. However, their unprecedented scale comes with significant computational costs. These models, often…

Machine Learning · Computer Science 2024-09-17 Zeyu Han , Chao Gao , Jinyang Liu , Jeff Zhang , Sai Qian Zhang