English
Related papers

Related papers: Enhancing Parameter-Efficient Fine-Tuning of Visio…

200 papers

Parameter-efficient fine-tuning (PEFT) has emerged as an effective method for adapting pre-trained language models to various tasks efficiently. Recently, there has been a growing interest in transferring knowledge from one or multiple…

Computation and Language · Computer Science 2024-06-07 Zhisheng Lin , Han Fu , Chenghao Liu , Zhuo Li , Jianling Sun

Parameter-Efficient Fine-Tuning (PEFT) has become a dominant paradigm for deploying LLMs in multi-task scenarios due to its extreme parameter efficiency. While Mixture-of-Experts (MoE) based LoRA variants have achieved promising results by…

Computation and Language · Computer Science 2026-03-16 Jia-Chen Zhang , Zhen-Wei Yan , Yu-Jie Xiong , Chun-Ming Xia

Parameter Efficient Fine-Tuning (PEFT) methods are proposed as an alternative fine-tuning approach for Large Language Models (LLM) to minimize high training costs. While prior research demonstrates the effectiveness of PEFT methods in…

Software Engineering · Computer Science 2025-01-28 Amirreza Esmaeili , Iman Saberi , Fatemeh H. Fard

Parameter-efficient fine-tuning (PEFT) methods, such as LoRA, DoRA, and HiRA, enable lightweight adaptation of large pre-trained models via low-rank updates. However, existing PEFT approaches apply static, input-agnostic updates to all…

Machine Learning · Computer Science 2025-12-23 Jie Ou , Shuaihong Jiang , Yingjun Du , Cees G. M. Snoek

Visible-infrared object detection has gained sufficient attention due to its detection performance in low light, fog, and rain conditions. However, visible and infrared modalities captured by different sensors exist the information…

Computer Vision and Pattern Recognition · Computer Science 2025-11-17 Wencong Wu , Xiuwei Zhang , Hanlin Yin , Shun Dai , Hongxi Zhang , Yanning Zhang

Parameter-efficient fine-tuning (PEFT) methods have shown promise in adapting large language models, yet existing approaches exhibit counter-intuitive phenomena: integrating router into prompt tuning (PT) increases training efficiency yet…

Computation and Language · Computer Science 2025-05-15 Zongqian Li , Yixuan Su , Nigel Collier

Parameter efficient fine tuning (PEFT) is a versatile and extensible approach for adapting a Large Language Model (LLM) for newer tasks. One of the most prominent PEFT approaches, Low Rank Adaptation (LoRA), primarily focuses on adjusting…

Machine Learning · Computer Science 2025-07-22 Harsh Nilesh Pathak , Randy Paffenroth

Large language models can now be personalised efficiently at scale using parameter efficient finetuning methods (PEFTs), but serving user-specific PEFTs harms throughput, even with specialised kernels and memory management techniques. This…

Machine Learning · Computer Science 2026-05-15 Andrew Lanpouthakoun , Aryaman Arora , Zhengxuan Wu , Dhruv Pai , Ben Keigwin , Dan Jurafsky , Christopher Potts

Pre-training on large-scale datasets and utilizing margin-based loss functions have been highly successful in training models for high-resolution face recognition. However, these models struggle with low-resolution face datasets, in which…

Computer Vision and Pattern Recognition · Computer Science 2024-12-11 Kartik Narayan , Nithin Gopalakrishnan Nair , Jennifer Xu , Rama Chellappa , Vishal M. Patel

Recent parameter-efficient finetuning (PEFT) techniques aim to improve over the considerable cost of fully finetuning large pretrained language models (PLM). As different PEFT techniques proliferate, it is becoming difficult to compare…

Computation and Language · Computer Science 2023-10-20 Mohammed Sabry , Anya Belz

Parameter-Efficient Fine-Tuning (PEFT) methods have transformed the approach to fine-tuning large models for downstream tasks by enabling the adjustment of significantly fewer parameters than those in the original model matrices. In this…

Computer Vision and Pattern Recognition · Computer Science 2025-03-12 Alessio Quercia , Zhuo Cao , Arya Bangun , Richard D. Paul , Abigail Morrison , Ira Assent , Hanno Scharr

Despite their exceptional performance on various tasks after fine-tuning, pre-trained language models (PLMs) face significant challenges due to growing privacy concerns with data in centralized training methods. We consider federated…

Machine Learning · Computer Science 2024-05-28 Yuxuan Yan , Qianqian Yang , Shunpu Tang , Zhiguo Shi

Parameter-efficient fine-tuning (PEFT) has emerged as a powerful paradigm for adapting large-scale pre-trained models to downstream tasks with minimal additional parameters. Among PEFT methods, Low-Rank Adaptation (LoRA) stands out for its…

Machine Learning · Computer Science 2026-02-03 Nghiem T. Diep , Dung Le , Tuan Truong , Tan Dinh , Huy Nguyen , Nhat Ho

Modern large language models become multimodal, analyzing various data formats like text and images. While fine-tuning is effective for adapting these multimodal language models (MLMs) to downstream tasks, full fine-tuning is…

Computation and Language · Computer Science 2025-12-01 Alexander Sergeev , Evgeny Kotelnikov

Fine-tuning large language models (LLM) can be costly. Parameter-efficient fine-tuning (PEFT) addresses the problems by training a fraction of the parameters, whose success reveals the expressiveness and flexibility of pretrained models.…

Machine Learning · Computer Science 2024-05-07 Jing Xu , Jingzhao Zhang

With the surge in digital content in low-resource languages, there is an escalating demand for advanced Natural Language Processing (NLP) techniques tailored to these languages. BERT (Bidirectional Encoder Representations from…

Computation and Language · Computer Science 2024-08-07 Pranita Deshmukh , Nikita Kulkarni , Sanhita Kulkarni , Kareena Manghani , Raviraj Joshi

Adapting models pre-trained on large-scale datasets is a proven way to reach strong performance quickly for down-stream tasks. However, the growth of state-of-the-art mod-els makes traditional full fine-tuning unsuitable and difficult,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Maxime Fontana , Michael Spratling , Miaojing Shi

The Fast Fourier Transform(FFT) is a classic signal processing algorithm that is utilized in a wide range of applications. For image processing, FFT computes on every pixel's value of an image, regardless of their properties in frequency…

Signal Processing · Electrical Eng. & Systems 2020-02-25 Sheng Shi , Runkai Yang , Haihang You

Fine-tuning large language models is essential for task-specific adaptation, yet it remains computationally prohibitive. Parameter-Efficient Fine-Tuning (PEFT) methods have emerged as a solution, but current approaches typically ignore the…

Computation and Language · Computer Science 2025-12-01 Dayan Pan , Jingyuan Wang , Yilong Zhou , Jiawei Cheng , Pengyue Jia , Xiangyu Zhao

The emergence of large pre-trained networks has revolutionized the AI field, unlocking new possibilities and achieving unprecedented performance. However, these models inherit a fundamental limitation from traditional Machine Learning…