English
Related papers

Related papers: Introducing Routing Functions to Vision-Language P…

200 papers

The fine-tuning of Large Language Models (LLMs) is pivotal for achieving optimal performance across diverse downstream tasks. However, while full fine-tuning delivers superior results, it entails significant computational and resource…

Computation and Language · Computer Science 2025-01-15 Yao Liang , Yuwei Wang , Yi Zeng

Fine-tuning large-scale pre-trained models is inherently a resource-intensive task. While it can enhance the capabilities of the model, it also incurs substantial computational costs, posing challenges to the practical application of…

Computation and Language · Computer Science 2024-06-27 Yulong Mao , Kaiyu Huang , Changhao Guan , Ganglin Bao , Fengran Mo , Jinan Xu

Adapting pre-trained vision models using parameter-efficient fine-tuning (PEFT) remains challenging, as it aims to achieve performance comparable to full fine-tuning using a minimal number of trainable parameters. When applied to complex…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Meng Lou , Stanley Yu , Yizhou Yu

Parameter Efficient Fine-Tuning (PEFT) offers an efficient solution for fine-tuning large pretrained language models for downstream tasks. However, most PEFT strategies are manually designed, often resulting in suboptimal performance.…

Computation and Language · Computer Science 2024-10-15 Aofei Chang , Jiaqi Wang , Han Liu , Parminder Bhatia , Cao Xiao , Ting Wang , Fenglong Ma

The rise of Artificial Intelligence (AI)-and particularly Large Language Models (LLMs) for code-has reshaped Software Engineering (SE) by enabling the automation of tasks such as code generation, bug detection, and repair. However, these…

Software Engineering · Computer Science 2025-08-18 Saima Afrin , Md Zahidul Haque , Antonio Mastropaolo

With the rise of cloud-edge collaboration, recommendation services are increasingly trained in distributed environments. Federated Recommendation (FR) enables such multi-end collaborative training while preserving privacy by sharing model…

Machine Learning · Computer Science 2025-12-17 Haochen Yuan , Yang Zhang , Xiang He , Quan Z. Sheng , Zhongjie Wang

Parameter-efficient fine-tuning (PEFT) of pre-trained foundation models is increasingly attracting interest in medical imaging due to its effectiveness and computational efficiency. Among these methods, Low-Rank Adaptation (LoRA) is a…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 Ghassen Baklouti , Julio Silva-Rodríguez , Jose Dolz , Houda Bahig , Ismail Ben Ayed

The rapid development of large language models has revolutionized natural language processing, but their fine-tuning remains computationally expensive, hindering broad deployment. Parameter-efficient fine-tuning (PEFT) methods, such as…

Machine Learning · Computer Science 2025-05-30 Chongjie Si , Zhiyi Shi , Yadao Wang , Xiaokang Yang , Susanto Rahardja , Wei Shen

This study explores the fine-tuning (FT) of the Open Pre-trained Transformer (OPT-125M) for grammatical acceptability tasks using the CoLA dataset. By comparing Vanilla-Fine-Tuning (VFT), Pattern-Based-Fine-Tuning (PBFT), and…

Computation and Language · Computer Science 2025-01-15 Shobhit Ratan , Farley Knight , Ghada Jerfel , Sze Chung Ho

Parameter efficient transfer learning (PETL) aims at making good use of the representation knowledge in the pre-trained large models by fine-tuning a small number of parameters. Recently, taking inspiration from the natural language…

Computer Vision and Pattern Recognition · Computer Science 2023-03-03 Bruce X. B. Yu , Jianlong Chang , Lingbo Liu , Qi Tian , Chang Wen Chen

With the scale of vision Transformer-based models continuing to grow, finetuning these large-scale pretrained models for new tasks has become increasingly parameter-intensive. Visual prompt tuning is introduced as a parameter-efficient…

Computer Vision and Pattern Recognition · Computer Science 2024-11-19 Runjia Zeng , Cheng Han , Qifan Wang , Chunshu Wu , Tong Geng , Lifu Huang , Ying Nian Wu , Dongfang Liu

Parameter-efficient fine-tuning (PEFT) techniques have emerged to address overfitting and high computational costs associated with fully fine-tuning in self-supervised learning. Mainstream PEFT methods add a few trainable parameters while…

Computer Vision and Pattern Recognition · Computer Science 2025-06-06 Xingliang Lei , Yiwen Ye , Zhisong Wang , Ziyang Chen , Minglei Shu , Weidong Cai , Yanning Zhang , Yong Xia

Low-Rank Adaptation (LoRA) is a widely adopted parameter-efficient fine-tuning (PEFT) method validated across NLP and CV domains. However, LoRA faces an inherent low-rank bottleneck: narrowing its performance gap with full finetuning…

Machine Learning · Computer Science 2025-12-03 Haonan Dong , Wenhao Zhu , Guojie Song , Liang Wang

Parameter Efficient Fine-Tuning (PEFT) methods have been extensively utilized in Large Language Models (LLMs) to improve the down-streaming tasks without the cost of fine-tuing the whole LLMs. Recent studies have shown how to effectively…

Computation and Language · Computer Science 2024-04-15 Zhiyuan Peng , Xuyang Wu , Qifan Wang , Sravanthi Rajanala , Yi Fang

Aligning features from different modalities, is one of the most fundamental challenges for cross-modal tasks. Although pre-trained vision-language models can achieve a general alignment between image and text, they often require…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Ziqi Jiang , Yanghao Wang , Long Chen

Low-rank adaptation (LoRA) and its mixture-of-experts (MOE) variants are highly effective parameter-efficient fine-tuning (PEFT) methods. However, they introduce significant latency in multi-tenant settings due to the LoRA modules and MOE…

Computation and Language · Computer Science 2024-10-24 Jingfan Zhang , Yi Zhao , Dan Chen , Xing Tian , Huanran Zheng , Wei Zhu

Vision-Language Continual Learning (VLCL) has attracted significant research attention for its robust capabilities, and the adoption of Parameter-Efficient Fine-Tuning (PEFT) strategies is enabling these models to achieve competitive…

Computer Vision and Pattern Recognition · Computer Science 2026-01-12 Ziwei Liu , Borui Kang , Wei Li , Hangjie Yuan , Yanbing Yang , Wenbin Li , Yifan Zhu , Tao Feng , Jun Luo

Fine-tuning large language models (LLMs) remains a computational bottleneck due to their scale and memory demands. This paper presents a comprehensive evaluation of parameter-efficient fine-tuning (PEFT) techniques, including LoRA, BOFT,…

Computation and Language · Computer Science 2026-01-06 Haomin Qi , Zihan Dai , Chengbo Huang

Parameter-efficient fine-tuning (PEFT) has become a common method for fine-tuning large language models, where a base model can serve multiple users through PEFT module switching. To enhance user experience, base models require periodic…

Computation and Language · Computer Science 2025-06-10 Naibin Gu , Peng Fu , Xiyu Liu , Ke Ma , Zheng Lin , Weiping Wang

Parameter-efficient fine-tuning (PEFT) methods, which fine-tune only a subset of model parameters, offer a promising solution by reducing the computational costs of tuning large language models (LLMs) while maintaining their performance.…

Software Engineering · Computer Science 2025-11-25 André Storhaug , Jingyue Li