English
Related papers

Related papers: TR-PTS: Task-Relevant Parameter and Token Selectio…

200 papers

Prompt tuning is a parameter-efficient way to deploy large-scale pre-trained models to downstream tasks by adding task-specific tokens. In terms of vision-language pre-trained (VLP) models, prompt tuning often requires a large number of…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Qiong Wu , Shubin Huang , Yiyi Zhou , Pingyang Dai , Annan Shu , Guannan Jiang , Rongrong Ji

Pre-trained language models (PLMs) have ignited a surge in demand for effective fine-tuning techniques, particularly in low-resource domains and languages. Active learning (AL), a set of algorithms designed to decrease labeling costs by…

Computation and Language · Computer Science 2023-10-24 Josip Jukić , Jan Šnajder

Parameter-efficient finetuning (PEFT) methods seek to adapt large neural models via updates to a small number of weights. However, much prior interpretability work has shown that representations encode rich semantic information, suggesting…

Computation and Language · Computer Science 2024-05-24 Zhengxuan Wu , Aryaman Arora , Zheng Wang , Atticus Geiger , Dan Jurafsky , Christopher D. Manning , Christopher Potts

In the realm of Medical Visual Language Models (Med-VLMs), the quest for universal efficient fine-tuning mechanisms remains paramount, especially given researchers in interdisciplinary fields are often extremely short of training resources,…

Computer Vision and Pattern Recognition · Computer Science 2024-04-26 Jiawei Chen , Dingkang Yang , Yue Jiang , Mingcheng Li , Jinjie Wei , Xiaolu Hou , Lihua Zhang

Recent efforts to scale Transformer models have demonstrated rapid progress across a wide range of tasks (Wei et al., 2022). However, fine-tuning these models for downstream tasks is expensive due to their large parameter counts.…

Parameter-Efficient Transfer Learning (PETL) aims at efficiently adapting large models pre-trained on massive data to downstream tasks with limited task-specific data. In view of the practicality of PETL, previous works focus on tuning a…

Computer Vision and Pattern Recognition · Computer Science 2023-03-15 Hengyuan Zhao , Hao Luo , Yuyang Zhao , Pichao Wang , Fan Wang , Mike Zheng Shou

Packing for Supervised Fine-Tuning (SFT) in autoregressive models involves concatenating data points of varying lengths until reaching the designed maximum length to facilitate GPU processing. However, randomly concatenating data points can…

Machine Learning · Computer Science 2025-02-27 Jiancheng Dong , Lei Jiang , Wei Jin , Lu Cheng

This paper introduces Quantum-PEFT that leverages quantum computations for parameter-efficient fine-tuning (PEFT). Unlike other additive PEFT methods, such as low-rank adaptation (LoRA), Quantum-PEFT exploits an underlying full-rank yet…

Machine Learning · Computer Science 2025-03-10 Toshiaki Koike-Akino , Francesco Tonin , Yongtao Wu , Frank Zhengqing Wu , Leyla Naz Candogan , Volkan Cevher

Representation Fine-tuning (ReFT), a recently proposed Parameter-Efficient Fine-Tuning (PEFT) method, has attracted widespread attention for significantly improving parameter efficiency by editing representation space alone. In this work,…

Computation and Language · Computer Science 2025-07-15 Chenxi Huang , Shaotian Yan , Liang Xie , Binbin Lin , Sinan Fan , Yue Xin , Deng Cai , Chen Shen , Jieping Ye

Continual table semantic parsing aims to train a parser on a sequence of tasks, where each task requires the parser to translate natural language into SQL based on task-specific tables but only offers limited training examples. Conventional…

Computation and Language · Computer Science 2023-10-10 Yongrui Chen , Shenyu Zhang , Guilin Qi , Xinnan Guo

The entry of large language models (LLMs) into research and commercial spaces has led to a trend of ever-larger models, with initial promises of generalisability, followed by a widespread desire to downsize and create specialised models…

Computation and Language · Computer Science 2024-02-19 Niall Taylor , Upamanyu Ghose , Omid Rohanian , Mohammadmahdi Nouriborji , Andrey Kormilitzin , David Clifton , Alejo Nevado-Holgado

Parameter-efficient fine-tuning (PEFT) has shown its effectiveness in adapting the pre-trained language models to downstream tasks while only updating a small number of parameters. Despite the success, most existing methods independently…

Computation and Language · Computer Science 2023-11-14 Hao Zhao , Jie Fu , Zhaofeng He

Parameter-Efficient Fine-Tuning (PEFT) and Retrieval-Augmented Generation (RAG) have become popular methods for adapting large language models while minimizing compute requirements. In this paper, we apply PEFT methods (P-tuning, Adapters,…

Computation and Language · Computer Science 2024-10-28 Aleksander Ficek , Jiaqi Zeng , Oleksii Kuchaiev

Parameter efficient transfer learning (PETL) is an emerging research spot that aims to adapt large-scale pre-trained models to downstream tasks. Recent advances have achieved great success in saving storage and computation costs. However,…

Computer Vision and Pattern Recognition · Computer Science 2023-09-13 Chunqing Ruan , Hongjian Wang

Self-supervised representation learning for point cloud has demonstrated effectiveness in improving pre-trained model performance across diverse tasks. However, as pre-trained models grow in complexity, fully fine-tuning them for downstream…

Computer Vision and Pattern Recognition · Computer Science 2025-05-28 Song Wang , Xiaolu Liu , Lingdong Kong , Jianyun Xu , Chunyong Hu , Gongfan Fang , Wentong Li , Jianke Zhu , Xinchao Wang

Time Series Foundation Models (TSFMs) have recently garnered attention for their ability to model complex, large-scale time series data across domains such as retail, finance, and transportation. However, their application to sensitive,…

Machine Learning · Computer Science 2024-09-18 Divij Gupta , Anubhav Bhatti , Surajsinh Parmar

The fine-tuning of Large Language Models (LLMs) is pivotal for achieving optimal performance across diverse downstream tasks. However, while full fine-tuning delivers superior results, it entails significant computational and resource…

Computation and Language · Computer Science 2025-01-15 Yao Liang , Yuwei Wang , Yi Zeng

It has become a popular paradigm to transfer the knowledge of large-scale pre-trained models to various downstream tasks via fine-tuning the entire model parameters. However, with the growth of model scale and the rising number of…

Machine Learning · Computer Science 2023-05-18 Anchun Gui , Jinqiang Ye , Han Xiao

Feature transformation plays a critical role in enhancing machine learning model performance by optimizing data representations. Recent state-of-the-art approaches address this task as a continuous embedding optimization problem, converting…

Machine Learning · Computer Science 2025-08-29 Yang Gao , Dongjie Wang , Scott Piersall , Ye Zhang , Liqiang Wang

Popular PEFT methods reduce trainable parameter count for fine-tuning by parameterizing new low-rank or sparse trainable weights in parallel to the frozen pre-trained weights $W$. However, these weights are trained from scratch, and there…

Machine Learning · Computer Science 2025-08-15 Suhas G Hegde , Shilpy Kaur , Aruna Tiwari