English
Related papers

Related papers: Improving Prompt Tuning with Learned Prompting Lay…

200 papers

Prompt tuning, a parameter- and data-efficient transfer learning paradigm that tunes only a small number of parameters in a model's input space, has become a trend in the vision community since the emergence of large vision-language models…

Computer Vision and Pattern Recognition · Computer Science 2022-10-14 Yuhang Zang , Wei Li , Kaiyang Zhou , Chen Huang , Chen Change Loy

There has been growing interest in parameter-efficient methods to apply pre-trained language models to downstream tasks. Building on the Prompt Tuning approach of Lester et al. (2021), which learns task-specific soft prompts to condition a…

Computation and Language · Computer Science 2022-03-18 Tu Vu , Brian Lester , Noah Constant , Rami Al-Rfou , Daniel Cer

Prompt tuning (PT), where a small amount of trainable soft (continuous) prompt vectors is affixed to the input of language models (LM), has shown promising results across various tasks and models for parameter-efficient fine-tuning (PEFT).…

Computation and Language · Computer Science 2024-02-20 Zhengxiang Shi , Aldo Lipani

Prompt Tuning (PT) enables the adaptation of Pre-trained Large Language Models (PLMs) to downstream tasks by optimizing a small amount of soft virtual tokens, which are prepended to the input token embeddings. Recently, Decomposed Prompt…

Computation and Language · Computer Science 2025-12-23 Pengwei Tang , Xiaolin Hu , Yong Liu

Prompt tuning is a technology that tunes a small set of parameters to steer a pre-trained language model (LM) to directly generate the output for downstream tasks. Recently, prompt tuning has demonstrated its storage and computation…

Audio and Speech Processing · Electrical Eng. & Systems 2023-03-02 Kai-Wei Chang , Yu-Kai Wang , Hua Shen , Iu-thing Kang , Wei-Cheng Tseng , Shang-Wen Li , Hung-yi Lee

In this work, we explore "prompt tuning", a simple yet effective mechanism for learning "soft prompts" to condition frozen language models to perform specific downstream tasks. Unlike the discrete text prompts used by GPT-3, soft prompts…

Computation and Language · Computer Science 2021-09-03 Brian Lester , Rami Al-Rfou , Noah Constant

Foundation models pre-trained on large-scale data have been widely witnessed to achieve success in various natural imaging downstream tasks. Parameter-efficient fine-tuning (PEFT) methods aim to adapt foundation models to new domains by…

Computer Vision and Pattern Recognition · Computer Science 2025-03-24 Wenqiang Zu , Shenghao Xie , Qing Zhao , Guoqi Li , Lei Ma

We propose structured prompt tuning, a simple and effective method to improve prompt tuning. Instead of prepending a sequence of tunable embeddings to the input, we generate the soft prompt embeddings through a hypernetwork. Our approach…

Computation and Language · Computer Science 2022-05-26 Chi-Liang Liu , Hung-yi Lee , Wen-tau Yih

Speech representations learned from Self-supervised learning (SSL) models can benefit various speech processing tasks. However, utilizing SSL representations usually requires fine-tuning the pre-trained models or designing task-specific…

Audio and Speech Processing · Electrical Eng. & Systems 2022-07-12 Kai-Wei Chang , Wei-Cheng Tseng , Shang-Wen Li , Hung-yi Lee

In this paper, we introduce Attention Prompt Tuning (APT) - a computationally efficient variant of prompt tuning for video-based applications such as action recognition. Prompt tuning approaches involve injecting a set of learnable prompts…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Wele Gedara Chaminda Bandara , Vishal M. Patel

Prompt tuning is a parameter-efficient way to deploy large-scale pre-trained models to downstream tasks by adding task-specific tokens. In terms of vision-language pre-trained (VLP) models, prompt tuning often requires a large number of…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Qiong Wu , Shubin Huang , Yiyi Zhou , Pingyang Dai , Annan Shu , Guannan Jiang , Rongrong Ji

Prompt-based methods have achieved promising results in most few-shot text classification tasks. However, for readability assessment tasks, traditional prompt methods lackcrucial linguistic knowledge, which has already been proven to be…

Computation and Language · Computer Science 2024-04-11 Ziyang Wang , Sanwoo Lee , Hsiu-Yuan Huang , Yunfang Wu

Why can pre-trained language models (PLMs) learn universal representations and effectively adapt to broad NLP tasks differing a lot superficially? In this work, we empirically find evidence indicating that the adaptations of PLMs to various…

Computation and Language · Computer Science 2022-11-28 Yujia Qin , Xiaozhi Wang , Yusheng Su , Yankai Lin , Ning Ding , Jing Yi , Weize Chen , Zhiyuan Liu , Juanzi Li , Lei Hou , Peng Li , Maosong Sun , Jie Zhou

Prompt tuning has emerged as a key technique for adapting large pre-trained Decision Transformers (DTs) in offline Reinforcement Learning (RL), particularly in multi-task and few-shot settings. The Prompting Decision Transformer (PDT)…

Machine Learning · Computer Science 2025-10-02 Finn Rietz , Oleg Smirnov , Sara Karimi , Lele Cao

Prompt tuning (PT) is a promising parameter-efficient method to utilize extremely large pre-trained language models (PLMs), which can achieve comparable performance to full-parameter fine-tuning by only tuning a few soft prompts. However,…

Computation and Language · Computer Science 2023-12-19 Yusheng Su , Xiaozhi Wang , Yujia Qin , Chi-Min Chan , Yankai Lin , Huadong Wang , Kaiyue Wen , Zhiyuan Liu , Peng Li , Juanzi Li , Lei Hou , Maosong Sun , Jie Zhou

Pre-trained models have been shown effective in many code intelligence tasks. These models are pre-trained on large-scale unlabeled corpus and then fine-tuned in downstream tasks. However, as the inputs to pre-training and downstream tasks…

Software Engineering · Computer Science 2022-07-26 Chaozheng Wang , Yuanhang Yang , Cuiyun Gao , Yun Peng , Hongyu Zhang , Michael R. Lyu

Recently, prompt tuning \cite{lester2021power} has gradually become a new paradigm for NLP, which only depends on the representation of the words by freezing the parameters of pre-trained language models (PLMs) to obtain remarkable…

Computation and Language · Computer Science 2022-01-31 Pan He , Yuxi Chen , Yan Wang , Yanru Zhang

Prompt-tuning is an emerging strategy to adapt large language models (LLM) to downstream tasks by learning a (soft-)prompt parameter from data. Despite its success in LLMs, there is limited theoretical understanding of the power of…

Machine Learning · Computer Science 2023-06-07 Samet Oymak , Ankit Singh Rawat , Mahdi Soltanolkotabi , Christos Thrampoulidis

Soft prompt tuning achieves superior performances across a wide range of few-shot tasks. However, the performances of prompt tuning can be highly sensitive to the initialization of the prompts. We also empirically observe that conventional…

Computation and Language · Computer Science 2023-06-09 Junda Wu , Tong Yu , Rui Wang , Zhao Song , Ruiyi Zhang , Handong Zhao , Chaochao Lu , Shuai Li , Ricardo Henao

In conversational AI, personalizing dialogues with persona profiles and contextual understanding is essential. Despite large language models' (LLMs) improved response coherence, effective persona integration remains a challenge. In this…

Computation and Language · Computer Science 2024-06-27 Qiushi Huang , Xubo Liu , Tom Ko , Bo Wu , Wenwu Wang , Yu Zhang , Lilian Tang