English
Related papers

Related papers: Exploring Embedding Priors in Prompt-Tuning for Im…

200 papers

As a novel approach to tuning pre-trained models, prompt tuning involves freezing the parameters in downstream tasks while inserting trainable embeddings into inputs in the first layer. However, previous methods have mainly focused on the…

Computation and Language · Computer Science 2023-05-16 Chi Liu , Haochun Wang , Nuwa Xi , Sendong Zhao , Bing Qin

In this work, we explore "prompt tuning", a simple yet effective mechanism for learning "soft prompts" to condition frozen language models to perform specific downstream tasks. Unlike the discrete text prompts used by GPT-3, soft prompts…

Computation and Language · Computer Science 2021-09-03 Brian Lester , Rami Al-Rfou , Noah Constant

Fine-tuned pre-trained language models (PLMs) have achieved awesome performance on almost all NLP tasks. By using additional prompts to fine-tune PLMs, we can further stimulate the rich knowledge distributed in PLMs to better serve…

Computation and Language · Computer Science 2021-09-16 Xu Han , Weilin Zhao , Ning Ding , Zhiyuan Liu , Maosong Sun

Prompting large language models has gained immense popularity in recent years due to the advantage of producing good results even without the need for labelled data. However, this requires prompt tuning to get optimal prompts that lead to…

Computation and Language · Computer Science 2024-03-06 Jacob-Junqi Tian , David Emerson , Sevil Zanjani Miyandoab , Deval Pandya , Laleh Seyyed-Kalantari , Faiza Khan Khattak

Large language models (LLMs) sometimes fail to respond appropriately to deterministic tasks -- such as counting or forming acronyms -- because the implicit prior distribution they have learned over sequences of tokens influences their…

Computation and Language · Computer Science 2025-04-18 Liyi Zhang , Veniamin Veselovsky , R. Thomas McCoy , Thomas L. Griffiths

Prompting has become a practical method for utilizing pre-trained language models (LMs). This approach offers several advantages. It allows an LM to adapt to new tasks with minimal training and parameter updates, thus achieving efficiency…

Audio and Speech Processing · Electrical Eng. & Systems 2024-08-26 Kai-Wei Chang , Haibin Wu , Yu-Kai Wang , Yuan-Kuei Wu , Hua Shen , Wei-Cheng Tseng , Iu-thing Kang , Shang-Wen Li , Hung-yi Lee

Prompt learning has emerged as an efficient alternative to fine-tuning pre-trained vision-language models (VLMs). Despite its promise, current methods still struggle to maintain tail-class discriminability when adapting to class-imbalanced…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Boyang Guo , Liang Li , Lin Peng , Yuhan Gao , Xichun Sheng , Chenggang Yan

Prompting a pretrained language model with natural language patterns has been proved effective for natural language understanding (NLU). However, our preliminary study reveals that manual discrete prompts often lead to unstable performance…

Computation and Language · Computer Science 2023-10-26 Xiao Liu , Yanan Zheng , Zhengxiao Du , Ming Ding , Yujie Qian , Zhilin Yang , Jie Tang

Recently, CLIP-based approaches have exhibited remarkable performance on generalization and few-shot learning tasks, fueled by the power of contrastive language-vision pre-training. In particular, prompt tuning has emerged as an effective…

Computer Vision and Pattern Recognition · Computer Science 2024-01-17 Balamurali Murugesan , Rukhshanda Hussain , Rajarshi Bhattacharya , Ismail Ben Ayed , Jose Dolz

Pretrained language models have achieved state-of-the-art performance when adapted to a downstream NLP task. However, theoretical analysis of these models is scarce and challenging since the pretraining and downstream tasks can be very…

Machine Learning · Computer Science 2022-04-22 Colin Wei , Sang Michael Xie , Tengyu Ma

Prompt Tuning (PT) enables the adaptation of Pre-trained Large Language Models (PLMs) to downstream tasks by optimizing a small amount of soft virtual tokens, which are prepended to the input token embeddings. Recently, Decomposed Prompt…

Computation and Language · Computer Science 2025-12-23 Pengwei Tang , Xiaolin Hu , Yong Liu

We propose structured prompt tuning, a simple and effective method to improve prompt tuning. Instead of prepending a sequence of tunable embeddings to the input, we generate the soft prompt embeddings through a hypernetwork. Our approach…

Computation and Language · Computer Science 2022-05-26 Chi-Liang Liu , Hung-yi Lee , Wen-tau Yih

The large language models have achieved superior performance on various natural language tasks. One major drawback of such approaches is they are resource-intensive in fine-tuning new datasets. Soft-prompt tuning presents a…

Computation and Language · Computer Science 2023-10-30 Guoxin Chen , Yiming Qian , Bowen Wang , Liangzhi Li

Why can pre-trained language models (PLMs) learn universal representations and effectively adapt to broad NLP tasks differing a lot superficially? In this work, we empirically find evidence indicating that the adaptations of PLMs to various…

Computation and Language · Computer Science 2022-11-28 Yujia Qin , Xiaozhi Wang , Yusheng Su , Yankai Lin , Ning Ding , Jing Yi , Weize Chen , Zhiyuan Liu , Juanzi Li , Lei Hou , Peng Li , Maosong Sun , Jie Zhou

Prompt engineering has emerged as an indispensable technique for extending the capabilities of large language models (LLMs) and vision-language models (VLMs). This approach leverages task-specific instructions, known as prompts, to enhance…

Artificial Intelligence · Computer Science 2025-03-18 Pranab Sahoo , Ayush Kumar Singh , Sriparna Saha , Vinija Jain , Samrat Mondal , Aman Chadha

We lack a systematic understanding of the effects of fine-tuning (via methods such as instruction-tuning or reinforcement learning from human feedback), particularly on tasks outside the narrow fine-tuning distribution. In a simplified…

Computation and Language · Computer Science 2024-04-16 Suhas Kotha , Jacob Mitchell Springer , Aditi Raghunathan

Large language models achieve state-of-the-art performance but are increasingly costly to fine-tune. Prompt tuning is a parameter-efficient fine-tuning method that addresses parameter-efficiency by learning prompt embeddings, but these…

Computation and Language · Computer Science 2026-04-14 Zijun Wu , Yongchang Hao , Lili Mou

Adapting pre-trained models to open classes is a challenging problem in machine learning. Vision-language models fully explore the knowledge of text modality, demonstrating strong zero-shot recognition performance, which is naturally suited…

Computer Vision and Pattern Recognition · Computer Science 2024-08-30 Zhengqing Gao , Xiang Ao , Xu-Yao Zhang , Cheng-Lin Liu

Prompt-based fine-tuning has boosted the performance of Pre-trained Language Models (PLMs) on few-shot text classification by employing task-specific prompts. Yet, PLMs are unfamiliar with prompt-style expressions during pre-training, which…

Computation and Language · Computer Science 2022-05-12 Jianing Wang , Chengyu Wang , Fuli Luo , Chuanqi Tan , Minghui Qiu , Fei Yang , Qiuhui Shi , Songfang Huang , Ming Gao

Recent works have shown promising results of prompt tuning in stimulating pre-trained language models (PLMs) for natural language processing (NLP) tasks. However, to the best of our knowledge, existing works focus on prompt-tuning…

Computation and Language · Computer Science 2022-05-24 Yuan Yao , Bowen Dong , Ao Zhang , Zhengyan Zhang , Ruobing Xie , Zhiyuan Liu , Leyu Lin , Maosong Sun , Jianyong Wang