English
Related papers

Related papers: Exploring Embedding Priors in Prompt-Tuning for Im…

200 papers

Several works have proven that finetuning is an applicable approach for debiasing contextualized word embeddings. Similarly, discrete prompts with semantic meanings have shown to be effective in debiasing tasks. With unfixed mathematical…

Computation and Language · Computer Science 2025-05-27 Ke Yang , Charles Yu , Yi Fung , Manling Li , Heng Ji

Language models (LMs) trained on vast quantities of unlabelled data have greatly advanced the field of natural language processing (NLP). In this study, we re-visit the widely accepted notion in NLP that continued pre-training LMs on…

Computation and Language · Computer Science 2023-10-09 Zhengxiang Shi , Aldo Lipani

Transformer-based Large Language Models (LLMs) have shown exceptional language generation capabilities in response to text-based prompts. However, controlling the direction of generation via textual prompts has been challenging, especially…

Computation and Language · Computer Science 2024-04-09 Rohan Deepak Ajwani , Zining Zhu , Jonathan Rose , Frank Rudzicz

Fine-tuning large language models is becoming ever more impractical due to their rapidly-growing scale. This motivates the use of parameter-efficient adaptation methods such as prompt tuning (PT), which adds a small number of tunable…

Computation and Language · Computer Science 2023-02-23 Simeng Sun , Yang Liu , Dan Iter , Chenguang Zhu , Mohit Iyyer

Soft prompt tuning techniques have recently gained traction as an effective strategy for the parameter-efficient tuning of pretrained language models, particularly minimizing the required adjustment of model parameters. Despite their…

Computation and Language · Computer Science 2024-06-11 MohammadAli SadraeiJavaeri , Ehsaneddin Asgari , Alice Carolyn McHardy , Hamid Reza Rabiee

We investigate whether prompts learned independently for different tasks can be later combined through prompt algebra to obtain a model that supports composition of tasks. We consider Visual Language Models (VLM) with prompt tuning as our…

Computer Vision and Pattern Recognition · Computer Science 2023-06-02 Pramuditha Perera , Matthew Trager , Luca Zancato , Alessandro Achille , Stefano Soatto

Prompt tuning has achieved remarkable progress in vision-language models (VLMs) and is recently being adopted for audio-language models (ALMs). However, its generalization ability in ALMs remains largely underexplored. We observe that…

Sound · Computer Science 2026-04-21 Jaehyuk Jang , Wonjun Lee , Kangwook Ko , Changick Kim

Going beyond mere fine-tuning of vision-language models (VLMs), learnable prompt tuning has emerged as a promising, resource-efficient alternative. Despite their potential, effectively learning prompts faces the following challenges: (i)…

Computer Vision and Pattern Recognition · Computer Science 2024-06-21 Hari Chandana Kuchibhotla , Sai Srinivas Kancheti , Abbavaram Gowtham Reddy , Vineeth N Balasubramanian

Recently, prompt tuning (PT) has gained increasing attention as a parameter-efficient way of tuning pre-trained language models (PLMs). Despite extensively reducing the number of tunable parameters and achieving satisfying performance, PT…

Computation and Language · Computer Science 2022-11-15 Yufei Huang , Yujia Qin , Huadong Wang , Yichun Yin , Maosong Sun , Zhiyuan Liu , Qun Liu

Prompt tuning is a technology that tunes a small set of parameters to steer a pre-trained language model (LM) to directly generate the output for downstream tasks. Recently, prompt tuning has demonstrated its storage and computation…

Audio and Speech Processing · Electrical Eng. & Systems 2023-03-02 Kai-Wei Chang , Yu-Kai Wang , Hua Shen , Iu-thing Kang , Wei-Cheng Tseng , Shang-Wen Li , Hung-yi Lee

In prompt tuning, a prefix or suffix text is added to the prompt, and the embeddings (soft prompts) or token indices (hard prompts) of the prefix/suffix are optimized to gain more control over language models for specific tasks. This…

Computation and Language · Computer Science 2024-07-01 Shouchang Guo , Sonam Damani , Keng-hao Chang

Prompt learning represents a promising method for adapting pre-trained vision-language models (VLMs) to various downstream tasks by learning a set of text embeddings. One challenge inherent to these methods is the poor generalization…

Computer Vision and Pattern Recognition · Computer Science 2024-11-18 Fangming Cui , Xun Yang , Chao Wu , Liang Xiao , Xinmei Tian

Prompt tuning has recently emerged as an effective method for adapting pre-trained language models to a number of language understanding and generation tasks. In this paper, we investigate prompt tuning for semantic parsing -- the task of…

Computation and Language · Computer Science 2022-04-04 Nathan Schucher , Siva Reddy , Harm de Vries

Pre-trained multilingual language models show significant performance gains for zero-shot cross-lingual model transfer on a wide range of natural language understanding (NLU) tasks. Previously, for zero-shot cross-lingual evaluation,…

Computation and Language · Computer Science 2022-12-14 Lifu Tu , Caiming Xiong , Yingbo Zhou

With the emergence of large pre-trained vison-language model like CLIP, transferable representations can be adapted to a wide range of downstream tasks via prompt tuning. Prompt tuning tries to probe the beneficial information for…

Computer Vision and Pattern Recognition · Computer Science 2023-07-10 Yinghui Xing , Qirui Wu , De Cheng , Shizhou Zhang , Guoqiang Liang , Peng Wang , Yanning Zhang

Prompt tuning, or the conditioning of a frozen pretrained language model (PLM) with soft prompts learned from data, has demonstrated impressive performance on a wide range of NLP tasks. However, prompt tuning requires a large training…

Computation and Language · Computer Science 2022-10-24 Xu Guo , Boyang Li , Han Yu

Prompt-based continual learning methods fine-tune only a small set of additional learnable parameters while keeping the pre-trained model's parameters frozen. It enables efficient adaptation to new tasks while mitigating the risk of…

Computer Vision and Pattern Recognition · Computer Science 2026-05-11 Shengqin Jiang , Tianqi Kong , Yuankai Qi , Haokui Zhang , Lina Yao , Quan Z. Sheng , Qingshan Liu , Ming-Hsuan Yang

Prompt learning is effective for fine-tuning foundation models to improve their generalization across a variety of downstream tasks. However, the prompts that are independently optimized along a single modality path, may sacrifice the…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Yuncheng Yang , Chuyan Zhang , Zuopeng Yang , Yuting Gao , Yulei Qin , Ke Li , Xing Sun , Jie Yang , Yun Gu

Prompt tuning is an efficient solution for training large language models (LLMs). However, current soft-prompt-based methods often sacrifice multi-task modularity, requiring the training process to be fully or partially repeated for each…

Computation and Language · Computer Science 2026-05-14 Robert Belanec , Simon Ostermann , Ivan Srba , Maria Bielikova

Pre-trained large language models can efficiently interpolate human-written prompts in a natural way. Multitask prompted learning can help generalization through a diverse set of tasks at once, thus enhancing the potential for more…

Computation and Language · Computer Science 2022-12-22 M Saiful Bari , Aston Zhang , Shuai Zheng , Xingjian Shi , Yi Zhu , Shafiq Joty , Mu Li