English
Related papers

Related papers: What Makes Pre-trained Language Models Better Zero…

200 papers

Pre-trained language models derive substantial linguistic and factual knowledge from the massive corpora on which they are trained, and prompt engineering seeks to align these models to specific tasks. Unfortunately, existing prompt…

The promising zero-shot generalization of vision-language models such as CLIP has led to their adoption using prompt learning for numerous downstream tasks. Previous works have shown test-time prompt tuning using entropy minimization to…

Computer Vision and Pattern Recognition · Computer Science 2024-01-12 Jameel Hassan , Hanan Gani , Noor Hussein , Muhammad Uzair Khattak , Muzammal Naseer , Fahad Shahbaz Khan , Salman Khan

Zero-shot text classification typically relies on prompt engineering, but the inherent prompt brittleness of large language models undermines its reliability. Minor changes in prompt can cause significant discrepancies in model performance.…

Computation and Language · Computer Science 2025-04-07 Junlang Qian , Zixiao Zhu , Hanzhang Zhou , Zijian Feng , Zepeng Zhai , Kezhi Mao

Consistently scaling pre-trained language models (PLMs) imposes substantial burdens on model adaptation, necessitating more efficient alternatives to conventional fine-tuning. Given the advantage of prompting in the zero-shot setting and…

Computation and Language · Computer Science 2023-06-01 Yulin Chen , Ning Ding , Xiaobin Wang , Shengding Hu , Hai-Tao Zheng , Zhiyuan Liu , Pengjun Xie

Leveraging class semantic descriptions and examples of known objects, zero-shot learning makes it possible to train a recognition model for an object class whose examples are not available. In this paper, we propose a novel zero-shot…

Computer Vision and Pattern Recognition · Computer Science 2017-08-22 Soravit Changpinyo , Wei-Lun Chao , Fei Sha

Zero-shot Learners are models capable of predicting unseen classes. In this work, we propose a Zero-shot Learning approach for text categorization. Our method involves training model on a large corpus of sentences to learn the relationship…

Computation and Language · Computer Science 2017-12-27 Pushpankar Kumar Pushp , Muktabh Mayank Srivastava

Recent prompt-based approaches allow pretrained language models to achieve strong performances on few-shot finetuning by reformulating downstream tasks as a language modeling problem. In this work, we demonstrate that, despite its…

Computation and Language · Computer Science 2021-09-10 Prasetya Ajie Utama , Nafise Sadat Moosavi , Victor Sanh , Iryna Gurevych

Few-shot Learning aims to learn and distinguish new categories with a very limited number of available images, presenting a significant challenge in the realm of deep learning. Recent researchers have sought to leverage the additional…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Chunpeng Zhou , Haishuai Wang , Xilu Yuan , Zhi Yu , Jiajun Bu

Zero-shot learning (ZSL) aims to recognize objects of novel classes without any training samples of specific classes, which is achieved by exploiting the semantic information and auxiliary datasets. Recently most ZSL approaches focus on…

Computer Vision and Pattern Recognition · Computer Science 2018-07-25 Huajie Jiang , Ruiping Wang , Shiguang Shan , Xilin Chen

Contrastive Language-Audio Pretraining (CLAP) is pre-trained to associate audio features with human language, making it a natural zero-shot classifier to recognize unseen sound categories. To adapt CLAP to downstream tasks, prior works…

Audio and Speech Processing · Electrical Eng. & Systems 2023-09-18 Yiming Li , Xiangdong Wang , Hong Liu

Prompts for pre-trained language models (PLMs) have shown remarkable performance by bridging the gap between pre-training tasks and various downstream tasks. Among these methods, prompt tuning, which freezes PLMs and only tunes soft…

Computation and Language · Computer Science 2022-03-15 Yuxian Gu , Xu Han , Zhiyuan Liu , Minlie Huang

Prompting methods have shown impressive performance in a variety of text mining tasks and applications, especially few-shot ones. Despite the promising prospects, the performance of prompting model largely depends on the design of prompt…

Computation and Language · Computer Science 2023-06-16 Hongyuan Dong , Weinan Zhang , Wanxiang Che

Large language models have exhibited intriguing in-context learning capability, achieving promising zero- and few-shot performance without updating the parameters. However, conventional in-context learning is usually restricted by length…

Computation and Language · Computer Science 2022-12-14 Yaru Hao , Yutao Sun , Li Dong , Zhixiong Han , Yuxian Gu , Furu Wei

Despite the growing use of large language models (LLMs) for providing feedback, limited research has explored how to achieve high-quality feedback. This case study introduces an evaluation framework to assess different zero-shot prompt…

Software Engineering · Computer Science 2024-12-23 Niklas Ippisch , Anna-Carolina Haensch , Jan Simson , Jacob Beck , Markus Herklotz , Malte Schierholz

This paper explores a simple method for improving the zero-shot learning abilities of language models. We show that instruction tuning -- finetuning language models on a collection of tasks described via instructions -- substantially…

Computation and Language · Computer Science 2022-02-10 Jason Wei , Maarten Bosma , Vincent Y. Zhao , Kelvin Guu , Adams Wei Yu , Brian Lester , Nan Du , Andrew M. Dai , Quoc V. Le

Few-shot learning benchmarks are critical for evaluating modern NLP techniques. It is possible, however, that benchmarks favor methods which easily make use of unlabeled text, because researchers can use unlabeled text from the test set to…

Computation and Language · Computer Science 2024-10-03 Kush Dubey

Improving pretraining data quality and size is known to boost downstream performance, but the role of text complexity--how hard a text is to read--remains less explored. We reduce surface-level complexity (shorter sentences, simpler words,…

Computation and Language · Computer Science 2025-10-07 Dan John Velasco , Matthew Theodore Roque

Learning code representations has been the core prerequisite of many software engineering tasks such as code clone detection and code generation. State-of-the-art program representation techniques mainly utilize pre-trained language models…

Software Engineering · Computer Science 2024-04-16 Nan Cui , Xiaodong Gu , Beijun Shen

Prompt-based learning, with its capability to tackle zero-shot and few-shot NLP tasks, has gained much attention in community. The main idea is to bridge the gap between NLP downstream tasks and language modeling (LM), by mapping these…

Computation and Language · Computer Science 2022-11-21 Yulong Chen , Yang Liu , Li Dong , Shuohang Wang , Chenguang Zhu , Michael Zeng , Yue Zhang

Language model (LM) prompting--a popular paradigm for solving NLP tasks--has been shown to be susceptible to miscalibration and brittleness to slight prompt variations, caused by its discriminative prompting approach, i.e., predicting the…

Computation and Language · Computer Science 2023-11-14 Sachin Kumar , Chan Young Park , Yulia Tsvetkov