English
Related papers

Related papers: Evaluating Prompts Across Multiple Choice Tasks In…

200 papers

Recent studies have demonstrated that natural-language prompts can help to leverage the knowledge learned by pre-trained language models for the binary sentence-level sentiment classification task. Specifically, these methods utilize…

Computation and Language · Computer Science 2023-07-04 Mohna Chakraborty , Adithya Kulkarni , Qi Li

Large language models have recently been shown to attain reasonable zero-shot generalization on a diverse set of tasks (Brown et al., 2020). It has been hypothesized that this is a consequence of implicit multitask learning in language…

Prevailing methods for mapping large generative language models to supervised tasks may fail to sufficiently probe models' novel capabilities. Using GPT-3 as a case study, we show that 0-shot prompts can significantly outperform few-shot…

Computation and Language · Computer Science 2021-02-16 Laria Reynolds , Kyle McDonell

The remarkable advancements in large language models (LLMs) have brought about significant improvements in Natural Language Processing(NLP) tasks. This paper presents a comprehensive review of in-context learning techniques, focusing on…

Computation and Language · Computer Science 2023-09-26 Yinheng Li

One of the most impressive results of recent NLP history is the ability of pre-trained language models to solve new tasks in a zero-shot setting. To achieve this, NLP tasks are framed as natural language prompts, generating a response…

Computation and Language · Computer Science 2022-12-29 Chunting Zhou , Junxian He , Xuezhe Ma , Taylor Berg-Kirkpatrick , Graham Neubig

The latest generation of LLMs can be prompted to achieve impressive zero-shot or few-shot performance in many NLP tasks. However, since performance is highly sensitive to the choice of prompts, considerable effort has been devoted to…

Computation and Language · Computer Science 2023-11-06 Alina Leidinger , Robert van Rooij , Ekaterina Shutova

Current methods for prompt learning in zeroshot scenarios widely rely on a development set with sufficient human-annotated data to select the best-performing prompt template a posteriori. This is not ideal because in a realworld zero-shot…

Computation and Language · Computer Science 2023-05-17 Jinghui Lu , Dongsheng Zhu , Weidong Han , Rui Zhao , Brian Mac Namee , Fei Tan

Prompting is a common approach for leveraging LMs in zero-shot settings. However, the underlying mechanisms that enable LMs to perform diverse tasks without task-specific supervision remain poorly understood. Studying the relationship…

Computation and Language · Computer Science 2025-10-23 Cesar Gonzalez-Gutierrez , Dirk Hovy

Prompt-based models have gathered a lot of attention from researchers due to their remarkable advancements in the fields of zero-shot and few-shot learning. Developing an effective prompt template plays a critical role. However, prior…

Computation and Language · Computer Science 2024-07-01 Junyu Mao , Stuart E. Middleton , Mahesan Niranjan

Recently, a boom of papers has shown extraordinary progress in zero-shot and few-shot learning with various prompt-based models. It is commonly argued that prompts help models to learn faster in the same way that humans learn faster when…

Computation and Language · Computer Science 2022-04-22 Albert Webson , Ellie Pavlick

Language models can be prompted to perform a wide variety of zero- and few-shot learning problems. However, performance varies significantly with the choice of prompt, and we do not yet understand why this happens or how to pick the best…

Computation and Language · Computer Science 2024-09-16 Hila Gonen , Srini Iyer , Terra Blevins , Noah A. Smith , Luke Zettlemoyer

Massively Multilingual Transformer based Language Models have been observed to be surprisingly effective on zero-shot transfer across languages, though the performance varies from language to language depending on the pivot language(s) used…

Computation and Language · Computer Science 2022-05-13 Kabir Ahuja , Shanu Kumar , Sandipan Dandapat , Monojit Choudhury

Prompting language models (LMs) with training examples and task descriptions has been seen as critical to recent successes in few-shot learning. In this work, we show that finetuning LMs in the few-shot setting can considerably reduce the…

Computation and Language · Computer Science 2021-07-02 Robert L. Logan , Ivana Balažević , Eric Wallace , Fabio Petroni , Sameer Singh , Sebastian Riedel

We propose a multitask pretraining approach ZeroPrompt for zero-shot generalization, focusing on task scaling and zero-shot prompting. While previous models are trained on only a few dozen tasks, we scale to 1,000 tasks for the first time…

Machine Learning · Computer Science 2022-11-01 Hanwei Xu , Yujun Chen , Yulun Du , Nan Shao , Yanggang Wang , Haiyu Li , Zhilin Yang

Thanks to the advanced improvement of large pre-trained language models, prompt-based fine-tuning is shown to be effective on a variety of downstream tasks. Though many prompting methods have been investigated, it remains unknown which type…

Computation and Language · Computer Science 2022-03-03 Sen Yang , Yunchen Zhang , Leyang Cui , Yue Zhang

This paper surveys and organizes research works in a new paradigm in natural language processing, which we dub "prompt-based learning". Unlike traditional supervised learning, which trains a model to take in an input x and predict an output…

Computation and Language · Computer Science 2021-07-30 Pengfei Liu , Weizhe Yuan , Jinlan Fu , Zhengbao Jiang , Hiroaki Hayashi , Graham Neubig

Prompt-based classifiers are an attractive approach for zero-shot classification. However, the precise choice of the prompt template and label words can largely influence performance, with semantically equivalent settings often showing…

Computation and Language · Computer Science 2023-09-12 Adian Liusie , Potsawee Manakul , Mark J. F. Gales

Prompting method is regarded as one of the crucial progress for few-shot nature language processing. Recent research on prompting moves from discrete tokens based ``hard prompts'' to continuous ``soft prompts'', which employ learnable…

Computation and Language · Computer Science 2023-02-06 Yutai Hou , Hongyuan Dong , Xinghao Wang , Bohan Li , Wanxiang Che

Recently introduced language model prompting methods can achieve high accuracy in zero- and few-shot settings while requiring few to no learned task-specific parameters. Nevertheless, these methods still often trail behind full model…

Computation and Language · Computer Science 2022-10-24 Zhaofeng Wu , Robert L. Logan , Pete Walsh , Akshita Bhagia , Dirk Groeneveld , Sameer Singh , Iz Beltagy

Large language models (LLMs) have revolutionized zero-shot task performance, mitigating the need for task-specific annotations while enhancing task generalizability. Despite its advancements, current methods using trigger phrases such as…

Computation and Language · Computer Science 2024-06-13 Saurabh Srivastava , Chengyue Huang , Weiguo Fan , Ziyu Yao
‹ Prev 1 2 3 10 Next ›