English
Related papers

Related papers: Few-shot Prompting for Pairwise Ranking: An Effect…

200 papers

Pairwise Ranking Prompting (PRP) elicits pairwise preference judgments from an LLM, which are then aggregated into a ranking, usually via classical sorting algorithms. However, judgments are noisy, order-sensitive, and sometimes…

Due to their architecture and vast pre-training data, large language models (LLMs) demonstrate strong text classification performance. However, LLM output - here, the category assigned to a text - depends heavily on the wording of the…

Computation and Language · Computer Science 2025-12-04 Kylie L. Anglin , Stephanie Milan , Brittney Hernandez , Claudia Ventura

This paper investigates the effectiveness of pre-training for few-shot intent classification. While existing paradigms commonly further pre-train language models such as BERT on a vast amount of unlabeled corpus, we find it highly effective…

Computation and Language · Computer Science 2024-09-17 Haode Zhang , Yuwei Zhang , Li-Ming Zhan , Jiaxin Chen , Guangyuan Shi , Albert Y. S. Lam , Xiao-Ming Wu

Intent classification (IC) and slot filling (SF) are core components in most goal-oriented dialogue systems. Current IC/SF models perform poorly when the number of training examples per class is small. We propose a new few-shot learning…

Computation and Language · Computer Science 2020-04-24 Jason Krone , Yi Zhang , Mona Diab

Recently introduced language model prompting methods can achieve high accuracy in zero- and few-shot settings while requiring few to no learned task-specific parameters. Nevertheless, these methods still often trail behind full model…

Computation and Language · Computer Science 2022-10-24 Zhaofeng Wu , Robert L. Logan , Pete Walsh , Akshita Bhagia , Dirk Groeneveld , Sameer Singh , Iz Beltagy

Few-shot image classification aims to classify unseen classes with limited labelled samples. Recent works benefit from the meta-learning process with episodic tasks and can fast adapt to class from training to testing. Due to the limited…

Computer Vision and Pattern Recognition · Computer Science 2021-02-24 Da Chen , Yuefeng Chen , Yuhong Li , Feng Mao , Yuan He , Hui Xue

Transductive inference is widely used in few-shot learning, as it leverages the statistics of the unlabeled query set of a few-shot task, typically yielding substantially better performances than its inductive counterpart. The current…

Machine Learning · Computer Science 2022-04-26 Olivier Veilleux , Malik Boudiaf , Pablo Piantanida , Ismail Ben Ayed

Self-supervised pretraining has made few-shot learning possible for many NLP tasks. But the pretraining objectives are not typically adapted specifically for in-context few-shot learning. In this paper, we propose to use self-supervision in…

Computation and Language · Computer Science 2022-06-08 Mingda Chen , Jingfei Du , Ramakanth Pasunuru , Todor Mihaylov , Srini Iyer , Veselin Stoyanov , Zornitsa Kozareva

Few-shot and zero-shot entity linking focus on the tail and emerging entities, which are more challenging but closer to real-world scenarios. The mainstream method is the ''retrieve and rerank'' two-stage framework. In this paper, we…

Computation and Language · Computer Science 2023-08-15 Shijue Huang , Bingbing Wang , Libo Qin , Qin Zhao , Ruifeng Xu

The problem of learning to generalize to unseen classes during training, known as few-shot classification, has attracted considerable attention. Initialization based methods, such as the gradient-based model agnostic meta-learning (MAML),…

Machine Learning · Computer Science 2021-03-10 Chen Zhao , Feng Chen , Zhuoyi Wang , Latifur Khan

Few-shot classification tasks aim to classify images in query sets based on only a few labeled examples in support sets. Most studies usually assume that each image in a task has a single and unique class association. Under these…

Computer Vision and Pattern Recognition · Computer Science 2022-03-01 Lu Yin , Vlado Menkovski , Yulong Pei , Mykola Pechenizkiy

Few-shot learning is a challenging task since only few instances are given for recognizing an unseen class. One way to alleviate this problem is to acquire a strong inductive bias via meta-learning on similar tasks. In this paper, we show…

Computer Vision and Pattern Recognition · Computer Science 2021-05-26 Wentao Chen , Chenyang Si , Wei Wang , Liang Wang , Zilei Wang , Tieniu Tan

We consider the predictive problem of supervised ranking, where the task is to rank sets of candidate items returned in response to queries. Although there exist statistical procedures that come with guarantees of consistency in this…

Statistics Theory · Mathematics 2013-11-27 John C. Duchi , Lester Mackey , Michael I. Jordan

Multilingual Pretrained Language Models (MPLMs) have shown their strong multilinguality in recent empirical cross-lingual transfer studies. In this paper, we propose the Prompts Augmented by Retrieval Crosslingually (PARC) pipeline to…

Computation and Language · Computer Science 2023-07-12 Ercong Nie , Sheng Liang , Helmut Schmid , Hinrich Schütze

Large Language Models (LLMs) have demonstrated promising capabilities as automatic evaluators in assessing the quality of generated natural language. However, LLMs still exhibit biases in evaluation and often struggle to generate coherent…

Computation and Language · Computer Science 2025-01-20 Yinhong Liu , Han Zhou , Zhijiang Guo , Ehsan Shareghi , Ivan Vulić , Anna Korhonen , Nigel Collier

Nowadays, recommender systems already impact almost every facet of peoples lives. To provide personalized high quality recommendation results, conventional systems usually train pointwise rankers to predict the absolute value of objectives…

Information Retrieval · Computer Science 2021-12-01 Yi Ren , Hongyan Tang , Siwen Zhu

One of the ways Large Language Models (LLMs) are used to perform machine learning tasks is to provide them with a few examples before asking them to produce a prediction. This is a meta-learning process known as few-shot learning. In this…

Software Engineering · Computer Science 2024-03-14 Vali Tawosi , Salwa Alamir , Xiaomo Liu

Given base classes with sufficient labeled samples, the target of few-shot classification is to recognize unlabeled samples of novel classes with only a few labeled samples. Most existing methods only pay attention to the relationship…

Computer Vision and Pattern Recognition · Computer Science 2020-08-11 Zeyuan Wang , Yifan Zhao , Jia Li , Yonghong Tian

Few-shot prompting has emerged as a practical alternative to fine-tuning for leveraging the capabilities of large language models (LLMs) in specialized tasks. However, its effectiveness depends heavily on the selection and quality of…

Software Engineering · Computer Science 2025-12-05 Fouad Trad , Ali Chehab

Meta-learning has been the most common framework for few-shot learning in recent years. It learns the model from collections of few-shot classification tasks, which is believed to have a key advantage of making the training objective…

Computer Vision and Pattern Recognition · Computer Science 2021-08-20 Yinbo Chen , Zhuang Liu , Huijuan Xu , Trevor Darrell , Xiaolong Wang