English
Related papers

Related papers: Reordering Examples Helps during Priming-based Few…

200 papers

End-to-end approaches have recently become popular as a means of simplifying the training and deployment of speech recognition systems. However, they often require large amounts of data to perform well on large vocabulary tasks. With the…

Computation and Language · Computer Science 2019-03-25 Bertrand Higy , Peter Bell

Few-shot learning allows pre-trained language models to adapt to downstream tasks while using a limited number of training examples. However, practical applications are limited when all model parameters must be optimized. In this work we…

Computation and Language · Computer Science 2023-02-01 Ethan Kim , Jerry Yang

Prompt-based classifiers are an attractive approach for zero-shot classification. However, the precise choice of the prompt template and label words can largely influence performance, with semantically equivalent settings often showing…

Computation and Language · Computer Science 2023-09-12 Adian Liusie , Potsawee Manakul , Mark J. F. Gales

Learning from limited exemplars (few-shot learning) is a fundamental, unsolved problem that has been laboriously explored in the machine learning community. However, current few-shot learners are mostly supervised and rely heavily on a…

Computer Vision and Pattern Recognition · Computer Science 2019-12-30 Zilong Ji , Xiaolong Zou , Tiejun Huang , Si Wu

Stance detection aims to identify whether the author of a text is in favor of, against, or neutral to a given target. The main challenge of this task comes two-fold: few-shot learning resulting from the varying targets and the lack of…

Computation and Language · Computer Science 2022-06-28 Yan Jiang , Jinhua Gao , Huawei Shen , Xueqi Cheng

As unlabeled data carry rich task-relevant information, they are proven useful for few-shot learning of language model. The question is how to effectively make use of such data. In this work, we revisit the self-training technique for…

Computation and Language · Computer Science 2021-10-05 Yiming Chen , Yan Zhang , Chen Zhang , Grandee Lee , Ran Cheng , Haizhou Li

Prompting methods have shown impressive performance in a variety of text mining tasks and applications, especially few-shot ones. Despite the promising prospects, the performance of prompting model largely depends on the design of prompt…

Computation and Language · Computer Science 2023-06-16 Hongyuan Dong , Weinan Zhang , Wanxiang Che

Few-shot learning (FSL) is an emergent paradigm of learning that attempts to learn to reason with low sample complexity to mimic the way humans learn, generalise and extrapolate from only a few seen examples. While FSL attempts to mimic…

Machine Learning · Computer Science 2023-12-08 Jaron Mar , Jiamou Liu

Few-shot classification is a challenging task which aims to formulate the ability of humans to learn concepts from limited prior data and has drawn considerable attention in machine learning. Recent progress in few-shot classification has…

Machine Learning · Computer Science 2020-04-14 Meiyu Huang , Xueshuang Xiang , Yao Xu

The task of learning from only a few examples (called a few-shot setting) is of key importance and relevance to a real-world setting. For question answering (QA), the current state-of-the-art pre-trained models typically need fine-tuning on…

Computation and Language · Computer Science 2021-10-13 Rakesh Chada , Pradeep Natarajan

Few-shot action recognition aims to recognize action classes with few training samples. Most existing methods adopt a meta-learning approach with episodic training. In each episode, the few samples in a meta-training task are split into…

Computer Vision and Pattern Recognition · Computer Science 2021-10-26 Xiatian Zhu , Antoine Toisoul , Juan-Manuel Perez-Rua , Li Zhang , Brais Martinez , Tao Xiang

Few-shot learning (FSL) aims to learn a classifier that can be easily adapted to recognize novel classes with only a few labeled examples. Some recent work about FSL has yielded promising classification performance, where the image-level…

Computer Vision and Pattern Recognition · Computer Science 2023-06-16 Jianpeng Yang , Yuhang Niu , Xuemei Xie , Guangming Shi

Demonstration learning aims to guide the prompt prediction via providing answered demonstrations in the few shot settings. Despite achieving promising results, existing work only concatenates the answered examples as demonstrations to the…

Machine Learning · Computer Science 2022-09-02 Sirui Wang , Kaiwen Wei , Hongzhi Zhang , Yuntao Li , Wei Wu

Few-shot learning has drawn researchers' attention to overcome the problem of data scarcity. Recently, large pre-trained language models have shown great performance in few-shot learning for various downstream tasks, such as question…

Computation and Language · Computer Science 2021-03-18 Nayeon Lee , Yejin Bang , Andrea Madotto , Madian Khabsa , Pascale Fung

Few-shot learning features the capability of generalizing from a few examples. In this paper, we first identify that a discriminative feature space, namely a rectified metric space, that is learned to maintain the metric consistency from…

Computer Vision and Pattern Recognition · Computer Science 2020-12-03 Yang Zhao , Chunyuan Li , Ping Yu , Changyou Chen

In the field of natural language processing, sentiment analysis via deep learning has a excellent performance by using large labeled datasets. Meanwhile, labeled data are insufficient in many sentiment analysis, and obtaining these data is…

Computation and Language · Computer Science 2022-05-17 Pengfei Zhang , Tingting Chai , Yongdong Xu

Large pre-trained language models (LMs) have demonstrated remarkable ability as few-shot learners. However, their success hinges largely on scaling model parameters to a degree that makes it challenging to train and serve. In this paper, we…

Computation and Language · Computer Science 2021-05-03 Sinong Wang , Han Fang , Madian Khabsa , Hanzi Mao , Hao Ma

Despite the notable advancements achieved by leveraging pre-trained vision-language (VL) models through few-shot tuning for downstream tasks, our detailed empirical study highlights a significant dependence of few-shot learning outcomes on…

Computer Vision and Pattern Recognition · Computer Science 2024-05-24 Zhaojun Guo , Jinghui Lu , Xuejing Liu , Rui Zhao , ZhenXing Qian , Fei Tan

Few-shot learning aims at leveraging knowledge learned by one or more deep learning models, in order to obtain good classification performance on new problems, where only a few labeled samples per class are available. Recent years have seen…

Machine Learning · Computer Science 2022-02-08 Yassir Bendou , Yuqing Hu , Raphael Lafargue , Giulia Lioi , Bastien Pasdeloup , Stéphane Pateux , Vincent Gripon

Intent Detection is one of the core tasks of dialog systems. Few-shot Intent Detection is challenging due to limited number of annotated utterances for novel classes. Generalized Few-shot intent detection is more realistic but challenging…

Computation and Language · Computer Science 2023-12-27 Ayush Kumar , Vijit Malik , Jithendra Vepa