中文
相关论文

相关论文: Self-training Improves Pre-training for Few-shot L…

200 篇论文

Identifying breakdowns in ongoing dialogues helps to improve communication effectiveness. Most prior work on this topic relies on human annotated data and data augmentation to learn a classification model. While quality labeled dialogue…

计算与语言 · 计算机科学 2022-04-20 Qian Lin , Hwee Tou Ng

Few-shot learning and self-supervised learning address different facets of the same problem: how to train a model with little or no labeled data. Few-shot learning aims for optimization methods and models that can learn efficiently to…

计算机视觉与模式识别 · 计算机科学 2019-06-13 Spyros Gidaris , Andrei Bursuc , Nikos Komodakis , Patrick Pérez , Matthieu Cord

Recently, pre-trained language models (LMs) have achieved strong performance when fine-tuned on difficult benchmarks like SuperGLUE. However, performance can suffer when there are very few labeled examples available for fine-tuning. Pattern…

计算与语言 · 计算机科学 2021-09-29 Derek Tam , Rakesh R Menon , Mohit Bansal , Shashank Srivastava , Colin Raffel

The field of few-shot learning has been laboriously explored in the supervised setting, where per-class labels are available. On the other hand, the unsupervised few-shot learning setting, where no labels of any kind are required, has seen…

机器学习 · 统计学 2019-03-07 Antreas Antoniou , Amos Storkey

Existing dialogue state tracking (DST) models require plenty of labeled data. However, collecting high-quality labels is costly, especially when the number of domains increases. In this paper, we address a practical DST problem that is…

计算与语言 · 计算机科学 2020-10-28 Chien-Sheng Wu , Steven Hoi , Caiming Xiong

In class-incremental semantic segmentation, we have no access to the labeled data of previous tasks. Therefore, when incrementally learning new classes, deep neural networks suffer from catastrophic forgetting of previously learned…

计算机视觉与模式识别 · 计算机科学 2022-03-14 Lu Yu , Xialei Liu , Joost van de Weijer

Few-shot classification (FSC) is challenging due to the scarcity of labeled training data (e.g. only one labeled data point per class). Meta-learning has shown to achieve promising results by learning to initialize a classification model…

计算机视觉与模式识别 · 计算机科学 2019-10-01 Xinzhe Li , Qianru Sun , Yaoyao Liu , Shibao Zheng , Qin Zhou , Tat-Seng Chua , Bernt Schiele

Few-shot text classification aims to recognize unseen classes with limited labeled text samples. Existing approaches focus on boosting meta-learners by developing complex algorithms in the training stage. However, the labeled samples are…

机器学习 · 计算机科学 2026-03-04 Yunlong Gao , Xinyue Liu , Yingbo Wang , Linlin Zong , Bo Xu

We demonstrate that co-training (Blum & Mitchell, 1998) can improve the performance of prompt-based learning by using unlabeled data. While prompting has emerged as a promising paradigm for few-shot and zero-shot learning, it is often…

计算与语言 · 计算机科学 2022-02-03 Hunter Lang , Monica Agrawal , Yoon Kim , David Sontag

The text-attributed graph (TAG) is one kind of important real-world graph-structured data with each node associated with raw texts. For TAGs, traditional few-shot node classification methods directly conduct training on the pre-processed…

社会与信息网络 · 计算机科学 2024-07-23 Huanjing Zhao , Beining Yang , Yukuo Cen , Junyu Ren , Chenhui Zhang , Yuxiao Dong , Evgeny Kharlamov , Shu Zhao , Jie Tang

Few-shot learning has been extensively explored to address problems where the amount of labeled samples is very limited for some classes. In the semi-supervised few-shot learning setting, substantial quantities of unlabeled samples are…

计算机视觉与模式识别 · 计算机科学 2025-12-16 Souvik Maji , Rhythm Baghel , Pratik Mazumder

In this paper, we propose a novel strategy for text-independent speaker identification system: Multi-Label Training (MLT). Instead of the commonly used one-to-one correspondence between the speech and the speaker label, we divide all the…

音频与语音处理 · 电气工程与系统科学 2024-08-19 Yuqi Xue

Task-oriented dialogue systems have been plagued by the difficulties of obtaining large-scale and high-quality annotated conversations. Furthermore, most of the publicly available datasets only include written conversations, which are…

Meta-training, which fine-tunes the language model (LM) on various downstream tasks by maximizing the likelihood of the target label given the task instruction and input instance, has improved the zero-shot task generalization performance.…

计算与语言 · 计算机科学 2023-06-07 Seonghyeon Ye , Doyoung Kim , Joel Jang , Joongbo Shin , Minjoon Seo

Most existing works in few-shot learning rely on meta-learning the network on a large base dataset which is typically from the same domain as the target dataset. We tackle the problem of cross-domain few-shot learning where there is a large…

计算机视觉与模式识别 · 计算机科学 2021-11-02 Ashraful Islam , Chun-Fu Chen , Rameswar Panda , Leonid Karlinsky , Rogerio Feris , Richard J. Radke

Self-training via pseudo labeling is a conventional, simple, and popular pipeline to leverage unlabeled data. In this work, we first construct a strong baseline of self-training (namely ST) for semi-supervised semantic segmentation via…

计算机视觉与模式识别 · 计算机科学 2022-03-04 Lihe Yang , Wei Zhuo , Lei Qi , Yinghuan Shi , Yang Gao

Few-shot learning aims to handle previously unseen tasks using only a small amount of new training data. In preparing (or meta-training) a few-shot learner, however, massive labeled data are necessary. In the real world, unfortunately,…

机器学习 · 计算机科学 2020-03-19 Jun Seo , Sung Whan Yoon , Jaekyun Moon

The recent development of language models has shown promising results by achieving state-of-the-art performance on various natural language tasks by fine-tuning pretrained models. In task-oriented dialogue (ToD) systems, language models can…

计算与语言 · 计算机科学 2022-01-24 Vinsen Marselino Andreas , Genta Indra Winata , Ayu Purwarianti

Meta-learning has emerged as a prominent technology for few-shot text classification and has achieved promising performance. However, existing methods often encounter difficulties in drawing accurate class prototypes from support set…

计算机视觉与模式识别 · 计算机科学 2024-10-15 Xinyue Liu , Yunlong Gao , Linlin Zong , Bo Xu

Developing semi-supervised task-oriented dialog (TOD) systems by leveraging unlabeled dialog data has attracted increasing interests. For semi-supervised learning of latent state TOD models, variational learning is often used, but suffers…

计算与语言 · 计算机科学 2022-07-26 Yucheng Cai , Hong Liu , Zhijian Ou , Yi Huang , Junlan Feng