中文
相关论文

相关论文: Few-shot Text Classification with Dual Contrastive…

200 篇论文

Few-shot learning aims at rapidly adapting to novel categories with only a handful of samples at test time, which has been predominantly tackled with the idea of meta-learning. However, meta-learning approaches essentially learn across a…

计算机视觉与模式识别 · 计算机科学 2021-07-21 Jinhai Yang , Hua Yang , Lin Chen

In the realm of few-shot learning, foundation models like CLIP have proven effective but exhibit limitations in cross-domain robustness especially in few-shot settings. Recent works add text as an extra modality to enhance the performance…

计算机视觉与模式识别 · 计算机科学 2023-11-27 Yassir Bendou , Vincent Gripon , Bastien Pasdeloup , Giulia Lioi , Lukas Mauch , Fabien Cardinaux , Ghouthi Boukli Hacene

The major paradigm of applying a pre-trained language model to downstream tasks is to fine-tune it on labeled task data, which often suffers instability and low performance when the labeled examples are scarce.~One way to alleviate this…

计算与语言 · 计算机科学 2021-06-07 Ruikun Luo , Guanhuan Huang , Xiaojun Quan

It is challenging to train a good intent classifier for a task-oriented dialogue system with only a few annotations. Recent studies have shown that fine-tuning pre-trained language models with a small amount of labeled utterances from…

计算与语言 · 计算机科学 2024-09-17 Haode Zhang , Haowen Liang , Yuwei Zhang , Liming Zhan , Xiaolei Lu , Albert Y. S. Lam , Xiao-Ming Wu

Few-shot image classification, where the goal is to generalize to tasks with limited labeled data, has seen great progress over the years. However, the classifiers are vulnerable to adversarial examples, posing a question regarding their…

计算机视觉与模式识别 · 计算机科学 2022-04-13 Akshayvarun Subramanya , Hamed Pirsiavash

In few-shot classification, we are interested in learning algorithms that train a classifier from only a handful of labeled examples. Recent progress in few-shot classification has featured meta-learning, in which a parameterized model for…

This paper proposes a novel prompt-based finetuning method (called DLM-SCS) for few-shot text classification by utilizing the discriminative language model ELECTRA that is pretrained to distinguish whether a token is original or generated.…

计算与语言 · 计算机科学 2022-10-25 Zhipeng Xie , Yahe Li

We analyze several recent unsupervised constituency parsing models, which are tuned with respect to the parsing $F_1$ score on the Wall Street Journal (WSJ) development set (1,700 sentences). We introduce strong baselines for them, by…

计算与语言 · 计算机科学 2020-10-08 Haoyue Shi , Karen Livescu , Kevin Gimpel

Pre-trained masked language models have demonstrated remarkable ability as few-shot learners. In this paper, as an alternative, we propose a novel approach to few-shot learning with pre-trained token-replaced detection models like ELECTRA.…

计算与语言 · 计算机科学 2023-03-22 Zicheng Li , Shoushan Li , Guodong Zhou

Few-shot classification (FSC) is challenging due to the scarcity of labeled training data (e.g. only one labeled data point per class). Meta-learning has shown to achieve promising results by learning to initialize a classification model…

计算机视觉与模式识别 · 计算机科学 2019-10-01 Xinzhe Li , Qianru Sun , Yaoyao Liu , Shibao Zheng , Qin Zhou , Tat-Seng Chua , Bernt Schiele

Meta-learning has emerged as a trending technique to tackle few-shot text classification and achieved state-of-the-art performance. However, existing solutions heavily rely on the exploitation of lexical features and their distributional…

计算与语言 · 计算机科学 2021-07-27 ChengCheng Han , Zeqiu Fan , Dongxiang Zhang , Minghui Qiu , Ming Gao , Aoying Zhou

Few-shot detection is a major task in pattern recognition which seeks to localize objects using models trained with few labeled data. One of the mainstream few-shot methods is transfer learning which consists in pretraining a detection…

计算机视觉与模式识别 · 计算机科学 2024-02-15 Jie Mei , Mingyuan Jiu , Hichem Sahbi , Xiaoheng Jiang , Mingliang Xu

Few-shot classification is a challenging task which aims to formulate the ability of humans to learn concepts from limited prior data and has drawn considerable attention in machine learning. Recent progress in few-shot classification has…

机器学习 · 计算机科学 2020-04-14 Meiyu Huang , Xueshuang Xiang , Yao Xu

Fine-tuning a pre-trained language model via the contrastive learning framework with a large amount of unlabeled sentences or labeled sentence pairs is a common way to obtain high-quality sentence representations. Although the contrastive…

计算与语言 · 计算机科学 2022-11-01 Tianduo Wang , Wei Lu

In-context learning of GPT-like models has been recognized as fragile across different hand-crafted templates, and demonstration permutations. In this work, we propose prototypical calibration to adaptively learn a more robust decision…

计算与语言 · 计算机科学 2022-10-06 Zhixiong Han , Yaru Hao , Li Dong , Yutao Sun , Furu Wei

Few-shot object classification is the task of classifying objects in an image with limited number of examples as supervision. We propose a one-shot/few-shot classification model that can classify an object of any unseen class into a…

计算机视觉与模式识别 · 计算机科学 2023-10-13 Arpit Mittal , Harshil Jhaveri , Swapnil Mallick , Abhishek Ajmera

Training or finetuning large-scale language models (LLMs) requires substantial computation resources, motivating recent efforts to explore parameter-efficient adaptation to downstream tasks. One approach is to treat these models as black…

计算与语言 · 计算机科学 2024-03-20 Danqing Luo , Chen Zhang , Yan Zhang , Haizhou Li

Few-shot text classification has attracted great interest in both academia and industry due to the lack of labeled data in many fields. Different from general text classification (e.g., topic classification), few-shot sentiment…

计算与语言 · 计算机科学 2023-12-19 Jingyi Zhou , Jie Zhou , Jiabao Zhao , Siyin Wang , Haijun Shan , Gui Tao , Qi Zhang , Xuanjing Huang

Few-shot learning aims to handle previously unseen tasks using only a small amount of new training data. In preparing (or meta-training) a few-shot learner, however, massive labeled data are necessary. In the real world, unfortunately,…

机器学习 · 计算机科学 2020-03-19 Jun Seo , Sung Whan Yoon , Jaekyun Moon

Meta-learning has emerged as a prominent technology for few-shot text classification and has achieved promising performance. However, existing methods often encounter difficulties in drawing accurate class prototypes from support set…

计算机视觉与模式识别 · 计算机科学 2024-10-15 Xinyue Liu , Yunlong Gao , Linlin Zong , Bo Xu