中文
相关论文

相关论文: Learning New Tasks from a Few Examples with Soft-L…

200 篇论文

One of the most impressive results of recent NLP history is the ability of pre-trained language models to solve new tasks in a zero-shot setting. To achieve this, NLP tasks are framed as natural language prompts, generating a response…

计算与语言 · 计算机科学 2022-12-29 Chunting Zhou , Junxian He , Xuezhe Ma , Taylor Berg-Kirkpatrick , Graham Neubig

Large Language Models (LLMs) have shown strong performance on NLP classification tasks. However, they typically rely on aggregated labels-often via majority voting-which can obscure the human disagreement inherent in subjective annotations.…

计算与语言 · 计算机科学 2025-06-09 Benedetta Muscato , Yue Li , Gizem Gezici , Zhixue Zhao , Fosca Giannotti

Recently deep learning has dominated many machine learning areas, including spoken language understanding (SLU). However, deep learning models are notorious for being data-hungry, and the heavily optimized models are usually sensitive to…

计算与语言 · 计算机科学 2020-12-15 Shang-Wen Li , Jason Krone , Shuyan Dong , Yi Zhang , Yaser Al-onaizan

Few-shot classification aims at classifying categories of a novel task by learning from just a few (typically, 1 to 5) labelled examples. An effective approach to few-shot classification involves a prior model trained on a large-sample base…

计算机视觉与模式识别 · 计算机科学 2021-09-22 Rajshekhar Das , Yu-Xiong Wang , JoséM. F. Moura

Few-shot learning has been extensively explored to address problems where the amount of labeled samples is very limited for some classes. In the semi-supervised few-shot learning setting, substantial quantities of unlabeled samples are…

计算机视觉与模式识别 · 计算机科学 2025-12-16 Souvik Maji , Rhythm Baghel , Pratik Mazumder

The remarkable advancements in large language models (LLMs) have significantly enhanced the performance in few-shot learning settings. By using only a small number of labeled examples, referred to as demonstrations, LLMs can effectively…

计算与语言 · 计算机科学 2023-11-23 Katerina Margatina , Timo Schick , Nikolaos Aletras , Jane Dwivedi-Yu

Few-shot slot tagging is an emerging research topic in the field of Natural Language Understanding (NLU). With sufficient annotated data from source domains, the key challenge is how to train and adapt the model to another target domain…

计算与语言 · 计算机科学 2021-09-14 Zezhong Wang , Hongru Wang , Kwan Wai Chung , Jia Zhu , Gabriel Pui Cheong Fung , Kam-Fai Wong

It is an important yet challenging setting to continually learn new tasks from a few examples. Although numerous efforts have been devoted to either continual learning or few-shot learning, little work has considered this new setting of…

机器学习 · 计算机科学 2021-04-20 Liyuan Wang , Qian Li , Yi Zhong , Jun Zhu

Few-shot learning (FSL) is an emergent paradigm of learning that attempts to learn to reason with low sample complexity to mimic the way humans learn, generalise and extrapolate from only a few seen examples. While FSL attempts to mimic…

机器学习 · 计算机科学 2023-12-08 Jaron Mar , Jiamou Liu

Vision-language models (VLMs) pre-trained on large, heterogeneous data sources are becoming increasingly popular, providing rich multi-modal embeddings that enable efficient transfer to new tasks. A particularly relevant application is…

计算机视觉与模式识别 · 计算机科学 2026-03-04 Julio Silva-Rodríguez , Ender Konukoglu

Modern deep learning requires large-scale extensively labelled datasets for training. Few-shot learning aims to alleviate this issue by learning effectively from few labelled examples. In previously proposed few-shot visual classifiers, it…

计算机视觉与模式识别 · 计算机科学 2022-12-13 Peyman Bateni , Jarred Barber , Raghav Goyal , Vaden Masrani , Jan-Willem van de Meent , Leonid Sigal , Frank Wood

The success of deep learning methods hinges on the availability of large training datasets annotated for the task of interest. In contrast to human intelligence, these methods lack versatility and struggle to learn and adapt quickly to new…

计算与语言 · 计算机科学 2020-10-13 Nithin Holla , Pushkar Mishra , Helen Yannakoudakis , Ekaterina Shutova

Large pre-trained language models (LMs) have demonstrated remarkable ability as few-shot learners. However, their success hinges largely on scaling model parameters to a degree that makes it challenging to train and serve. In this paper, we…

计算与语言 · 计算机科学 2021-05-03 Sinong Wang , Han Fang , Madian Khabsa , Hanzi Mao , Hao Ma

In recent years, deep learning has been widely applied in communications and achieved remarkable performance improvement. Most of the existing works are based on data-driven deep learning, which requires a significant amount of training…

信息论 · 计算机科学 2022-09-07 Ouya Wang , Jiabao Gao , Geoffrey Ye Li

Humans can learn a new language task efficiently with only few examples, by leveraging their knowledge obtained when learning prior tasks. In this paper, we explore whether and how such cross-task generalization ability can be acquired, and…

计算与语言 · 计算机科学 2021-10-04 Qinyuan Ye , Bill Yuchen Lin , Xiang Ren

Learning with few labeled tabular samples is often an essential requirement for industrial machine learning applications as varieties of tabular data suffer from high annotation costs or have difficulties in collecting new samples for novel…

机器学习 · 计算机科学 2023-03-03 Jaehyun Nam , Jihoon Tack , Kyungmin Lee , Hankook Lee , Jinwoo Shin

We consider the problem of Learning from Label Proportions (LLP), a weakly supervised classification setup where instances are grouped into "bags", and only the frequency of class labels at each bag is available. Albeit, the objective of…

机器学习 · 计算机科学 2023-02-15 Robert Istvan Busa-Fekete , Heejin Choi , Travis Dick , Claudio Gentile , Andres Munoz medina

Few-shot classification (FSC) is challenging due to the scarcity of labeled training data (e.g. only one labeled data point per class). Meta-learning has shown to achieve promising results by learning to initialize a classification model…

计算机视觉与模式识别 · 计算机科学 2019-10-01 Xinzhe Li , Qianru Sun , Yaoyao Liu , Shibao Zheng , Qin Zhou , Tat-Seng Chua , Bernt Schiele

Learning from limited exemplars (few-shot learning) is a fundamental, unsolved problem that has been laboriously explored in the machine learning community. However, current few-shot learners are mostly supervised and rely heavily on a…

计算机视觉与模式识别 · 计算机科学 2019-12-30 Zilong Ji , Xiaolong Zou , Tiejun Huang , Si Wu

This paper tackles the problem of few-shot learning, which aims to learn new visual concepts from a few examples. A common problem setting in few-shot classification assumes random sampling strategy in acquiring data labels, which is…

计算机视觉与模式识别 · 计算机科学 2022-01-10 Shipeng Yan , Songyang Zhang , Xuming He