English
Related papers

Related papers: Unsupervised Few-shot Learning via Self-supervised…

200 papers

Few-shot dialogue state tracking (DST) is a realistic problem that trains the DST model with limited labeled data. Existing few-shot methods mainly transfer knowledge learned from external labeled dialogue data (e.g., from question…

Computation and Language · Computer Science 2022-10-12 Haoning Zhang , Junwei Bao , Haipeng Sun , Huaishao Luo , Wenye Li , Shuguang Cui

As unlabeled data carry rich task-relevant information, they are proven useful for few-shot learning of language model. The question is how to effectively make use of such data. In this work, we revisit the self-training technique for…

Computation and Language · Computer Science 2021-10-05 Yiming Chen , Yan Zhang , Chen Zhang , Grandee Lee , Ran Cheng , Haizhou Li

Few-shot learning (FSL) techniques seek to learn the underlying patterns in data using fewer samples, analogous to how humans learn from limited experience. In this limited-data scenario, the challenges associated with deep neural networks,…

Computer Vision and Pattern Recognition · Computer Science 2023-04-14 Deepan Chakravarthi Padmanabhan , Shruthi Gowda , Elahe Arani , Bahram Zonooz

Few-shot learning refers to understanding new concepts from only a few examples. We propose an information retrieval-inspired approach for this problem that is motivated by the increased importance of maximally leveraging all the available…

Machine Learning · Computer Science 2017-11-15 Eleni Triantafillou , Richard Zemel , Raquel Urtasun

In recent years, self-supervised learning has excelled for its capacity to learn robust feature representations from unlabelled data. Networks pretrained through self-supervision serve as effective feature extractors for downstream tasks,…

Sound · Computer Science 2024-02-15 Calum Heggan , Sam Budgett , Timothy Hospedales , Mehrdad Yaghoobi

State-of-the-art computer vision models are mostly trained with supervised learning using human-labeled images, which limits their scalability due to the expensive annotation cost. While self-supervised representation learning has achieved…

Computer Vision and Pattern Recognition · Computer Science 2023-03-13 Junnan Li , Silvio Savarese , Steven C. H. Hoi

Few-shot classification is a challenge in machine learning where the goal is to train a classifier using a very limited number of labeled examples. This scenario is likely to occur frequently in real life, for example when data acquisition…

Neural and Evolutionary Computing · Computer Science 2020-09-09 Lyes Khacef , Vincent Gripon , Benoit Miramond

Self-training provides an effective means of using an extremely small amount of labeled data to create pseudo-labels for unlabeled data. Many state-of-the-art self-training approaches hinge on different regularization methods to prevent…

Computation and Language · Computer Science 2022-02-08 Hazel Kim , Jaeman Son , Yo-Sub Han

Real-world contains an overwhelmingly large number of object classes, learning all of which at once is infeasible. Few shot learning is a promising learning paradigm due to its ability to learn out of order distributions quickly with only a…

Computer Vision and Pattern Recognition · Computer Science 2020-08-05 Jathushan Rajasegaran , Salman Khan , Munawar Hayat , Fahad Shahbaz Khan , Mubarak Shah

Despite the fast progress in training specialized models for various tasks, learning a single general model that works well for many tasks is still challenging for computer vision. Here we introduce multi-task self-training (MuST), which…

Computer Vision and Pattern Recognition · Computer Science 2021-08-26 Golnaz Ghiasi , Barret Zoph , Ekin D. Cubuk , Quoc V. Le , Tsung-Yi Lin

The field of few-shot learning has been laboriously explored in the supervised setting, where per-class labels are available. On the other hand, the unsupervised few-shot learning setting, where no labels of any kind are required, has seen…

Machine Learning · Statistics 2019-03-07 Antreas Antoniou , Amos Storkey

Few-shot learning aims to classify unseen classes with a few training examples. While recent works have shown that standard mini-batch training with a carefully designed training strategy can improve generalization ability for unseen…

Machine Learning · Computer Science 2021-03-02 Jin-Woo Seo , Hong-Gyu Jung , Seong-Whan Lee

Real-time bioaerosol monitoring is improving the quality of life for people affected by allergies, but it often relies on deep-learning models which pose challenges for widespread adoption. These models are typically trained in a supervised…

Machine Learning · Computer Science 2024-06-17 Adrian Willi , Pascal Baumann , Sophie Erb , Fabian Gröger , Yanick Zeder , Simone Lionetti

Few-shot learning (FSL) has emerged as an effective learning method and shows great potential. Despite the recent creative works in tackling FSL tasks, learning valid information rapidly from just a few or even zero samples still remains a…

Machine Learning · Computer Science 2022-05-25 Yisheng Song , Ting Wang , Subrota K Mondal , Jyoti Prakash Sahoo

Learning from a few examples is an important practical aspect of training classifiers. Various works have examined this aspect quite well. However, all existing approaches assume that the few examples provided are always correctly labeled.…

Computer Vision and Pattern Recognition · Computer Science 2020-11-24 Pratik Mazumder , Pravendra Singh , Vinay P. Namboodiri

Few-shot learning is an interesting and challenging study, which enables machines to learn from few samples like humans. Existing studies rarely exploit auxiliary information from large amount of unlabeled data. Self-supervised learning is…

Computer Vision and Pattern Recognition · Computer Science 2021-03-11 Hainan Li , Renshuai Tao , Jun Li , Haotong Qin , Yifu Ding , Shuo Wang , Xianglong Liu

Self-training is a classical approach in semi-supervised learning which is successfully applied to a variety of machine learning problems. Self-training algorithm generates pseudo-labels for the unlabeled examples and progressively refines…

Machine Learning · Computer Science 2020-06-22 Samet Oymak , Talha Cihad Gulcu

Existing approaches to lifelong language learning rely on plenty of labeled data for learning a new task, which is hard to obtain in most real scenarios. Considering that humans can continually learn new tasks from a handful of examples, we…

Computation and Language · Computer Science 2022-04-01 Chengwei Qin , Shafiq Joty

Few-shot learning is challenging due to its very limited data and labels. Recent studies in big transfer (BiT) show that few-shot learning can greatly benefit from pretraining on large scale labeled dataset in a different domain. This paper…

Computer Vision and Pattern Recognition · Computer Science 2020-12-11 Suichan Li , Dongdong Chen , Yinpeng Chen , Lu Yuan , Lei Zhang , Qi Chu , Nenghai Yu

Self-supervised learning (SSL) techniques have recently been integrated into the few-shot learning (FSL) framework and have shown promising results in improving the few-shot image classification performance. However, existing SSL approaches…

Computer Vision and Pattern Recognition · Computer Science 2023-04-27 Yi Rong , Xiongbo Lu , Zhaoyang Sun , Yaxiong Chen , Shengwu Xiong