English
Related papers

Related papers: Few-Shot Learning with a Strong Teacher

200 papers

Few-shot object detection, the problem of modelling novel object detection categories with few training instances, is an emerging topic in the area of few-shot learning and object detection. Contemporary techniques can be divided into two…

Computer Vision and Pattern Recognition · Computer Science 2023-04-25 Berkan Demirel , Orhun Buğra Baran , Ramazan Gokberk Cinbis

Few-shot segmentation (FSS) aims to segment unseen classes given only a few annotated samples. Existing methods suffer the problem of feature undermining, i.e. potential novel classes are treated as background during training phase. Our…

Computer Vision and Pattern Recognition · Computer Science 2021-09-28 Lihe Yang , Wei Zhuo , Lei Qi , Yinghuan Shi , Yang Gao

We uncover an ever-overlooked deficiency in the prevailing Few-Shot Learning (FSL) methods: the pre-trained knowledge is indeed a confounder that limits the performance. This finding is rooted from our causal assumption: a Structural Causal…

Machine Learning · Computer Science 2020-12-07 Zhongqi Yue , Hanwang Zhang , Qianru Sun , Xian-Sheng Hua

Human learning benefits from multi-modal inputs that often appear as rich semantics (e.g., description of an object's attributes while learning about it). This enables us to learn generalizable concepts from very limited visual examples.…

Computer Vision and Pattern Recognition · Computer Science 2021-11-15 Mohamed Afham , Salman Khan , Muhammad Haris Khan , Muzammal Naseer , Fahad Shahbaz Khan

Federated Learning (FL) enables multiple clients to collaboratively learn a machine learning model without exchanging their own local data. In this way, the server can exploit the computational power of all clients and train the model on a…

Machine Learning · Computer Science 2023-07-04 Song Wang , Xingbo Fu , Kaize Ding , Chen Chen , Huiyuan Chen , Jundong Li

Few-shot algorithms aim at learning new tasks provided only a handful of training examples. In this work we investigate few-shot learning in the setting where the data points are sequences of tokens and propose an efficient learning…

Machine Learning · Computer Science 2020-12-18 Lajanugen Logeswaran , Ann Lee , Myle Ott , Honglak Lee , Marc'Aurelio Ranzato , Arthur Szlam

As an algorithmic framework for learning to learn, meta-learning provides a promising solution for few-shot text classification. However, most existing research fail to give enough attention to class labels. Traditional basic framework…

Computation and Language · Computer Science 2024-12-16 Guanghua Hou , Shuhui Cao , Deqiang Ouyang , Ning Wang

Large pre-trained language models (LMs) have demonstrated remarkable ability as few-shot learners. However, their success hinges largely on scaling model parameters to a degree that makes it challenging to train and serve. In this paper, we…

Computation and Language · Computer Science 2021-05-03 Sinong Wang , Han Fang , Madian Khabsa , Hanzi Mao , Hao Ma

We introduce Mixture-based Feature Space Learning (MixtFSL) for obtaining a rich and robust feature representation in the context of few-shot image classification. Previous works have proposed to model each base class either with a single…

Computer Vision and Pattern Recognition · Computer Science 2021-08-18 Arman Afrasiyabi , Jean-François Lalonde , Christian Gagné

Few-shot learning is a rapidly evolving area of research in machine learning where the goal is to classify unlabeled data with only one or "a few" labeled exemplary samples. Neural networks are typically trained to minimize a distance…

Computer Vision and Pattern Recognition · Computer Science 2022-12-09 Samuel Hess , Gregory Ditzler

Few-shot learning is currently enjoying a considerable resurgence of interest, aided by the recent advance of deep learning. Contemporary approaches based on weight-generation scheme delivers a straightforward and flexible solution to the…

Computer Vision and Pattern Recognition · Computer Science 2021-05-05 Mingjiang Liang , Shaoli Huang , Shirui Pan , Mingming Gong , Wei Liu

A meta-model is trained on a distribution of similar tasks such that it learns an algorithm that can quickly adapt to a novel task with only a handful of labeled examples. Most of current meta-learning methods assume that the meta-training…

Machine Learning · Computer Science 2019-04-12 Minseop Park , Jungtaek Kim , Saehoon Kim , Yanbin Liu , Seungjin Choi

Learning with few samples is a major challenge for parameter-rich models like deep networks. In contrast, people learn complex new concepts even from very few examples, suggesting that the sample complexity of learning can often be reduced.…

Machine Learning · Computer Science 2019-06-11 Roman Visotsky , Yuval Atzmon , Gal Chechik

Deep neural networks have been able to outperform humans in some cases like image recognition and image classification. However, with the emergence of various novel categories, the ability to continuously widen the learning capability of…

Computer Vision and Pattern Recognition · Computer Science 2020-07-31 Nihar Bendre , Hugo Terashima Marín , Peyman Najafirad

Few-shot learning (FSL) aims at recognizing novel classes given only few training samples, which still remains a great challenge for deep learning. However, humans can easily recognize novel classes with only few samples. A key component of…

Computer Vision and Pattern Recognition · Computer Science 2020-09-23 Yixiong Zou , Shanghang Zhang , Ke Chen , Yonghong Tian , Yaowei Wang , José M. F. Moura

Few-shot learning (FSL) is a challenging task in machine learning, demanding a model to render discriminative classification by using only a few labeled samples. In the literature of FSL, deep models are trained in a manner of metric…

Computer Vision and Pattern Recognition · Computer Science 2025-01-27 Tong Wu , Takumi Kobayashi

Overfitting is a significant challenge in Few-Shot Learning (FSL), where models trained on small, variable datasets tend to memorize rather than generalize to unseen tasks. Regularization is crucial in FSL to prevent overfitting and enhance…

Machine Learning · Computer Science 2025-02-28 Mohammad Rostami , Atik Faysal , Huaxia Wang , Avimanyu Sahoo

Few-shot learning (FSL) aims to learn a classifier that can be easily adapted to accommodate new tasks not seen during training, given only a few examples. To handle the limited-data problem in few-shot regimes, recent methods tend to…

Computer Vision and Pattern Recognition · Computer Science 2022-03-21 Yang Liu , Weifeng Zhang , Chao Xiang , Tu Zheng , Deng Cai , Xiaofei He

Many meta-learning approaches for few-shot learning rely on simple base learners such as nearest-neighbor classifiers. However, even in the few-shot regime, discriminatively trained linear predictors can offer better generalization. We…

Computer Vision and Pattern Recognition · Computer Science 2019-04-24 Kwonjoon Lee , Subhransu Maji , Avinash Ravichandran , Stefano Soatto

Humans have a remarkable ability to quickly and effectively learn new concepts in a continuous manner without forgetting old knowledge. Though deep learning has made tremendous successes on various computer vision tasks, it faces challenges…

Machine Learning · Computer Science 2022-07-26 Kun Wu , Chengxiang Yin , Jian Tang , Zhiyuan Xu , Yanzhi Wang , Dejun Yang