中文
相关论文

相关论文: Few-Shot Learning with a Strong Teacher

200 篇论文

Few-shot object detection, the problem of modelling novel object detection categories with few training instances, is an emerging topic in the area of few-shot learning and object detection. Contemporary techniques can be divided into two…

计算机视觉与模式识别 · 计算机科学 2023-04-25 Berkan Demirel , Orhun Buğra Baran , Ramazan Gokberk Cinbis

Few-shot segmentation (FSS) aims to segment unseen classes given only a few annotated samples. Existing methods suffer the problem of feature undermining, i.e. potential novel classes are treated as background during training phase. Our…

计算机视觉与模式识别 · 计算机科学 2021-09-28 Lihe Yang , Wei Zhuo , Lei Qi , Yinghuan Shi , Yang Gao

We uncover an ever-overlooked deficiency in the prevailing Few-Shot Learning (FSL) methods: the pre-trained knowledge is indeed a confounder that limits the performance. This finding is rooted from our causal assumption: a Structural Causal…

机器学习 · 计算机科学 2020-12-07 Zhongqi Yue , Hanwang Zhang , Qianru Sun , Xian-Sheng Hua

Human learning benefits from multi-modal inputs that often appear as rich semantics (e.g., description of an object's attributes while learning about it). This enables us to learn generalizable concepts from very limited visual examples.…

计算机视觉与模式识别 · 计算机科学 2021-11-15 Mohamed Afham , Salman Khan , Muhammad Haris Khan , Muzammal Naseer , Fahad Shahbaz Khan

Federated Learning (FL) enables multiple clients to collaboratively learn a machine learning model without exchanging their own local data. In this way, the server can exploit the computational power of all clients and train the model on a…

机器学习 · 计算机科学 2023-07-04 Song Wang , Xingbo Fu , Kaize Ding , Chen Chen , Huiyuan Chen , Jundong Li

Few-shot algorithms aim at learning new tasks provided only a handful of training examples. In this work we investigate few-shot learning in the setting where the data points are sequences of tokens and propose an efficient learning…

机器学习 · 计算机科学 2020-12-18 Lajanugen Logeswaran , Ann Lee , Myle Ott , Honglak Lee , Marc'Aurelio Ranzato , Arthur Szlam

As an algorithmic framework for learning to learn, meta-learning provides a promising solution for few-shot text classification. However, most existing research fail to give enough attention to class labels. Traditional basic framework…

计算与语言 · 计算机科学 2024-12-16 Guanghua Hou , Shuhui Cao , Deqiang Ouyang , Ning Wang

Large pre-trained language models (LMs) have demonstrated remarkable ability as few-shot learners. However, their success hinges largely on scaling model parameters to a degree that makes it challenging to train and serve. In this paper, we…

计算与语言 · 计算机科学 2021-05-03 Sinong Wang , Han Fang , Madian Khabsa , Hanzi Mao , Hao Ma

We introduce Mixture-based Feature Space Learning (MixtFSL) for obtaining a rich and robust feature representation in the context of few-shot image classification. Previous works have proposed to model each base class either with a single…

计算机视觉与模式识别 · 计算机科学 2021-08-18 Arman Afrasiyabi , Jean-François Lalonde , Christian Gagné

Few-shot learning is a rapidly evolving area of research in machine learning where the goal is to classify unlabeled data with only one or "a few" labeled exemplary samples. Neural networks are typically trained to minimize a distance…

计算机视觉与模式识别 · 计算机科学 2022-12-09 Samuel Hess , Gregory Ditzler

Few-shot learning is currently enjoying a considerable resurgence of interest, aided by the recent advance of deep learning. Contemporary approaches based on weight-generation scheme delivers a straightforward and flexible solution to the…

计算机视觉与模式识别 · 计算机科学 2021-05-05 Mingjiang Liang , Shaoli Huang , Shirui Pan , Mingming Gong , Wei Liu

A meta-model is trained on a distribution of similar tasks such that it learns an algorithm that can quickly adapt to a novel task with only a handful of labeled examples. Most of current meta-learning methods assume that the meta-training…

机器学习 · 计算机科学 2019-04-12 Minseop Park , Jungtaek Kim , Saehoon Kim , Yanbin Liu , Seungjin Choi

Learning with few samples is a major challenge for parameter-rich models like deep networks. In contrast, people learn complex new concepts even from very few examples, suggesting that the sample complexity of learning can often be reduced.…

机器学习 · 计算机科学 2019-06-11 Roman Visotsky , Yuval Atzmon , Gal Chechik

Deep neural networks have been able to outperform humans in some cases like image recognition and image classification. However, with the emergence of various novel categories, the ability to continuously widen the learning capability of…

计算机视觉与模式识别 · 计算机科学 2020-07-31 Nihar Bendre , Hugo Terashima Marín , Peyman Najafirad

Few-shot learning (FSL) aims at recognizing novel classes given only few training samples, which still remains a great challenge for deep learning. However, humans can easily recognize novel classes with only few samples. A key component of…

计算机视觉与模式识别 · 计算机科学 2020-09-23 Yixiong Zou , Shanghang Zhang , Ke Chen , Yonghong Tian , Yaowei Wang , José M. F. Moura

Few-shot learning (FSL) is a challenging task in machine learning, demanding a model to render discriminative classification by using only a few labeled samples. In the literature of FSL, deep models are trained in a manner of metric…

计算机视觉与模式识别 · 计算机科学 2025-01-27 Tong Wu , Takumi Kobayashi

Overfitting is a significant challenge in Few-Shot Learning (FSL), where models trained on small, variable datasets tend to memorize rather than generalize to unseen tasks. Regularization is crucial in FSL to prevent overfitting and enhance…

机器学习 · 计算机科学 2025-02-28 Mohammad Rostami , Atik Faysal , Huaxia Wang , Avimanyu Sahoo

Few-shot learning (FSL) aims to learn a classifier that can be easily adapted to accommodate new tasks not seen during training, given only a few examples. To handle the limited-data problem in few-shot regimes, recent methods tend to…

计算机视觉与模式识别 · 计算机科学 2022-03-21 Yang Liu , Weifeng Zhang , Chao Xiang , Tu Zheng , Deng Cai , Xiaofei He

Many meta-learning approaches for few-shot learning rely on simple base learners such as nearest-neighbor classifiers. However, even in the few-shot regime, discriminatively trained linear predictors can offer better generalization. We…

计算机视觉与模式识别 · 计算机科学 2019-04-24 Kwonjoon Lee , Subhransu Maji , Avinash Ravichandran , Stefano Soatto

Humans have a remarkable ability to quickly and effectively learn new concepts in a continuous manner without forgetting old knowledge. Though deep learning has made tremendous successes on various computer vision tasks, it faces challenges…

机器学习 · 计算机科学 2022-07-26 Kun Wu , Chengxiang Yin , Jian Tang , Zhiyuan Xu , Yanzhi Wang , Dejun Yang