English
Related papers

Related papers: Revisiting Fine-tuning for Few-shot Learning

200 papers

In recent works, utilizing a deep network trained on meta-training set serves as a strong baseline in few-shot learning. In this paper, we move forward to refine novel-class features by finetuning a trained deep network. Finetuning is…

Computer Vision and Pattern Recognition · Computer Science 2022-06-06 Ran Tao , Han Zhang , Yutong Zheng , Marios Savvides

Few-shot segmentation targets to segment new classes with few annotated images provided. It is more challenging than traditional semantic segmentation tasks that segment known classes with abundant annotated images. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2020-05-12 Jinlu Liu , Yongqiang Qin

This paper tackles the problem of few-shot learning, which aims to learn new visual concepts from a few examples. A common problem setting in few-shot classification assumes random sampling strategy in acquiring data labels, which is…

Computer Vision and Pattern Recognition · Computer Science 2022-01-10 Shipeng Yan , Songyang Zhang , Xuming He

Few-shot classification aims to recognize novel categories with only few labeled images in each class. Existing metric-based few-shot classification algorithms predict categories by comparing the feature embeddings of query images with…

Computer Vision and Pattern Recognition · Computer Science 2020-03-10 Hung-Yu Tseng , Hsin-Ying Lee , Jia-Bin Huang , Ming-Hsuan Yang

Few-shot learning aims to build classifiers for new classes from a small number of labeled examples and is commonly facilitated by access to examples from a distinct set of 'base classes'. The difference in data distribution between the…

Computer Vision and Pattern Recognition · Computer Science 2021-04-26 Zitian Chen , Subhransu Maji , Erik Learned-Miller

Deep neural networks are highly effective when a large number of labeled samples are available but fail with few-shot classification tasks. Recently, meta-learning methods have received much attention, which train a meta-learner on massive…

Computer Vision and Pattern Recognition · Computer Science 2020-07-14 Yucan Zhou , Yu Wang , Jianfei Cai , Yu Zhou , Qinghua Hu , Weiping Wang

Many real-world classification problems often have classes with very few labeled training samples. Moreover, all possible classes may not be initially available for training, and may be given incrementally. Deep learning models need to deal…

Computer Vision and Pattern Recognition · Computer Science 2021-03-02 Pratik Mazumder , Pravendra Singh , Piyush Rai

In this paper, we propose a simple but effective method for training neural networks with a limited amount of training data. Our approach inherits the idea of knowledge distillation that transfers knowledge from a deep or wide reference…

Machine Learning · Statistics 2018-07-06 Akisato Kimura , Zoubin Ghahramani , Koh Takeuchi , Tomoharu Iwata , Naonori Ueda

We propose prototypical networks for the problem of few-shot classification, where a classifier must generalize to new classes not seen in the training set, given only a small number of examples of each new class. Prototypical networks…

Machine Learning · Computer Science 2017-06-21 Jake Snell , Kevin Swersky , Richard S. Zemel

Few-shot learning is challenging due to its very limited data and labels. Recent studies in big transfer (BiT) show that few-shot learning can greatly benefit from pretraining on large scale labeled dataset in a different domain. This paper…

Computer Vision and Pattern Recognition · Computer Science 2020-12-11 Suichan Li , Dongdong Chen , Yinpeng Chen , Lu Yuan , Lei Zhang , Qi Chu , Nenghai Yu

Few-shot learning is a fundamental task in computer vision that carries the promise of alleviating the need for exhaustively labeled data. Most few-shot learning approaches to date have focused on progressively more complex neural feature…

Computer Vision and Pattern Recognition · Computer Science 2020-06-12 Peyman Bateni , Raghav Goyal , Vaden Masrani , Frank Wood , Leonid Sigal

Few-shot learning aims to recognize novel classes with few examples. Pre-training based methods effectively tackle the problem by pre-training a feature extractor and then fine-tuning it through the nearest centroid based meta-learning.…

Computer Vision and Pattern Recognition · Computer Science 2021-08-21 Baoquan Zhang , Xutao Li , Yunming Ye , Shanshan Feng

Empirical science of neural scaling laws is a rapidly growing area of significant importance to the future of machine learning, particularly in the light of recent breakthroughs achieved by large-scale pre-trained models such as GPT-3, CLIP…

Machine Learning · Computer Science 2021-10-20 Gabriele Prato , Simon Guiroy , Ethan Caballero , Irina Rish , Sarath Chandar

Few-shot classification requires adapting knowledge learned from a large annotated base dataset to recognize novel unseen classes, each represented by few labeled examples. In such a scenario, pretraining a network with high capacity on the…

Computer Vision and Pattern Recognition · Computer Science 2021-12-08 Yiren Jian , Lorenzo Torresani

The objective of Few-shot learning is to fully leverage the limited data resources for exploring the latent correlations within the data by applying algorithms and training a model with outstanding performance that can adequately meet the…

Computer Vision and Pattern Recognition · Computer Science 2025-06-24 Wenqing Zhao , Guojia Xie , Han Pan , Biao Yang , Weichuan Zhang

In few-shot classification, we are interested in learning algorithms that train a classifier from only a handful of labeled examples. Recent progress in few-shot classification has featured meta-learning, in which a parameterized model for…

Low-shot visual learning---the ability to recognize novel object categories from very few examples---is a hallmark of human visual intelligence. Existing machine learning approaches fail to generalize in the same way. To make progress on…

Computer Vision and Pattern Recognition · Computer Science 2017-11-07 Bharath Hariharan , Ross Girshick

Deep networks can learn to accurately recognize objects of a category by training on a large number of annotated images. However, a meta-learning challenge known as a low-shot image recognition task comes when only a few images with…

Computer Vision and Pattern Recognition · Computer Science 2021-01-14 Mengting Chen , Xinggang Wang , Heng Luo , Yifeng Geng , Wenyu Liu

Few-shot deep learning is a topical challenge area for scaling visual recognition to open ended growth of unseen new classes with limited labeled examples. A promising approach is based on metric learning, which trains a deep embedding to…

Computer Vision and Pattern Recognition · Computer Science 2020-04-29 Xueting Zhang , Yuting Qiang , Flood Sung , Yongxin Yang , Timothy M. Hospedales

Time-series forecasting is important for many applications. Forecasting models are usually trained using time-series data in a specific target task. However, sufficient data in the target task might be unavailable, which leads to…

Machine Learning · Statistics 2020-10-01 Tomoharu Iwata , Atsutoshi Kumagai