English
Related papers

Related papers: Generalization Bounds for Few-Shot Transfer Learni…

200 papers

Transfer learning is widely used to adapt large pretrained models to new tasks with only a small amount of new data. However, a challenge persists -- the features from the original task often do not fully cover what is needed for unseen…

Machine Learning · Computer Science 2026-02-10 Xingyu Alice Yang , Jianyu Zhang , Léon Bottou

The goal of few-shot learning is to learn a classifier that can recognize unseen classes from limited support data with labels. A common practice for this task is to train a model on the base set first and then transfer to novel classes…

Computer Vision and Pattern Recognition · Computer Science 2021-02-09 Zhiqiang Shen , Zechun Liu , Jie Qin , Marios Savvides , Kwang-Ting Cheng

Few-shot classification requires adapting knowledge learned from a large annotated base dataset to recognize novel unseen classes, each represented by few labeled examples. In such a scenario, pretraining a network with high capacity on the…

Computer Vision and Pattern Recognition · Computer Science 2021-12-08 Yiren Jian , Lorenzo Torresani

Learning novel classes from a very few labeled samples has attracted increasing attention in machine learning areas. Recent research on either meta-learning based or transfer-learning based paradigm demonstrates that gaining information on…

Computer Vision and Pattern Recognition · Computer Science 2022-01-05 Bingbin Li , Elvis Han Cui , Yanan Li , Donghui Wang , Weng Kee Wong

By transferring knowledge learned from seen/previous tasks, meta learning aims to generalize well to unseen/future tasks. Existing meta-learning approaches have shown promising empirical performance on various multiclass classification…

Machine Learning · Computer Science 2020-12-04 Jiechao Guan , Zhiwu Lu , Tao Xiang , Timothy Hospedales

Learning high quality class representations from few examples is a key problem in metric-learning approaches to few-shot learning. To accomplish this, we introduce a novel architecture where class representations are conditioned for each…

Machine Learning · Computer Science 2018-02-14 Nathan Hilliard , Lawrence Phillips , Scott Howland , Artëm Yankov , Courtney D. Corley , Nathan O. Hodas

Few-shot learning aims to recognize novel queries with limited support samples by learning from base knowledge. Recent progress in this setting assumes that the base knowledge and novel query samples are distributed in the same domains,…

Computer Vision and Pattern Recognition · Computer Science 2023-06-21 Yifan Zhao , Tong Zhang , Jia Li , Yonghong Tian

Towards the challenging problem of semi-supervised node classification, there have been extensive studies. As a frontier, Graph Neural Networks (GNNs) have aroused great interest recently, which update the representation of each node by…

Machine Learning · Computer Science 2020-05-12 Huaxiu Yao , Chuxu Zhang , Ying Wei , Meng Jiang , Suhang Wang , Junzhou Huang , Nitesh V. Chawla , Zhenhui Li

Few-shot learning has attracted intensive research attention in recent years. Many methods have been proposed to generalize a model learned from provided base classes to novel classes, but no previous work studies how to select base…

Computer Vision and Pattern Recognition · Computer Science 2020-04-02 Linjun Zhou , Peng Cui , Xu Jia , Shiqiang Yang , Qi Tian

Object-centric representations promise a key property for few-shot learning: Rather than treating a scene as a single unit, a model can decompose it into individual object-level parts that can be matched and compared across different…

Machine Learning · Computer Science 2026-05-19 Phu-Quy Nguyen-Lam , Phu-Hoa Pham , Dao Sy Duy Minh , Chi-Nguyen Tran , Huynh Trung Kiet , Long Tran-Thanh

In contemporary deep learning, a prevalent and effective workflow for solving low-data problems is adapting powerful pre-trained foundation models (FMs) to new tasks via parameter-efficient fine-tuning (PEFT). However, while empirically…

Machine Learning · Computer Science 2025-05-29 Fady Rezk , Royson Lee , Henry Gouk , Timothy Hospedales , Minyoung Kim

One of the most significant challenges facing a few-shot learning task is the generalizability of the (meta-)model from the base to the novel categories. Most of existing few-shot learning models attempt to address this challenge by either…

Computer Vision and Pattern Recognition · Computer Science 2020-01-01 Haohang Xu , Hongkai Xiong , Guojun Qi

With the continuous development of natural language processing (NLP) technology, text classification tasks have been widely used in multiple application fields. However, obtaining labeled data is often expensive and difficult, especially in…

Computation and Language · Computer Science 2025-02-14 Jia Gao , Shuangquan Lyu , Guiran Liu , Binrong Zhu , Hongye Zheng , Xiaoxuan Liao

The estimation of the generalization error of classifiers often relies on a validation set. Such a set is hardly available in few-shot learning scenarios, a highly disregarded shortcoming in the field. In these scenarios, it is common to…

Generalized few-shot semantic segmentation (GFSS) aims to segment objects of both base and novel classes, using sufficient samples of base classes and few samples of novel classes. Representative GFSS approaches typically employ a two-phase…

Computer Vision and Pattern Recognition · Computer Science 2024-12-23 Xinyue Chen , Miaojing Shi , Zijian Zhou , Lianghua He , Sophia Tsoka

Few-shot learning aims to recognize new categories using very few labeled samples. Although few-shot learning has witnessed promising development in recent years, most existing methods adopt an average operation to calculate prototypes,…

Computer Vision and Pattern Recognition · Computer Science 2021-08-26 Minglei Yuan , Wenhai Wang , Tao Wang , Chunhao Cai , Qian Xu , Tong Lu

Although few-shot learning research has advanced rapidly with the help of meta-learning, its practical usefulness is still limited because most of them assumed that all meta-training and meta-testing examples came from a single domain. We…

Machine Learning · Computer Science 2020-09-18 Yongseok Choi , Junyoung Park , Subin Yi , Dong-Yeon Cho

We propose a method that can perform one-class classification given only a small number of examples from the target class and none from the others. We formulate the learning of meaningful features for one-class classification as a…

Computer Vision and Pattern Recognition · Computer Science 2021-04-26 Gabriel Dahia , Maurício Pamplona Segundo

The training of deep-learning-based text classification models relies heavily on a huge amount of annotation data, which is difficult to obtain. When the labeled data is scarce, models tend to struggle to achieve satisfactory performance.…

Computation and Language · Computer Science 2020-04-07 Dianbo Sui , Yubo Chen , Binjie Mao , Delai Qiu , Kang Liu , Jun Zhao

Learning with limited data is a key challenge for visual recognition. Many few-shot learning methods address this challenge by learning an instance embedding function from seen classes and apply the function to instances from unseen classes…

Machine Learning · Computer Science 2021-06-15 Han-Jia Ye , Hexiang Hu , De-Chuan Zhan , Fei Sha