English
Related papers

Related papers: Big-model Driven Few-shot Continual Learning

200 papers

Most of the recent few-shot learning (FSL) algorithms are based on transfer learning, where a model is pre-trained using a large amount of source data, and the pre-trained model is fine-tuned using a small amount of target data. In transfer…

Machine Learning · Computer Science 2022-08-22 Yujin Kim , Jaehoon Oh , Sungnyun Kim , Se-Young Yun

In machine learning applications, it is common practice to feed as much information as possible. In most cases, the model can handle large data sets that allow to predict more accurately. In the presence of data scarcity, a Few-Shot…

Computer Vision and Pattern Recognition · Computer Science 2023-05-04 Saad Bin Ahmed , Umaid M. Zaffar , Marium Aslam , Muhammad Imran Malik

Recent studies on few-shot classification using transfer learning pose challenges to the effectiveness and efficiency of episodic meta-learning algorithms. Transfer learning approaches are a natural alternative, but they are restricted to…

Machine Learning · Computer Science 2022-05-03 Kuilin Chen , Chi-Guhn Lee

The proliferation of end devices has led to a distributed computing paradigm, wherein on-device machine learning models continuously process diverse data generated by these devices. The dynamic nature of this data, characterized by…

Machine Learning · Computer Science 2025-05-02 Zhengyi Zhong , Weidong Bao , Ji Wang , Jianguo Chen , Lingjuan Lyu , Wei Yang Bryan Lim

This paper presents SPeCiaL: a method for unsupervised pretraining of representations tailored for continual learning. Our approach devises a meta-learning objective that differentiates through a sequential learning process. Specifically,…

Computer Vision and Pattern Recognition · Computer Science 2021-06-18 Lucas Caccia , Joelle Pineau

The continual appearance of new objects in the visual world poses considerable challenges for current deep learning methods in real-world deployments. The challenge of new task learning is often exacerbated by the scarcity of data for the…

Computer Vision and Pattern Recognition · Computer Science 2022-08-02 Can Peng , Kun Zhao , Tianren Wang , Meng Li , Brian C. Lovell

Few-shot learning (FSL) aims to recognize novel concepts from only a few labeled support samples. Recent studies enhance support features by incorporating additional semantic information or designing complex semantic fusion modules.…

Computer Vision and Pattern Recognition · Computer Science 2025-10-24 Wenhao Li , Qiangchang Wang , Xianjing Meng , Zhibin Wu , Yilong Yin

The field of Few-Shot Learning (FSL), or learning from very few (typically $1$ or $5$) examples per novel class (unseen during training), has received a lot of attention and significant performance advances in the recent literature. While…

Computer Vision and Pattern Recognition · Computer Science 2020-03-17 Moshe Lichtenstein , Prasanna Sattigeri , Rogerio Feris , Raja Giryes , Leonid Karlinsky

Humans have a unique ability to learn new representations from just a handful of examples with little to no supervision. Deep learning models, however, require an abundance of data and supervision to perform at a satisfactory level.…

Computer Vision and Pattern Recognition · Computer Science 2022-10-13 Ojas Kishorkumar Shirekar , Anuj Singh , Hadi Jamali-Rad

Due to the availability of only a few labeled instances for the novel target prediction task and the significant domain shift between the well annotated source domain and the target domain, cross-domain few-shot learning (CDFSL) induces a…

Machine Learning · Computer Science 2023-12-08 Abdullah Alchihabi , Marzi Heidari , Yuhong Guo

Metric-based meta-learning techniques have successfully been applied to few-shot classification problems. In this paper, we propose to leverage cross-modal information to enhance metric-based few-shot learning methods. Visual and semantic…

Machine Learning · Computer Science 2020-02-19 Chen Xing , Negar Rostamzadeh , Boris N. Oreshkin , Pedro O. Pinheiro

In this paper, we propose to tackle the challenging few-shot learning (FSL) problem by learning global class representations using both base and novel class training samples. In each training episode, an episodic class mean computed from a…

Computer Vision and Pattern Recognition · Computer Science 2019-08-15 Tiange Luo , Aoxue Li , Tao Xiang , Weiran Huang , Liwei Wang

In this paper, we present a new method, Transductive Multi-Head Few-Shot learning (TMHFS), to address the Cross-Domain Few-Shot Learning (CD-FSL) challenge. The TMHFS method extends the Meta-Confidence Transduction (MCT) and Dense…

Computer Vision and Pattern Recognition · Computer Science 2020-06-23 Jianan Jiang , Zhenpeng Li , Yuhong Guo , Jieping Ye

Few-shot learning (FSL) has shown promise in vision but remains largely unexplored for \emph{industrial} time-series data, where annotating every new defect is prohibitively expensive. We present a systematic FSL study on screw-fastening…

Machine Learning · Computer Science 2025-11-20 Xinyuan Tu

Few-shot learning aims to train a classifier that can generalize well when just a small number of labeled examples per class are given. We introduce a transductive maximum margin classifier for few-shot learning (FS-TMMC). The basic idea of…

Computer Vision and Pattern Recognition · Computer Science 2021-10-29 Fei Pan , Chunlei Xu , Jie Guo , Yanwen Guo

Transductive Few-Shot learning has gained increased attention nowadays considering the cost of data annotations along with the increased accuracy provided by unlabelled samples in the domain of few shot. Especially in Few-Shot…

Machine Learning · Computer Science 2022-09-20 Yuqing Hu , Stéphane Pateux , Vincent Gripon

Recently, few-shot object detection~(FSOD) has received much attention from the community, and many methods are proposed to address this problem from a knowledge transfer perspective. Though promising results have been achieved, these…

Computer Vision and Pattern Recognition · Computer Science 2022-10-06 Zhiyuan Zhao , Qingjie Liu , Yunhong Wang

Humans exhibit a remarkable ability to learn quickly from a limited number of labeled samples, a capability that starkly contrasts with that of current machine learning systems. Unsupervised Few-Shot Learning (U-FSL) seeks to bridge this…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Zhenyu Zhang , Guangyao Chen , Yixiong Zou , Zhimeng Huang , Yuhua Li , Ruixuan Li

Real-world object detection is highly desired to be equipped with the learning expandability that can enlarge its detection classes incrementally. Moreover, such learning from only few annotated training samples further adds the flexibility…

Computer Vision and Pattern Recognition · Computer Science 2021-09-24 Yiting Li , Haiyue Zhu , Jun Ma , Chek Sing Teo , Cheng Xiang , Prahlad Vadakkepat , Tong Heng Lee

Cross-domain few-shot learning (CDFSL) aims to acquire knowledge from limited training data in the target domain by leveraging prior knowledge transferred from source domains with abundant training samples. CDFSL faces challenges in…

Computer Vision and Pattern Recognition · Computer Science 2024-04-22 Yixiong Zou , Yicong Liu , Yiman Hu , Yuhua Li , Ruixuan Li