English
Related papers

Related papers: Pre-trained Vision and Language Transformers Are F…

200 papers

Vision Transformers (ViTs) emerge to achieve impressive performance on many data-abundant computer vision tasks by capturing long-range dependencies among local features. However, under few-shot learning (FSL) settings on small datasets…

Computer Vision and Pattern Recognition · Computer Science 2023-03-31 Han Lin , Guangxing Han , Jiawei Ma , Shiyuan Huang , Xudong Lin , Shih-Fu Chang

Few-Shot Class-Incremental Learning (FSCIL) must contend with the dual challenge of learning new classes from scarce samples while preserving old class knowledge. Existing methods use the frozen feature extractor and class-averaged…

Computer Vision and Pattern Recognition · Computer Science 2026-02-04 Zeyu He , Shuai Huang , Yuwu Lu , Ming Zhao

Large pre-trained vision-language (VL) models can learn a new task with a handful of examples and generalize to a new task without fine-tuning. However, these VL models are hard to deploy for real-world applications due to their…

Computer Vision and Pattern Recognition · Computer Science 2022-03-16 Woojeong Jin , Yu Cheng , Yelong Shen , Weizhu Chen , Xiang Ren

Few-shot learning (FSL) techniques seek to learn the underlying patterns in data using fewer samples, analogous to how humans learn from limited experience. In this limited-data scenario, the challenges associated with deep neural networks,…

Computer Vision and Pattern Recognition · Computer Science 2023-04-14 Deepan Chakravarthi Padmanabhan , Shruthi Gowda , Elahe Arani , Bahram Zonooz

The emergent ability of Large Language Models to use a small number of examples to learn to perform in novel domains and tasks, also called in-context learning (ICL). In this work, we show that a much smaller model can be trained to perform…

Computation and Language · Computer Science 2023-09-18 Raphael Reinauer , Patrick Simianer , Kaden Uhlig , Johannes E. M. Mosig , Joern Wuebker

Continual learning (CL) can help pre-trained vision-language models efficiently adapt to new or under-trained data distributions without re-training. Nevertheless, during the continual training of the Contrastive Language-Image Pre-training…

Computer Vision and Pattern Recognition · Computer Science 2023-08-14 Zangwei Zheng , Mingyuan Ma , Kai Wang , Ziheng Qin , Xiangyu Yue , Yang You

Incremental Learning (IL) aims to learn new tasks while preserving previously acquired knowledge. Integrating the zero-shot learning capabilities of pre-trained vision-language models into IL methods has marked a significant advancement.…

Computer Vision and Pattern Recognition · Computer Science 2026-03-20 Haihua Luo , Xuming Ran , Jiangrong Shen , Timo Hämäläinen , Zhonghua Chen , Qi Xu , Fengyu Cong

Few-shot learning (FSL) has emerged as an effective learning method and shows great potential. Despite the recent creative works in tackling FSL tasks, learning valid information rapidly from just a few or even zero samples still remains a…

Machine Learning · Computer Science 2022-05-25 Yisheng Song , Ting Wang , Subrota K Mondal , Jyoti Prakash Sahoo

Conventional detection networks usually need abundant labeled training samples, while humans can learn new concepts incrementally with just a few examples. This paper focuses on a more challenging but realistic class-incremental few-shot…

Computer Vision and Pattern Recognition · Computer Science 2021-12-30 Pengyang Li , Yanan Li , Han Cui , Donghui Wang

Object recognition in the real-world requires handling long-tailed or even open-ended data. An ideal visual system needs to recognize the populated head visual concepts reliably and meanwhile efficiently learn about emerging new tail…

Computer Vision and Pattern Recognition · Computer Science 2021-06-29 Han-Jia Ye , Hexiang Hu , De-Chuan Zhan

Most existing studies on few-shot learning focus on unimodal settings, where models are trained to generalize to unseen data using a limited amount of labeled examples from a single modality. However, real-world data are inherently…

Computer Vision and Pattern Recognition · Computer Science 2025-03-12 Zhengwei Yang , Yuke Li , Qiang Sun , Basura Fernando , Heng Huang , Zheng Wang

The goal of Few-Shot Continual Learning (FSCL) is to incrementally learn novel tasks with limited labeled samples and preserve previous capabilities simultaneously, while current FSCL methods are all for the class-incremental purpose.…

Computer Vision and Pattern Recognition · Computer Science 2023-02-14 Yawen Cui , Zitong Yu , Rizhao Cai , Xun Wang , Alex C. Kot , Li Liu

Few-shot class-incremental learning (FSCIL) poses significant challenges for artificial neural networks due to the need to efficiently learn from limited data while retaining knowledge of previously learned tasks. Inspired by the brain's…

Computer Vision and Pattern Recognition · Computer Science 2025-02-27 Wanyi Li , Wei Wei , Yongkang Luo , Peng Wang

Pre-trained vision-language models learn massive data to model unified representations of images and natural languages, which can be widely applied to downstream machine learning tasks. In addition to zero-shot inference, in order to better…

Computer Vision and Pattern Recognition · Computer Science 2024-06-28 Qian-Wei Wang , Yuqiu Xie , Letian Zhang , Zimo Liu , Shu-Tao Xia

Incremental learning remains a critical challenge in machine learning, as models often struggle with catastrophic forgetting -the tendency to lose previously acquired knowledge when learning new information. These challenges are even more…

Large-scale pre-trained Vision-Language Models (VLMs) have exhibited impressive zero-shot performance and transferability, allowing them to adapt to downstream tasks in a data-efficient manner. However, when only a few labeled samples are…

Computer Vision and Pattern Recognition · Computer Science 2024-11-11 Ce Zhang , Simon Stepputtis , Katia Sycara , Yaqi Xie

Modern computer vision applications suffer from catastrophic forgetting when incrementally learning new concepts over time. The most successful approaches to alleviate this forgetting require extensive replay of previously seen data, which…

Computer Vision and Pattern Recognition · Computer Science 2021-08-20 James Smith , Yen-Chang Hsu , Jonathan Balloch , Yilin Shen , Hongxia Jin , Zsolt Kira

Foundational Vision-Language Models (VLMs) excel across diverse tasks, but adapting them to new domains without forgetting prior knowledge remains a critical challenge. Continual Learning (CL) addresses this challenge by enabling models to…

Machine Learning · Computer Science 2026-02-03 Vaibhav Singh , Rahaf Aljundi , Eugene Belilovsky

Vision-language models (VLMs) like CLIP have shown impressive generalization capabilities, yet their potential for Cross-Domain Few-Shot Learning (CDFSL) remains underexplored, where the model needs to transfer source-domain information to…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Shuai Yi , Yixiong Zou , Yuhua Li , Ruixuan Li

Source-Free Cross-Domain Few-Shot Learning (SF-CDFSL) focuses on fine-tuning with limited training data from target domains (e.g., medical or satellite images), where Vision-Language Models (VLMs) such as CLIP and SigLIP have shown…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Zhenyu Zhang , Yixiong Zou , Yuhua Li , Ruixuan Li , Guangyao Chen