English
Related papers

Related papers: DSS-Prompt: Dynamic-Static Synergistic Prompting f…

200 papers

Few-Shot Class-Incremental Learning (FSCIL) aims to continuously learn new classes from a limited set of training samples without forgetting knowledge of previously learned classes. Conventional FSCIL methods typically build a robust…

Computer Vision and Pattern Recognition · Computer Science 2025-04-18 Linhao Li , Yongzhang Tan , Siyuan Yang , Hao Cheng , Yongfeng Dong , Liang Yang

Large pre-trained vision-language models, such as CLIP, have shown remarkable generalization capabilities across various tasks when appropriate text prompts are provided. However, adapting these models to specific domains, like remote…

Computer Vision and Pattern Recognition · Computer Science 2023-12-13 Qinglong Cao , Zhengqin Xu , Yuntian Chen , Chao Ma , Xiaokang Yang

Significant advancements have been made in single label incremental learning (SLCIL),yet the more practical and challenging multi label class incremental learning (MLCIL) remains understudied. Recently,visual language models such as CLIP…

Computer Vision and Pattern Recognition · Computer Science 2025-01-06 Haifeng Zhao , Yuguang Jin , Leilei Ma

Data scarcity significantly complicates the continual learning problem, i.e., how a deep neural network learns in dynamic environments with very few samples. However, the latest progress of few-shot class incremental learning (FSCIL)…

Machine Learning · Computer Science 2025-02-13 M. Anwar Ma'sum , Mahardhika Pratama , Igor Skrjanc

Few-shot class-incremental learning (FSCIL) is proposed to continually learn from novel classes with only a few samples after the (pre-)training on base classes with sufficient data. However, this remains a challenge. In contrast, humans…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Yixiong Zou , Shanghang Zhang , Haichen Zhou , Yuhua Li , Ruixuan Li

In continual learning, solving the catastrophic forgetting problem may make the models fall into the stability-plasticity dilemma. Moreover, inter-task confusion will also occur due to the lack of knowledge exchanges between different…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Sheng-Kai Huang , Jiun-Feng Chang , Chun-Rong Huang

Few-shot class-incremental learning (FSCIL) aims to continually fit new classes with limited training data, while maintaining the performance of previously learned classes. The main challenges are overfitting the rare new training samples…

Computer Vision and Pattern Recognition · Computer Science 2024-03-22 Mingli Zhu , Zihao Zhu , Sihong Chen , Chen Chen , Baoyuan Wu

Recent advancements in deep learning have demonstrated remarkable performance comparable to human capabilities across various supervised computer vision tasks. However, the prevalent assumption of having an extensive pool of training data…

Computer Vision and Pattern Recognition · Computer Science 2024-08-16 Anurag Kumar , Chinmay Bharti , Saikat Dutta , Srikrishna Karanam , Biplab Banerjee

Few-shot class-incremental learning (FSCIL) aims to mitigate the catastrophic forgetting issue when a model is incrementally trained on limited data. However, many of these works lack effective exploration of prior knowledge, rendering them…

Computer Vision and Pattern Recognition · Computer Science 2025-01-09 Wan Xu , Tianyu Huang , Tianyu Qu , Guanglei Yang , Yiwen Guo , Wangmeng Zuo

Prompt learning as a parameter-efficient method that has been widely adopted to adapt Vision-Language Models (VLMs) to downstream tasks. While hard-prompt design requires domain expertise and iterative optimization, soft-prompt methods rely…

Computer Vision and Pattern Recognition · Computer Science 2025-05-26 Zherui Zhang , Jiaxin Wu , Changwei Wang , Rongtao Xu , Longzhao Huang , Wenhao Xu , Wenbo Xu , Li Guo , Shibiao Xu

The adaptation of large-scale vision-language models (VLMs) to downstream tasks with limited labeled data remains a significant challenge. While parameter-efficient prompt learning methods offer a promising path, they often suffer from…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Enming Zhang , Jiayang Li , Yanru Wu , Zhenyu Liu , Yang Li

The primary way of building AI applications is shifting from training specialist models to prompting generalist models. A common practice for prompting generalist models, often referred to as in-context learning, is to append a few examples…

Computation and Language · Computer Science 2023-05-19 Wangchunshu Zhou , Yuchen Eleanor Jiang , Ryan Cotterell , Mrinmaya Sachan

Humans can leverage prior experience and learn novel tasks from a handful of demonstrations. In contrast to offline meta-reinforcement learning, which aims to achieve quick adaptation through better algorithm design, we investigate the…

Machine Learning · Computer Science 2022-06-28 Mengdi Xu , Yikang Shen , Shun Zhang , Yuchen Lu , Ding Zhao , Joshua B. Tenenbaum , Chuang Gan

The Contrastive Language-Image Pretraining (CLIP) model has been widely used in various downstream vision tasks. The few-shot learning paradigm has been widely adopted to augment its capacity for these tasks. However, current paradigms may…

Computer Vision and Pattern Recognition · Computer Science 2024-11-22 Jintao Rong , Hao Chen , Linlin Ou , Tianxiao Chen , Xinyi Yu , Yifan Liu

Event detection (ED) is aimed to identify the key trigger words in unstructured text and predict the event types accordingly. Traditional ED models are too data-hungry to accommodate real applications with scarce labeled data. Besides,…

Computation and Language · Computer Science 2023-05-17 Siyuan Wang , Jianming Zheng , Xuejun Hu , Fei Cai , Chengyu Song , Xueshan Luo

Prompt learning is one of the most effective and trending ways to adapt powerful vision-language foundation models like CLIP to downstream datasets by tuning learnable prompt vectors with very few samples. However, although prompt learning…

Computer Vision and Pattern Recognition · Computer Science 2023-04-03 Cairong Zhao , Yubin Wang , Xinyang Jiang , Yifei Shen , Kaitao Song , Dongsheng Li , Duoqian Miao

Dialogue state tracking (DST) module is an important component for task-oriented dialog systems to understand users' goals and needs. Collecting dialogue state labels including slots and values can be costly, especially with the wide…

Computation and Language · Computer Science 2023-01-27 Yuting Yang , Wenqiang Lei , Pei Huang , Juan Cao , Jintao Li , Tat-Seng Chua

Few-shot semantic segmentation (FSS) endeavors to segment unseen classes with only a few labeled samples. Current FSS methods are commonly built on the assumption that their training and application scenarios share similar domains, and…

Computer Vision and Pattern Recognition · Computer Science 2024-06-14 Weizhao He , Yang Zhang , Wei Zhuo , Linlin Shen , Jiaqi Yang , Songhe Deng , Liang Sun

Large pre-trained vision language models (VLMs) have shown impressive zero-shot ability on downstream tasks with manually designed prompt. To further adapt VLMs to downstream tasks, soft prompt is proposed to replace manually designed…

Computer Vision and Pattern Recognition · Computer Science 2024-07-15 Shuanghao Bai , Yuedi Zhang , Wanqi Zhou , Zhirong Luan , Badong Chen

Prompting method is regarded as one of the crucial progress for few-shot nature language processing. Recent research on prompting moves from discrete tokens based ``hard prompts'' to continuous ``soft prompts'', which employ learnable…

Computation and Language · Computer Science 2023-02-06 Yutai Hou , Hongyuan Dong , Xinghao Wang , Bohan Li , Wanxiang Che