English
Related papers

Related papers: PIVOT: Prompting for Video Continual Learning

200 papers

Traditional deep learning-based visual imitation learning techniques require a large amount of demonstration data for model training, and the pre-trained models are difficult to adapt to new scenarios. To address these limitations, we…

Robotics · Computer Science 2022-04-26 Dandan Zhang , Wen Fan , John Lloyd , Chenguang Yang , Nathan Lepora

The remarkable success of deep learning in various domains relies on the availability of large-scale annotated datasets. However, obtaining annotations is expensive and requires great effort, which is especially challenging for videos.…

Computer Vision and Pattern Recognition · Computer Science 2023-07-20 Madeline C. Schiappa , Yogesh S. Rawat , Mubarak Shah

Deep artificial neural networks famously struggle to learn from non-stationary streams of data. Without dedicated mitigation strategies, continual learning is associated with continuous forgetting of previous tasks and a progressive loss of…

Neurons and Cognition · Quantitative Biology 2025-12-29 Suzanne van der Veldt , Gido M. van de Ven , Sanne Moorman , Guillaume Etter

The fourth edition of the "VIPriors: Visual Inductive Priors for Data-Efficient Deep Learning" workshop features two data-impaired challenges. These challenges address the problem of training deep learning models for computer vision tasks…

Computer Vision and Pattern Recognition · Computer Science 2024-07-02 Robert-Jan Bruintjes , Attila Lengyel , Marcos Baptista Rios , Osman Semih Kayhan , Davide Zambrano , Nergis Tomen , Jan van Gemert

Continual Learning is considered a key step toward next-generation Artificial Intelligence. Among various methods, replay-based approaches that maintain and replay a small episodic memory of previous samples are one of the most successful…

Machine Learning · Computer Science 2022-12-27 Guangji Bai , Chen Ling , Yuyang Gao , Liang Zhao

Although data-free incremental learning methods are memory-friendly, accurately estimating and counteracting representation shifts is challenging in the absence of historical data. This paper addresses this thorny problem by proposing a…

Computer Vision and Pattern Recognition · Computer Science 2023-03-27 Zhiheng Ma , Xiaopeng Hong , Beinan Liu , Yabin Wang , Pinyue Guo , Huiyun Li

In continual learning, solving the catastrophic forgetting problem may make the models fall into the stability-plasticity dilemma. Moreover, inter-task confusion will also occur due to the lack of knowledge exchanges between different…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Sheng-Kai Huang , Jiun-Feng Chang , Chun-Rong Huang

Continual learning (CL) is under-explored in the video domain. The few existing works contain splits with imbalanced class distributions over the tasks, or study the problem in unsuitable datasets. We introduce vCLIMB, a novel video…

Computer Vision and Pattern Recognition · Computer Science 2022-04-07 Andrés Villa , Kumail Alhamoud , Juan León Alcázar , Fabian Caba Heilbron , Victor Escorcia , Bernard Ghanem

Continual lifelong learning requires an agent or model to learn many sequentially ordered tasks, building on previous knowledge without catastrophically forgetting it. Much work has gone towards preventing the default tendency of machine…

Machine Learning · Computer Science 2020-03-05 Shawn Beaulieu , Lapo Frati , Thomas Miconi , Joel Lehman , Kenneth O. Stanley , Jeff Clune , Nick Cheney

Class-incremental learning is one of the most important settings for the study of Continual Learning, as it closely resembles real-world application scenarios. With constrained memory sizes, catastrophic forgetting arises as the number of…

Computer Vision and Pattern Recognition · Computer Science 2023-06-29 Lama Alssum , Juan Leon Alcazar , Merey Ramazanova , Chen Zhao , Bernard Ghanem

We propose a new method for exemplar-free class incremental training of ViTs. The main challenge of exemplar-free continual learning is maintaining plasticity of the learner without causing catastrophic forgetting of previously learned…

Computer Vision and Pattern Recognition · Computer Science 2023-07-28 Marco Cotogni , Fei Yang , Claudio Cusano , Andrew D. Bagdanov , Joost van de Weijer

Many recent delineation techniques owe much of their increased effectiveness to path classification algorithms that make it possible to distinguish promising paths from others. The downside of this development is that they require annotated…

Computer Vision and Pattern Recognition · Computer Science 2015-12-03 Agata Mosinska , Raphael Sznitman , Przemysław Głowacki , Pascal Fua

Existing prompt-tuning methods have demonstrated impressive performances in continual learning (CL), by selecting and updating relevant prompts in the vision-transformer models. On the contrary, this paper aims to learn each task by tuning…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Yue Lu , Shizhou Zhang , De Cheng , Yinghui Xing , Nannan Wang , Peng Wang , Yanning Zhang

Visual prompt tuning (VPT) is a promising solution incorporating learnable prompt tokens to customize pre-trained models for downstream tasks. However, VPT and its variants often encounter challenges like prompt initialization, prompt…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Yuzhu Wang , Lechao Cheng , Chaowei Fang , Dingwen Zhang , Manni Duan , Meng Wang

Modern deep recommender models are trained under a continual learning paradigm, relying on massive and continuously growing streaming behavioral logs. In large-scale platforms, retraining models on full historical data for architecture…

Information Retrieval · Computer Science 2026-03-27 Jiaqing Zhang , Hao Wang , Mingjia Yin , Bo Chen , Qinglin Jia , Rui Zhou , Ruiming Tang , ChaoYi Ma , Enhong Chen

Continual learning aims to enable models to learn sequentially from continuously incoming data while retaining performance on previously learned tasks. With the Contrastive Language-Image Pre-trained model (CLIP) exhibiting strong…

Computer Vision and Pattern Recognition · Computer Science 2025-07-15 Linlan Huang , Xusheng Cao , Haori Lu , Yifan Meng , Fei Yang , Xialei Liu

Recent state-of-the-art semi-supervised Video Object Segmentation (VOS) methods have shown significant improvements in target object segmentation accuracy when information from preceding frames is used in segmenting the current frame. In…

Computer Vision and Pattern Recognition · Computer Science 2024-02-15 Amir Nazemi , Mohammad Javad Shafiee , Zahra Gharaee , Paul Fieguth

Modern deep-learning systems are specialized to problem settings in which training occurs once and then never again, as opposed to continual-learning settings in which training occurs continually. If deep-learning systems are applied in a…

Machine Learning · Computer Science 2024-04-11 Shibhansh Dohare , J. Fernando Hernandez-Garcia , Parash Rahman , A. Rupam Mahmood , Richard S. Sutton

Applying an image processing algorithm independently to each video frame often leads to temporal inconsistency in the resulting video. To address this issue, we present a novel and general approach for blind video temporal consistency. Our…

Computer Vision and Pattern Recognition · Computer Science 2022-01-28 Chenyang Lei , Yazhou Xing , Hao Ouyang , Qifeng Chen

User behavior on online platforms is evolving, reflecting real-world changes in how people post, whether it's helpful messages or hate speech. Models that learn to capture this content can experience a decrease in performance over time due…

Machine Learning · Computer Science 2025-11-04 Yasas Senarath , Hemant Purohit