English
Related papers

Related papers: New Insights on Relieving Task-Recency Bias for On…

200 papers

Class-incremental learning is a challenging problem, where the goal is to train a model that can classify data from an increasing number of classes over time. With the advancement of vision-language pre-trained models such as CLIP, they…

Computer Vision and Pattern Recognition · Computer Science 2024-07-22 Linlan Huang , Xusheng Cao , Haori Lu , Xialei Liu

Feature Distillation (FD) strategies are proven to be effective in mitigating Catastrophic Forgetting (CF) seen in Class Incremental Learning (CIL). However, current FD approaches enforce strict alignment of feature magnitudes and…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 S Balasubramanian , Yedu Krishna P , Talasu Sai Sriram , M Sai Subramaniam , Manepalli Pranav Phanindra Sai , Darshan Gera

In a conventional supervised learning setting, a machine learning model has access to examples of all object classes that are desired to be recognized during the inference stage. This results in a fixed model that lacks the flexibility to…

Computer Vision and Pattern Recognition · Computer Science 2020-01-27 Jathushan Rajasegaran , Munawar Hayat , Salman Khan , Fahad Shahbaz Khan , Ling Shao , Ming-Hsuan Yang

Multistream classification poses significant challenges due to the necessity for rapid adaptation in dynamic streaming processes with concept drift. Despite the growing research outcomes in this area, there has been a notable oversight…

Machine Learning · Computer Science 2024-01-02 En Yu , Jie Lu , Bin Zhang , Guangquan Zhang

Traditional online continual learning (OCL) research has primarily focused on mitigating catastrophic forgetting with fixed and limited storage allocation throughout an agent's lifetime. However, a broad range of real-world applications are…

Computer Vision and Pattern Recognition · Computer Science 2023-11-03 Ameya Prabhu , Zhipeng Cai , Puneet Dokania , Philip Torr , Vladlen Koltun , Ozan Sener

Food image classification is essential for monitoring health and tracking dietary in image-based dietary assessment methods. However, conventional systems often rely on static datasets with fixed classes and uniform distribution. In…

Computer Vision and Pattern Recognition · Computer Science 2024-01-17 Siddeshwar Raghavan , Jiangpeng He , Fengqing Zhu

Recently, because of the high-quality representations of contrastive learning methods, rehearsal-based contrastive continual learning has been proposed to explore how to continually learn transferable representation embeddings to avoid the…

Machine Learning · Computer Science 2024-03-08 Jiyong Li , Dilshod Azizov , Yang Li , Shangsong Liang

Continual learning enables AI models to learn new data sequentially without retraining in real-world scenarios. Most existing methods assume the training data are balanced, aiming to reduce the catastrophic forgetting problem that models…

Machine Learning · Computer Science 2024-08-21 Di Fang , Yinan Zhu , Runze Fang , Cen Chen , Ziqian Zeng , Huiping Zhuang

Exemplar-free class-incremental learning is very challenging due to the negative effect of catastrophic forgetting. A balance between stability and plasticity of the incremental process is needed in order to obtain good accuracy for past as…

Computer Vision and Pattern Recognition · Computer Science 2023-11-29 Grégoire Petit , Adrian Popescu , Hugo Schindler , David Picard , Bertrand Delezoide

Exemplar-based class-incremental learning is to recognize new classes while not forgetting old ones, whose samples can only be saved in limited memory. The ratio fluctuation of new samples to old exemplars, which is caused by the variation…

Computer Vision and Pattern Recognition · Computer Science 2022-02-22 Zhiheng Liu , Kai Zhu , Yang Cao

Federated Learning (FL) enables collaborative model training among participants while guaranteeing the privacy of raw data. Mainstream FL methodologies overlook the dynamic nature of real-world data, particularly its tendency to grow in…

Machine Learning · Computer Science 2024-04-18 Zhiyuan Wu , Tianliu He , Sheng Sun , Yuwei Wang , Min Liu , Bo Gao , Xuefeng Jiang

Continual learning (CL) remains a significant challenge for deep neural networks, as it is prone to forgetting previously acquired knowledge. Several approaches have been proposed in the literature, such as experience rehearsal,…

Machine Learning · Computer Science 2024-05-24 Prashant Bhat , Bharath Renjith , Elahe Arani , Bahram Zonooz

The ability of artificial agents to increment their capabilities when confronted with new data is an open challenge in artificial intelligence. The main challenge faced in such cases is catastrophic forgetting, i.e., the tendency of neural…

Machine Learning · Computer Science 2020-12-16 Eden Belouadah , Adrian Popescu , Ioannis Kanellos

Continual learning aims to rapidly and continually learn the current task from a sequence of tasks. Compared to other kinds of methods, the methods based on experience replay have shown great advantages to overcome catastrophic forgetting.…

Machine Learning · Computer Science 2022-09-14 Ya-nan Han , Jian-wei Liu

In real-world applications, dynamic scenarios require the models to possess the capability to learn new tasks continuously without forgetting the old knowledge. Experience-Replay methods store a subset of the old images for joint training.…

Computer Vision and Pattern Recognition · Computer Science 2024-03-13 Xinyuan Gao , Songlin Dong , Yuhang He , Xing Wei , Yihong Gong

Online Continual Learning (OCL) for image classification represents a challenging subset of Continual Learning, focusing on classifying images from a stream without assuming data independence and identical distribution (i.i.d). The primary…

Machine Learning · Computer Science 2026-03-24 Joe Khawand , David Colliaux

Continual learning algorithms strive to acquire new knowledge while preserving prior information. Often, these algorithms emphasise stability and restrict network updates upon learning new tasks. In many cases, such restrictions come at a…

Machine Learning · Computer Science 2024-06-21 Daniel Anthes , Sushrut Thorat , Peter König , Tim C. Kietzmann

Class-incremental Learning (CIL) enables the model to incrementally absorb knowledge from new classes and build a generic classifier across all previously encountered classes. When the model optimizes with new classes, the knowledge of…

Computer Vision and Pattern Recognition · Computer Science 2025-03-31 Juncen Guo , Xiaoguang Zhu , Liangyu Teng , Hao Yang , Jing Liu , Yang Liu , Liang Song

Continual learning aims to provide intelligent agents that are capable of learning continually a sequence of tasks, building on previously learned knowledge. A key challenge in this learning paradigm is catastrophically forgetting…

Machine Learning · Computer Science 2021-01-18 Ghada Sokar , Decebal Constantin Mocanu , Mykola Pechenizkiy

Federated active learning (FAL) seeks to reduce annotation cost under privacy constraints, yet its effectiveness degrades in realistic settings with severe global class imbalance and highly heterogeneous clients. We conduct a systematic…

Machine Learning · Computer Science 2026-03-12 Chen-Chen Zong , Sheng-Jun Huang