English
Related papers

Related papers: Noise-Tolerant Coreset-Based Class Incremental Con…

200 papers

Continual Learning (CL) investigates how to train Deep Networks on a stream of tasks without incurring forgetting. CL settings proposed in literature assume that every incoming example is paired with ground-truth annotations. However, this…

Machine Learning · Statistics 2022-08-30 Matteo Boschini , Pietro Buzzega , Lorenzo Bonicelli , Angelo Porrello , Simone Calderara

Class-Incremental learning (CIL) refers to the ability of artificial agents to integrate new classes as they appear in a stream. It is particularly interesting in evolving environments where agents have limited access to memory and…

Computer Vision and Pattern Recognition · Computer Science 2024-04-10 Eden Belouadah , Arnaud Dapogny , Kevin Bailly

Complementary-label learning (CLL) is a weakly-supervised learning paradigm that aims to train a multi-class classifier using only complementary labels, which indicate classes to which an instance does not belong. Despite numerous…

Machine Learning · Computer Science 2025-06-17 Hsiu-Hsuan Wang , Tan-Ha Mai , Nai-Xuan Ye , Wei-I Lin , Hsuan-Tien Lin

Due to the model aging problem, Deep Neural Networks (DNNs) need updates to adjust them to new data distributions. The common practice leverages incremental learning (IL), e.g., Class-based Incremental Learning (CIL) that updates output…

Machine Learning · Computer Science 2023-04-11 Xuanqi Gao , Juan Zhai , Shiqing Ma , Chao Shen , Yufei Chen , Shiwei Wang

Replay-based continual learning (CL) methods assume that models trained on a small subset can also effectively minimize the empirical risk of the complete dataset. These methods maintain a memory buffer that stores a sampled subset of data…

Machine Learning · Computer Science 2025-05-29 Wenyang Liao , Quanziang Wang , Yichen Wu , Renzhen Wang , Deyu Meng

Real-world data streams naturally include the repetition of previous concepts. From a Continual Learning (CL) perspective, repetition is a property of the environment and, unlike replay, cannot be controlled by the agent. Nowadays, the…

Class-incremental learning (CIL) suffers from the notorious dilemma between learning newly added classes and preserving previously learned class knowledge. That catastrophic forgetting issue could be mitigated by storing historical data for…

Machine Learning · Computer Science 2022-06-20 Tianlong Chen , Sijia Liu , Shiyu Chang , Lisa Amini , Zhangyang Wang

This paper presents a practical and simple yet efficient method to effectively deal with the catastrophic forgetting for Class Incremental Learning (CIL) tasks. CIL tends to learn new concepts perfectly, but not at the expense of…

Machine Learning · Computer Science 2021-03-30 Bahram Mohammadi , Mohammad Sabokrou

Continual learning aims to acquire new knowledge while retaining past information. Class-incremental learning (CIL) presents a challenging scenario where classes are introduced sequentially. For video data, the task becomes more complex…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Tieyuan Chen , Huabin Liu , Chern Hong Lim , John See , Xing Gao , Junhui Hou , Weiyao Lin

Often, the data used to train ranking models is subject to label noise. For example, in web-search, labels created from clickstream data are noisy due to issues such as insufficient information in item descriptions on the SERP, query…

Information Retrieval · Computer Science 2022-08-18 Dany Haddad

Continual Learning is an unresolved challenge, whose relevance increases when considering modern applications. Unlike the human brain, trained deep neural networks suffer from a phenomenon called catastrophic forgetting, wherein they…

Machine Learning · Computer Science 2025-02-18 Shahar Shaul-Ariel , Daphna Weinshall

This work explores class-incremental learning (CIL) for sound event detection (SED), advancing adaptability towards real-world scenarios. CIL's success in domains like computer vision inspired our SED-tailored method, addressing the unique…

Audio and Speech Processing · Electrical Eng. & Systems 2025-01-14 Yang Xiao , Rohan Kumar Das

Continual learning (CL) enables deep networks to acquire new knowledge while avoiding catastrophic forgetting. The powerful generalization ability of pre-trained models (PTMs), such as the Contrastive Language-Image Pre-training (CLIP)…

Computer Vision and Pattern Recognition · Computer Science 2025-12-22 Haodong Lu , Xinyu Zhang , Kristen Moore , Jason Xue , Lina Yao , Anton van den Hengel , Dong Gong

Deep learning models rely heavily on large volumes of labeled data to achieve high performance. However, real-world datasets often contain noisy labels due to human error, ambiguity, or resource constraints during the annotation process.…

Computer Vision and Pattern Recognition · Computer Science 2024-12-09 Gouranga Bala , Anuj Gupta , Subrat Kumar Behera , Amit Sethi

Continual learning (CL) promises to allow neural networks to learn from continuous streams of inputs, instead of IID (independent and identically distributed) sampling, which requires random access to a full dataset. This would allow for…

Computer Vision and Pattern Recognition · Computer Science 2025-08-11 Shivani Mall , Joao F. Henriques

Large-scale datasets possessing clean label annotations are crucial for training Convolutional Neural Networks (CNNs). However, labeling large-scale data can be very costly and error-prone, and even high-quality datasets are likely to…

Computer Vision and Pattern Recognition · Computer Science 2018-04-03 Yisen Wang , Weiyang Liu , Xingjun Ma , James Bailey , Hongyuan Zha , Le Song , Shu-Tao Xia

Class-Incremental Learning (CIL) aims to learn new classes sequentially while retaining the knowledge of previously learned classes. Recently, pre-trained models (PTMs) combined with parameter-efficient fine-tuning (PEFT) have shown…

Computer Vision and Pattern Recognition · Computer Science 2025-06-02 Jiangpeng He , Zhihao Duan , Fengqing Zhu

Learning continuously during all model lifetime is fundamental to deploy machine learning solutions robust to drifts in the data distribution. Advances in Continual Learning (CL) with recurrent neural networks could pave the way to a large…

Machine Learning · Computer Science 2021-08-03 Andrea Cossu , Antonio Carta , Vincenzo Lomonaco , Davide Bacciu

Deep learning faces a formidable challenge when handling noisy labels, as models tend to overfit samples affected by label noise. This challenge is further compounded by the presence of instance-dependent noise (IDN), a realistic form of…

Computer Vision and Pattern Recognition · Computer Science 2026-01-12 Arpit Garg , Cuong Nguyen , Rafael Felix , Thanh-Toan Do , Gustavo Carneiro

Class-Incremental Learning (CIL) aims to train a reliable model with the streaming data, which emerges unknown classes sequentially. Different from traditional closed set learning, CIL has two main challenges: 1) Novel class detection. The…

Machine Learning · Computer Science 2020-09-01 Yang Yang , Zhen-Qiang Sun , HengShu Zhu , Yanjie Fu , Hui Xiong , Jian Yang