English
Related papers

Related papers: iCaRL: Incremental Classifier and Representation L…

200 papers

We introduce the "Incremental Implicitly-Refined Classi-fication (IIRC)" setup, an extension to the class incremental learning setup where the incoming batches of classes have two granularity levels. i.e., each sample could have a…

Computer Vision and Pattern Recognition · Computer Science 2021-01-13 Mohamed Abdelsalam , Mojtaba Faramarzi , Shagun Sodhani , Sarath Chandar

Continual learning in online scenario aims to learn a sequence of new tasks from data stream using each data only once for training, which is more realistic than in offline mode assuming data from new task are all available. However, this…

Computer Vision and Pattern Recognition · Computer Science 2021-10-19 Jiangpeng He , Fengqing Zhu

Incremental learning aims to enable machine learning models to continuously acquire new knowledge given new classes, while maintaining the knowledge already learned for old classes. Saving a subset of training samples of previously seen…

Computer Vision and Pattern Recognition · Computer Science 2021-04-22 Jian Jiang , Edoardo Cetin , Oya Celiktutan

Exemplar-Free Class Incremental Learning (efCIL) aims to continuously incorporate the knowledge from new classes while retaining previously learned information, without storing any old-class exemplars (i.e., samples). For this purpose,…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Libo Huang , Zhulin An , Yan Zeng , Chuanguang Yang , Xinqiang Yu , Yongjun Xu

Building robust and real-time classifiers with diverse datasets are one of the most significant challenges to deep learning researchers. It is because there is a considerable gap between a model built with training (seen) data and real…

Computer Vision and Pattern Recognition · Computer Science 2020-02-18 Mayanka Chandrashekar , Yugyung Lee

As systems are getting more autonomous with the development of artificial intelligence, it is important to discover the causal knowledge from observational sensory inputs. By encoding a series of cause-effect relations between events,…

Machine Learning · Computer Science 2020-01-16 Yuhao Wang , Vlado Menkovski , Hao Wang , Xin Du , Mykola Pechenizkiy

This paper studies the challenging continual learning (CL) setting of Class Incremental Learning (CIL). CIL learns a sequence of tasks consisting of disjoint sets of concepts or classes. At any time, a single model is built that can be…

Machine Learning · Computer Science 2023-06-23 Gyuhak Kim , Changnan Xiao , Tatsuya Konishi , Bing Liu

Standard deep learning-based classification approaches require collecting all samples from all classes in advance and are trained offline. This paradigm may not be practical in real-world clinical applications, where new classes are…

Computer Vision and Pattern Recognition · Computer Science 2022-07-05 Sana Ayromlou , Purang Abolmaesumi , Teresa Tsang , Xiaoxiao Li

Deep learning architectures exhibit a critical drop of performance due to catastrophic forgetting when they are required to incrementally learn new tasks. Contemporary incremental learning frameworks focus on image classification and object…

Computer Vision and Pattern Recognition · Computer Science 2019-09-18 Umberto Michieli , Pietro Zanuttigh

Causal models provide rich descriptions of complex systems as sets of mechanisms by which each variable is influenced by its direct causes. They support reasoning about manipulating parts of the system and thus hold promise for addressing…

Machine Learning · Computer Science 2024-06-21 Julius von Kügelgen

Incremental learning attempts to develop a classifier which learns continuously from a stream of data segregated into different classes. Deep learning approaches suffer from catastrophic forgetting when learning classes incrementally, while…

Computer Vision and Pattern Recognition · Computer Science 2020-07-31 Ali Ayub , Alan Wagner

The rehearsal strategy is widely used to alleviate the catastrophic forgetting problem in class incremental learning (CIL) by preserving limited exemplars from previous tasks. With imbalanced sample numbers between old and new classes, the…

Computer Vision and Pattern Recognition · Computer Science 2023-08-28 Xiuwei Chen , Xiaobin Chang

Like humans, deep networks have been shown to learn better when samples are organized and introduced in a meaningful order or curriculum. Conventional curriculum learning schemes introduce samples in their order of difficulty. This forces…

Computer Vision and Pattern Recognition · Computer Science 2020-08-14 Madan Ravi Ganesh , Jason J. Corso

Compared with traditional deep learning techniques, continual learning enables deep neural networks to learn continually and adaptively. Deep neural networks have to learn new tasks and overcome forgetting the knowledge obtained from the…

Machine Learning · Computer Science 2022-02-08 Yujiang He

Incremental Learning (IL) is an interesting AI problem when the algorithm is assumed to work on a budget. This is especially true when IL is modeled using a deep learning approach, where two com- plex challenges arise due to limited memory,…

Computer Vision and Pattern Recognition · Computer Science 2018-08-21 Eden Belouadah , Adrian Popescu

Inverse Constrained Reinforcement Learning (ICRL) is the task of inferring the implicit constraints that expert agents adhere to, based on their demonstration data. As an emerging research topic, ICRL has received considerable attention in…

Machine Learning · Computer Science 2025-02-04 Guiliang Liu , Sheng Xu , Shicheng Liu , Ashish Gaurav , Sriram Ganapathi Subramanian , Pascal Poupart

Continual learning (or class incremental learning) is a realistic learning scenario for computer vision systems, where deep neural networks are trained on episodic data, and the data from previous episodes are generally inaccessible to the…

Computer Vision and Pattern Recognition · Computer Science 2026-02-05 Aditya R. Bhattacharya , Debanjan Goswami , Shayok Chakraborty

We study the problem of inverse reinforcement learning (IRL) with the added twist that the learner is assisted by a helpful teacher. More formally, we tackle the following algorithmic question: How could a teacher provide an informative…

Machine Learning · Computer Science 2019-06-07 Parameswaran Kamalaruban , Rati Devidze , Volkan Cevher , Adish Singla

Class-incremental learning deals with sequential data streams composed of batches of classes. Various algorithms have been proposed to address the challenging case where samples from past classes cannot be stored. However, selecting an…

Machine Learning · Computer Science 2024-03-28 Eva Feillet , Adrian Popescu , Céline Hudelot

The emergence of in-context learning (ICL) enables large pre-trained language models (PLMs) to make predictions for unseen inputs without updating parameters. Despite its potential, ICL's effectiveness heavily relies on the quality,…

Machine Learning · Computer Science 2024-07-02 Xiaoling Zhou , Wei Ye , Yidong Wang , Chaoya Jiang , Zhemg Lee , Rui Xie , Shikun Zhang