English
Related papers

Related papers: iCaRL: Incremental Classifier and Representation L…

200 papers

Continual learning (CL) is the sub-field of machine learning concerned with accumulating knowledge in dynamic environments. So far, CL research has mainly focused on incremental classification tasks, where models learn to classify new…

In-Context Learning (ICL) empowers Large Language Models (LLMs) with the ability to learn from a few examples provided in the prompt, enabling downstream generalization without the requirement for gradient updates. Despite encouragingly…

Computation and Language · Computer Science 2025-01-28 Haitao Mao , Guangliang Liu , Yao Ma , Rongrong Wang , Kristen Johnson , Jiliang Tang

Traditional machine learning systems are deployed under the closed-world setting, which requires the entire training data before the offline training process. However, real-world applications often face the incoming new classes, and a model…

Machine Learning · Computer Science 2022-10-27 Da-Wei Zhou , Fu-Yun Wang , Han-Jia Ye , De-Chuan Zhan

Deep Neural Network (DNN) has achieved great success on datasets of closed class set. However, new classes, like new categories of social media topics, are continuously added to the real world, making it necessary to incrementally learn.…

Computer Vision and Pattern Recognition · Computer Science 2023-08-07 Wenzhuo Liu , Xinjian Wu , Fei Zhu , Mingming Yu , Chuang Wang , Cheng-Lin Liu

Inverse Reinforcement Learning (IRL) is a powerful set of techniques for imitation learning that aims to learn a reward function that rationalizes expert demonstrations. Unfortunately, traditional IRL methods suffer from a computational…

Machine Learning · Computer Science 2024-01-31 Gokul Swamy , Sanjiban Choudhury , J. Andrew Bagnell , Zhiwei Steven Wu

Causal representation learning (CRL) has garnered increasing interest from the causal inference and artificial intelligence communities due to its potential to disentangle complex data-generating mechanism into causally interpretable latent…

Machine Learning · Statistics 2026-05-28 Hao Chen , Lin Liu , Yu Guang Wang

We propose Exemplar-Condensed federated class-incremental learning (ECoral) to distil the training characteristics of real images from streaming data into informative rehearsal exemplars. The proposed method eliminates the limitations of…

Machine Learning · Computer Science 2025-06-04 Rui Sun , Yumin Zhang , Varun Ojha , Tejal Shah , Haoran Duan , Bo Wei , Rajiv Ranjan

Causal representation learning seeks to uncover causal relationships among high-level latent variables from low-level, entangled, and noisy observations. Existing approaches often either rely on deep neural networks, which lack…

Methodology · Statistics 2026-03-27 Wenjin Zhang , Yixin Wang , Yuqi Gu

Automatic Curriculum Learning (ACL) has become a cornerstone of recent successes in Deep Reinforcement Learning (DRL).These methods shape the learning trajectories of agents by challenging them with tasks adapted to their capacities. In…

Machine Learning · Computer Science 2020-06-01 Rémy Portelas , Cédric Colas , Lilian Weng , Katja Hofmann , Pierre-Yves Oudeyer

Continual Learning (CL) is a field dedicated to devise algorithms able to achieve lifelong learning. Overcoming the knowledge disruption of previously acquired concepts, a drawback affecting deep learning models and that goes by the name of…

Computer Vision and Pattern Recognition · Computer Science 2023-01-04 Francesco Pelosin

Reinforcement learning provides a powerful and general framework for decision making and control, but its application in practice is often hindered by the need for extensive feature and reward engineering. Deep reinforcement learning…

Machine Learning · Computer Science 2018-08-15 Justin Fu , Katie Luo , Sergey Levine

Various incremental learning (IL) approaches have been proposed to help deep learning models learn new tasks/classes continuously without forgetting what was learned previously (i.e., avoid catastrophic forgetting). With the growing number…

Sound · Computer Science 2021-06-28 Young D. Kwon , Jagmohan Chauhan , Cecilia Mascolo

Real-world data streams naturally include the repetition of previous concepts. From a Continual Learning (CL) perspective, repetition is a property of the environment and, unlike replay, cannot be controlled by the agent. Nowadays, the…

Most artificial intelligence models have limiting ability to solve new tasks faster, without forgetting previously acquired knowledge. The recently emerging paradigm of continual learning aims to solve this issue, in which the model learns…

Machine Learning · Computer Science 2018-06-01 Ju Xu , Zhanxing Zhu

Continual learning is an important problem for achieving human-level intelligence in real-world applications as an agent must continuously accumulate knowledge in response to streaming data/tasks. In this work, we consider a general and yet…

Computer Vision and Pattern Recognition · Computer Science 2022-10-14 Jiangwei Xie , Shipeng Yan , Xuming He

Self-supervised representation learning has achieved remarkable success in recent years. By subverting the need for supervised labels, such approaches are able to utilize the numerous unlabeled images that exist on the Internet and in…

Computer Vision and Pattern Recognition · Computer Science 2021-09-01 Yilun Du , Chuang Gan , Phillip Isola

Embodied agents, such as robots and virtual characters, must continuously select actions to execute tasks effectively, solving complex sequential decision-making problems. Given the difficulty of designing such controllers manually,…

Robotics · Computer Science 2026-05-18 Pedro Santana

Inverse Reinforcement Learning (IRL) learns an optimal policy, given some expert demonstrations, thus avoiding the need for the tedious process of specifying a suitable reward function. However, current methods are constrained by at least…

Machine Learning · Computer Science 2023-11-16 Pierre Le Pelletier de Woillemont , Rémi Labory , Vincent Corruble

Researchers have demonstrated state-of-the-art performance in sequential decision making problems (e.g., robotics control, sequential prediction) with deep neural network models. One often has access to near-optimal oracles that achieve…

Machine Learning · Computer Science 2017-03-06 Wen Sun , Arun Venkatraman , Geoffrey J. Gordon , Byron Boots , J. Andrew Bagnell

The dynamic expansion architecture is becoming popular in class incremental learning, mainly due to its advantages in alleviating catastrophic forgetting. However, task confusion is not well assessed within this framework, e.g., the…

Computer Vision and Pattern Recognition · Computer Science 2023-01-04 Bingchen Huang , Zhineng Chen , Peng Zhou , Jiayin Chen , Zuxuan Wu