English
Related papers

Related papers: Action-Adaptive Continual Learning: Enabling Polic…

200 papers

General-purpose learning systems should improve themselves in open-ended fashion in ever-changing environments. Conventional learning algorithms for neural networks, however, suffer from catastrophic forgetting (CF), i.e., previously…

Machine Learning · Computer Science 2025-02-18 Kazuki Irie , Róbert Csordás , Jürgen Schmidhuber

Online Continual Learning (CL) solves the problem of learning the ever-emerging new classification tasks from a continuous data stream. Unlike its offline counterpart, in online CL, the training data can only be seen once. Most existing…

Machine Learning · Computer Science 2024-04-02 Maorong Wang , Nicolas Michel , Ling Xiao , Toshihiko Yamasaki

Recent advances in multi-agent reinforcement learning (MARL) allow agents to coordinate their behaviors in complex environments. However, common MARL algorithms still suffer from scalability and sparse reward issues. One promising approach…

Artificial Intelligence · Computer Science 2023-02-08 Rundong Wang , Longtao Zheng , Wei Qiu , Bowei He , Bo An , Zinovi Rabinovich , Yujing Hu , Yingfeng Chen , Tangjie Lv , Changjie Fan

An agent that efficiently accumulates knowledge to develop increasingly sophisticated skills over a long lifetime could advance the frontier of artificial intelligence capabilities. The design of such agents, which remains a long-standing…

Machine Learning · Computer Science 2025-06-27 Saurabh Kumar , Henrik Marklund , Ashish Rao , Yifan Zhu , Hong Jun Jeon , Yueyang Liu , Benjamin Van Roy

Many machine learning frameworks have been proposed and used in wireless communications for realizing diverse goals. However, their incapability of adapting to the dynamic wireless environment and tasks and of self-learning limit their…

Artificial Intelligence · Computer Science 2021-06-02 Qihui Wu , Tianchen Ruan , Fuhui Zhou , Yang Huang , Fan Xu , Shijin Zhao , Ya Liu , Xuyang Huang

Continual learning refers to the ability of a biological or artificial system to seamlessly learn from continuous streams of information while preventing catastrophic forgetting, i.e., a condition in which new incoming information strongly…

Machine Learning · Computer Science 2019-07-04 German I. Parisi , Christopher Kanan

Reinforcement Learning (RL) faces significant challenges in adaptive healthcare interventions, such as dementia care, where data is scarce, decisions require interpretability, and underlying patient-state dynamic are complex and causal in…

Robotics · Computer Science 2025-12-02 Wenzheng Zhao , Ran Zhang , Ruth Palan Lopez , Shu-Fen Wung , Fengpei Yuan

Adversarial continual learning is effective for continual learning problems because of the presence of feature alignment process generating task-invariant features having low susceptibility to the catastrophic forgetting problem.…

Machine Learning · Computer Science 2022-09-07 Tanmoy Dam , Mahardhika Pratama , MD Meftahul Ferdaus , Sreenatha Anavatti , Hussein Abbas

Continual learning aims to learn continuously from a stream of tasks and data in an online-learning fashion, being capable of exploiting what was learned previously to improve current and future tasks while still being able to perform well…

Machine Learning · Computer Science 2020-07-31 Quang Pham , Doyen Sahoo , Chenghao Liu , Steven C. H Hoi

Continual learning~(CL) is a field concerned with learning a series of inter-related task with the tasks typically defined in the sense of either regression or classification. In recent years, CL has been studied extensively when these…

Machine Learning · Computer Science 2023-11-07 Krishnan Raghavan , Prasanna Balaprakash

Continual Learning (CL) is a field dedicated to devise algorithms able to achieve lifelong learning. Overcoming the knowledge disruption of previously acquired concepts, a drawback affecting deep learning models and that goes by the name of…

Computer Vision and Pattern Recognition · Computer Science 2023-01-04 Francesco Pelosin

Some real-world domains are best characterized as a single task, but for others this perspective is limiting. Instead, some tasks continually grow in complexity, in tandem with the agent's competence. In continual learning, also referred to…

Developing effective predictive models becomes challenging in dynamic environments that continuously produce data and constantly change. Continual Learning (CL) and Streaming Machine Learning (SML) are two research areas that tackle this…

Machine Learning · Computer Science 2026-03-03 Federico Giannini , Giacomo Ziffer , Andrea Cossu , Vincenzo Lomonaco

We study the problem of learning multi-task, multi-agent policies for cooperative, temporal objectives, under centralized training, decentralized execution. In this setting, using automata to represent tasks enables the decomposition of…

Multiagent Systems · Computer Science 2025-11-05 Beyazit Yalcinkaya , Marcell Vazquez-Chanlatte , Ameesh Shah , Hanna Krasowski , Sanjit A. Seshia

Continual learning (CL) aims to acquire new knowledge while preserving information from previous experiences without forgetting. Though buffer-based methods (i.e., retaining samples from previous tasks) have achieved acceptable performance,…

Machine Learning · Computer Science 2023-11-29 Hossein Rezaei , Mohammad Sabokrou

Continual reinforcement learning (RL) concerns agents that are expected to learn continually, rather than converge to a policy that is then fixed for evaluation. This setting is well-suited to environments that the agent perceives as…

Machine Learning · Computer Science 2026-03-10 Mohamed A. Mohamed , Kateryna Nekhomiazh , Vedant Vyas , Marcos M. Jose , Andrew Patterson , Marlos C. Machado

Artificial neural networks, celebrated for their human-like cognitive learning abilities, often encounter the well-known catastrophic forgetting (CF) problem, where the neural networks lose the proficiency in previously acquired knowledge.…

Machine Learning · Computer Science 2024-05-14 Weiwei Weng , Mahardhika Pratama , Jie Zhang , Chen Chen , Edward Yapp Kien Yee , Ramasamy Savitha

The ability to learn in dynamic, nonstationary environments without forgetting previous knowledge, also known as Continual Learning (CL), is a key enabler for scalable and trustworthy deployments of adaptive solutions. While the importance…

Machine Learning · Computer Science 2021-03-25 Andrea Cossu , Antonio Carta , Davide Bacciu

The diversity of tasks and dynamic nature of reinforcement learning (RL) require RL agents to be able to learn sequentially and continuously, a learning paradigm known as continuous reinforcement learning. This survey reviews how continual…

Machine Learning · Computer Science 2025-06-30 Amara Zuffer , Michael Burke , Mehrtash Harandi

In contrast to the natural capabilities of humans to learn new tasks in a sequential fashion, neural networks are known to suffer from catastrophic forgetting, where the model's performances on old tasks drop dramatically after being…

Machine Learning · Computer Science 2023-04-03 Sanghwan Kim , Lorenzo Noci , Antonio Orvieto , Thomas Hofmann