English
Related papers

Related papers: Is Continual Learning Ready for Real-world Challen…

200 papers

Recent Multimodal Large Language Models (MLLMs) excel in vision-language understanding but face challenges in adapting to dynamic real-world scenarios that require continuous integration of new knowledge and skills. While continual learning…

Computation and Language · Computer Science 2025-10-02 Hongbo Zhao , Fei Zhu , Haiyang Guo , Meng Wang , Rundong Wang , Gaofeng Meng , Zhaoxiang Zhang

Standard artificial neural networks suffer from the well-known issue of catastrophic forgetting, making continual or lifelong learning difficult for machine learning. In recent years, numerous methods have been proposed for continual…

Machine Learning · Computer Science 2019-04-18 Gido M. van de Ven , Andreas S. Tolias

Reinforcement Learning (RL) is an important machine learning paradigm for solving sequential decision-making problems. Recent years have witnessed remarkable progress in this field due to the rapid development of deep neural networks.…

Machine Learning · Computer Science 2026-04-08 Chaofan Pan , Xin Yang , Yanhua Li , Wei Wei , Tianrui Li , Bo An , Jiye Liang

Continual Learning is a step towards lifelong intelligence where models continuously learn from recently collected data without forgetting previous knowledge. Existing continual learning approaches mostly focus on image classification in…

Computer Vision and Pattern Recognition · Computer Science 2024-02-16 Motasem Alfarra , Zhipeng Cai , Adel Bibi , Bernard Ghanem , Matthias Müller

Deep Learning has shown great success in reshaping medical imaging, yet it faces numerous challenges hindering widespread application. Issues like catastrophic forgetting and distribution shifts in the continuously evolving data stream…

Computer Vision and Pattern Recognition · Computer Science 2024-10-02 Mohammad Areeb Qazi , Anees Ur Rehman Hashmi , Santosh Sanjeev , Ibrahim Almakky , Numan Saeed , Camila Gonzalez , Mohammad Yaqub

Continual learning has been an active research area in machine learning, focusing on incrementally learning a sequence of tasks. A key challenge is catastrophic forgetting (CF), and most research efforts have been directed toward mitigating…

Machine Learning · Computer Science 2025-02-27 Saleh Momeni , Bing Liu

Online Continual Learning (OCL) studies learning over a continuous data stream without observing any single example more than once, a setting that is closer to the experience of humans and systems that must learn "on-the-wild". Yet,…

Computation and Language · Computer Science 2021-02-02 Germán Kruszewski , Ionut-Teodor Sorodoc , Tomas Mikolov

With the digitization of modern cities, large data volumes and powerful computational resources facilitate the rapid update of intelligent models deployed in smart cities. Continual learning (CL) is a novel machine learning paradigm that…

Machine Learning · Computer Science 2024-04-02 Li Yang , Zhipeng Luo , Shiming Zhang , Fei Teng , Tianrui Li

Continual learning is a process that involves training learning agents to sequentially master a stream of tasks or classes without revisiting past data. The challenge lies in leveraging previously acquired knowledge to learn new tasks…

Machine Learning · Computer Science 2024-02-21 Marcus de Carvalho , Mahardhika Pratama , Jie Zhang , Chua Haoyan , Edward Yapp

Continual learning, also known as incremental learning or life-long learning, stands at the forefront of deep learning and AI systems. It breaks through the obstacle of one-way training on close sets and enables continuous adaptive learning…

Computer Vision and Pattern Recognition · Computer Science 2024-08-23 Bo Yuan , Danpei Zhao

Quadruped robots have emerged as an evolving technology that currently leverages simulators to develop a robust controller capable of functioning in the real-world without the need for further training. However, since it is impossible to…

Robotics · Computer Science 2023-11-14 Giovanni Minelli , Vassilis Vassiliades

Multiple supervised learning scenarios are composed by a sequence of classification tasks. For instance, multi-task learning and continual learning aim to learn a sequence of tasks that is either fixed or grows over time. Existing…

Machine Learning · Statistics 2025-01-10 Verónica Álvarez , Santiago Mazuelas , Jose A. Lozano

Continual learning approaches help deep neural network models adapt and learn incrementally by trying to solve catastrophic forgetting. However, whether these existing approaches, applied traditionally to image-based tasks, work with the…

Machine Learning · Computer Science 2022-06-27 Young D. Kwon , Jagmohan Chauhan , Abhishek Kumar , Pan Hui , Cecilia Mascolo

The diversity of tasks and dynamic nature of reinforcement learning (RL) require RL agents to be able to learn sequentially and continuously, a learning paradigm known as continuous reinforcement learning. This survey reviews how continual…

Machine Learning · Computer Science 2025-06-30 Amara Zuffer , Michael Burke , Mehrtash Harandi

Non-Centralized Continual Learning (NCCL) has become an emerging paradigm for enabling distributed devices such as vehicles and servers to handle streaming data from a joint non-stationary environment. To achieve high reliability and…

Machine Learning · Computer Science 2025-05-07 Yichen Li , Haozhao Wang , Wenchao Xu , Tianzhe Xiao , Hong Liu , Minzhu Tu , Yuying Wang , Xin Yang , Rui Zhang , Shui Yu , Song Guo , Ruixuan Li

This paper studies the challenging continual learning (CL) setting of Class Incremental Learning (CIL). CIL learns a sequence of tasks consisting of disjoint sets of concepts or classes. At any time, a single model is built that can be…

Machine Learning · Computer Science 2023-06-23 Gyuhak Kim , Changnan Xiao , Tatsuya Konishi , Bing Liu

Service robots, in general, have to work independently and adapt to the dynamic changes happening in the environment in real-time. One important aspect in such scenarios is to continually learn to recognize newer object categories when they…

Computer Vision and Pattern Recognition · Computer Science 2021-03-17 Sudhakaran Jain , Hamidreza Kasaei

Machine learning has achieved remarkable success in many applications. However, existing studies are largely based on the closed-world assumption, which assumes that the environment is stationary, and the model is fixed once deployed. In…

Machine Learning · Computer Science 2025-06-24 Fei Zhu , Shijie Ma , Zhen Cheng , Xu-Yao Zhang , Zhaoxiang Zhang , Dacheng Tao , Cheng-Lin Liu

Machine learning in medical imaging during clinical routine is impaired by changes in scanner protocols, hardware, or policies resulting in a heterogeneous set of acquisition settings. When training a deep learning model on an initial…

Computer Vision and Pattern Recognition · Computer Science 2022-03-16 Matthias Perkonigg , Johannes Hofmanninger , Christian Herold , Helmut Prosch , Georg Langs