English
Related papers

Related papers: Anytime Continual Learning for Open Vocabulary Cla…

200 papers

With the digitization of modern cities, large data volumes and powerful computational resources facilitate the rapid update of intelligent models deployed in smart cities. Continual learning (CL) is a novel machine learning paradigm that…

Machine Learning · Computer Science 2024-04-02 Li Yang , Zhipeng Luo , Shiming Zhang , Fei Teng , Tianrui Li

Continual learning (CL) enables models to adapt to new tasks and environments without forgetting previously learned knowledge. While current CL setups have ignored the relationship between labels in the past task and the new task with or…

Machine Learning · Computer Science 2023-08-29 Byung Hyun Lee , Okchul Jung , Jonghyun Choi , Se Young Chun

Continual Learning, also known as Lifelong Learning, aims to continually learn from new data as it becomes available. While prior research on continual learning in automatic speech recognition has focused on the adaptation of models across…

Machine Learning · Computer Science 2022-07-13 Muqiao Yang , Ian Lane , Shinji Watanabe

Although meta-learning seems promising performance in the realm of rapid adaptability, it is constrained by fixed cardinality. When faced with tasks of varying cardinalities that were unseen during training, the model lacks its ability. In…

Machine Learning · Computer Science 2024-01-11 Junhoo Lee , Yearim Kim , Hyunho Lee , Nojun Kwak

We propose and study a realistic Continual Learning (CL) setting where learning algorithms are granted a restricted computational budget per time step while training. We apply this setting to large-scale semi-supervised Continual Learning…

Machine Learning · Computer Science 2024-06-11 Wenxuan Zhang , Youssef Mohamed , Bernard Ghanem , Philip H. S. Torr , Adel Bibi , Mohamed Elhoseiny

This paper develops variational continual learning (VCL), a simple but general framework for continual learning that fuses online variational inference (VI) and recent advances in Monte Carlo VI for neural networks. The framework can…

Machine Learning · Statistics 2018-05-22 Cuong V. Nguyen , Yingzhen Li , Thang D. Bui , Richard E. Turner

As world knowledge advances and new task schemas emerge, Continual Learning (CL) becomes essential for keeping Large Language Models (LLMs) current and addressing their shortcomings. This process typically involves continual instruction…

Machine Learning · Computer Science 2024-12-17 Haokun Zhao , Haixia Han , Jie Shi , Chengyu Du , Jiaqing Liang , Yanghua Xiao

This paper introduces an interactive continual learning paradigm where AI models dynamically learn new skills from real-time human feedback while retaining prior knowledge. This paradigm distinctively addresses two major limitations of…

Machine Learning · Computer Science 2025-05-16 Yutao Yang , Jie Zhou , Junsong Li , Qianjun Pan , Bihao Zhan , Qin Chen , Xipeng Qiu , Liang He

Deep neural networks, despite their remarkable success, remain fundamentally limited in their ability to perform Continual Learning (CL). While most current methods aim to enhance the capabilities of a single model, Inspired by the…

Machine Learning · Computer Science 2025-08-01 Aojun Lu , Junchao Ke , Chunhui Ding , Jiahao Fan , Jiancheng Lv , Yanan Sun

Continual learning (CL) is a new online learning technique over sequentially generated streaming data from different tasks, aiming to maintain a small forgetting loss on previously-learned tasks. Existing work focuses on reducing the…

Machine Learning · Computer Science 2024-12-25 Shugang Hao , Lingjie Duan

Multi-label classification (MLC) is an important class of machine learning problems that come with a wide spectrum of applications, each demanding a possibly different evaluation criterion. When solving the MLC problems, we generally expect…

Machine Learning · Computer Science 2019-10-08 Yao-Yuan Yang , Yi-An Lin , Hong-Min Chu , Hsuan-Tien Lin

Anytime learning describes a relatively novel concept by which systems are able to acquire knowledge about a changing environment and adapt and behave accordingly to this. "Anytime" refers to the fact that the system is capable of returning…

Computers and Society · Computer Science 2018-08-24 Lucas Breitsameter

Continual Learning (CL) methods aim to learn from a sequence of tasks while avoiding the challenge of forgetting previous knowledge. We present DREAM-CL, a novel CL method for ECG arrhythmia detection that introduces dynamic prototype…

Machine Learning · Computer Science 2026-01-19 Sana Rahmani , Reetam Chatterjee , Ali Etemad , Javad Hashemi

Continual learning (CL) is a particular machine learning paradigm where the data distribution and learning objective changes through time, or where all the training data and objective criteria are never available at once. The evolution of…

Machine Learning · Computer Science 2019-11-25 Timothée Lesort , Vincenzo Lomonaco , Andrei Stoian , Davide Maltoni , David Filliat , Natalia Díaz-Rodríguez

Food image classification is challenging for real-world applications since existing methods require static datasets for training and are not capable of learning from sequentially available new food images. Online continual learning aims to…

Computer Vision and Pattern Recognition · Computer Science 2021-08-17 Jiangpeng He , Fengqing Zhu

Continual Learning (CL) is essential for enabling self-evolving large language models (LLMs) to adapt and remain effective amid rapid knowledge growth. Yet, despite its importance, little attention has been given to establishing statistical…

Machine Learning · Computer Science 2025-10-29 Xiaofan Zhou , Lu Cheng

Continual learning (CL) aims to incrementally learn different tasks (such as classification) in a non-stationary data stream without forgetting old ones. Most CL works focus on tackling catastrophic forgetting under a learning-from-scratch…

Machine Learning · Computer Science 2024-01-17 Mark D. McDonnell , Dong Gong , Amin Parveneh , Ehsan Abbasnejad , Anton van den Hengel

Open-world machine learning is an emerging technique in artificial intelligence, where conventional machine learning models often follow closed-world assumptions, which can hinder their ability to retain previously learned knowledge for…

Machine Learning · Computer Science 2025-11-26 Jitendra Parmar , Praveen Singh Thakur

Continual learning (CL) is one of the most promising trends in recent machine learning research. Its goal is to go beyond classical assumptions in machine learning and develop models and learning strategies that present high robustness in…

Machine Learning · Computer Science 2023-03-21 Kamil Faber , Dominik Zurek , Marcin Pietron , Nathalie Japkowicz , Antonio Vergari , Roberto Corizzo

Continuously learning new classes without catastrophic forgetting is a challenging problem for on-device environmental sound classification given the restrictions on computation resources (e.g., model size, running memory). To address this…

Sound · Computer Science 2022-07-19 Yang Xiao , Xubo Liu , James King , Arshdeep Singh , Eng Siong Chng , Mark D. Plumbley , Wenwu Wang