中文
相关论文

相关论文: Sub-network Discovery and Soft-masking for Continu…

200 篇论文

Continual learning (CL) learns a sequence of tasks incrementally with the goal of achieving two main objectives: overcoming catastrophic forgetting (CF) and encouraging knowledge transfer (KT) across tasks. However, most existing techniques…

计算与语言 · 计算机科学 2021-12-21 Zixuan Ke , Bing Liu , Nianzu Ma , Hu Xu , Lei Shu

Existing research on task incremental learning in continual learning has primarily focused on preventing catastrophic forgetting (CF). Although several techniques have achieved learning with no CF, they attain it by letting each task…

机器学习 · 计算机科学 2023-06-27 Tatsuya Konishi , Mori Kurokawa , Chihiro Ono , Zixuan Ke , Gyuhak Kim , Bing Liu

Existing research on continual learning (CL) of a sequence of tasks focuses mainly on dealing with catastrophic forgetting (CF) to balance the learning plasticity of new tasks and the memory stability of old tasks. However, an ideal CL…

机器学习 · 计算机科学 2026-01-12 Zhi Wang , Zhongbin Wu , Yanni Li , Bing Liu , Guangxi Li , Yuping Wang

Most existing works on continual learning (CL) focus on overcoming the catastrophic forgetting (CF) problem, with dynamic models and replay methods performing exceptionally well. However, since current works tend to assume exclusivity or…

计算机视觉与模式识别 · 计算机科学 2022-10-13 Sijia Wang , Yoojin Choi , Junya Chen , Mostafa El-Khamy , Ricardo Henao

In Continual Learning (CL), a neural network is trained on a stream of data whose distribution changes over time. In this context, the main problem is how to learn new information without forgetting old knowledge (i.e., Catastrophic…

Continual Learning (CL) has generated attention as a method of avoiding Catastrophic Forgetting (CF) in the sequential training of neural networks, improving network efficiency and adaptability to different tasks. Additionally, CL serves as…

机器学习 · 计算机科学 2023-12-20 Josh Andle , Ali Payani , Salimeh Yasaei-Sekeh

Continual learning (CL) has remained a persistent challenge for deep neural networks due to catastrophic forgetting (CF) of previously learned tasks. Several techniques such as weight regularization, experience rehearsal, and parameter…

人工智能 · 计算机科学 2023-10-13 Preetha Vijayan , Prashant Bhat , Elahe Arani , Bahram Zonooz

Continual learning (CL) is a learning paradigm that emulates the human capability of learning and accumulating knowledge continually without forgetting the previously learned knowledge and also transferring the learned knowledge to help…

计算与语言 · 计算机科学 2023-05-12 Zixuan Ke , Bing Liu

Continual learning (CL) is a setting in which an agent has to learn from an incoming stream of data sequentially. CL performance evaluates the model's ability to continually learn and solve new problems with incremental available…

机器学习 · 计算机科学 2022-05-04 Josh Andle , Salimeh Yasaei Sekeh

Continual Learning (CL) focuses on learning from dynamic and changing data distributions while retaining previously acquired knowledge. Various methods have been developed to address the challenge of catastrophic forgetting, including…

机器学习 · 计算机科学 2024-03-21 Zhenyi Wang , Yan Li , Li Shen , Heng Huang

Artificial neural networks suffer from catastrophic forgetting when they are sequentially trained on multiple tasks. To overcome this problem, we present a novel approach based on task-conditioned hypernetworks, i.e., networks that generate…

机器学习 · 计算机科学 2022-04-12 Johannes von Oswald , Christian Henning , Benjamin F. Grewe , João Sacramento

Existing research on continual learning of a sequence of tasks focused on dealing with catastrophic forgetting, where the tasks are assumed to be dissimilar and have little shared knowledge. Some work has also been done to transfer…

机器学习 · 计算机科学 2021-12-21 Zixuan Ke , Bing Liu , Xingchang Huang

Continual Learning (CL) methods aim to enable machine learning models to learn new tasks without catastrophic forgetting of those that have been previously mastered. Existing CL approaches often keep a buffer of previously-seen samples,…

机器学习 · 计算机科学 2022-02-22 Dong Gong , Qingsen Yan , Yuhang Liu , Anton van den Hengel , Javen Qinfeng Shi

General-purpose learning systems should improve themselves in open-ended fashion in ever-changing environments. Conventional learning algorithms for neural networks, however, suffer from catastrophic forgetting (CF), i.e., previously…

机器学习 · 计算机科学 2025-02-18 Kazuki Irie , Róbert Csordás , Jürgen Schmidhuber

Continual Learning (CL, sometimes also termed incremental learning) is a flavor of machine learning where the usual assumption of stationary data distribution is relaxed or omitted. When naively applying, e.g., DNNs in CL problems, changes…

机器学习 · 计算机科学 2022-08-31 Benedikt Bagus , Alexander Gepperth , Timothée Lesort

In continual learning (CL), a learner is faced with a sequence of tasks, arriving one after the other, and the goal is to remember all the tasks once the continual learning experience is finished. The prior art in CL uses episodic memory,…

机器学习 · 计算机科学 2020-12-09 Arslan Chaudhry , Naeemullah Khan , Puneet K. Dokania , Philip H. S. Torr

In this paper, we propose a continual learning (CL) technique that is beneficial to sequential task learners by improving their retained accuracy and reducing catastrophic forgetting. The principal target of our approach is the automatic…

机器学习 · 计算机科学 2021-01-19 Ammar Shaker , Shujian Yu , Francesco Alesiani

Continual Learning (CL) investigates how to train Deep Networks on a stream of tasks without incurring forgetting. CL settings proposed in literature assume that every incoming example is paired with ground-truth annotations. However, this…

Continual learning (CL) aims to extend deep models from static and enclosed environments to dynamic and complex scenarios, enabling systems to continuously acquire new knowledge of novel categories without forgetting previously learned…

计算机视觉与模式识别 · 计算机科学 2024-05-21 Sunyuan Qiang , Xuxin Lin , Yanyan Liang , Jun Wan , Du Zhang

Continual learning (CL) is a technique that enables neural networks to constantly adapt to their dynamic surroundings. Despite being overlooked for a long time, this technology can considerably address the customized needs of users in edge…

机器学习 · 计算机科学 2025-03-11 Zeqing Wang , Fei Cheng , Kangye Ji , Bohu Huang
‹ 上一页 1 2 3 10 下一页 ›