中文
相关论文

相关论文: Forgetting, Ignorance or Myopia: Revisiting Key Ch…

200 篇论文

Simultaneous localization and mapping (SLAM) with implicit neural representations has received extensive attention due to the expressive representation power and the innovative paradigm of continual learning. However, deploying such a…

计算机视觉与模式识别 · 计算机科学 2024-07-19 Baicheng Li , Zike Yan , Dong Wu , Hanqing Jiang , Hongbin Zha

Continual learning (CL) has garnered significant attention because of its ability to adapt to new tasks that arrive over time. Catastrophic forgetting (of old tasks) has been identified as a major issue in CL, as the model adapts to new…

机器学习 · 计算机科学 2025-02-20 Hongbo Li , Sen Lin , Lingjie Duan , Yingbin Liang , Ness B. Shroff

Continual learning (CL) aims to train models on a sequence of tasks while retaining performance on previously learned ones. A core challenge in this setting is catastrophic forgetting, where new learning interferes with past knowledge.…

机器学习 · 计算机科学 2026-02-04 Meng Ding , Jinhui Xu , Kaiyi Ji

The ability of artificial agents to increment their capabilities when confronted with new data is an open challenge in artificial intelligence. The main challenge faced in such cases is catastrophic forgetting, i.e., the tendency of neural…

机器学习 · 计算机科学 2020-12-16 Eden Belouadah , Adrian Popescu , Ioannis Kanellos

Continual learning in online scenario aims to learn a sequence of new tasks from data stream using each data only once for training, which is more realistic than in offline mode assuming data from new task are all available. However, this…

计算机视觉与模式识别 · 计算机科学 2021-10-19 Jiangpeng He , Fengqing Zhu

Federated Class Continual Learning (FCCL) merges the challenges of distributed client learning with the need for seamless adaptation to new classes without forgetting old ones. The key challenge in FCCL is catastrophic forgetting, an issue…

机器学习 · 计算机科学 2024-09-05 Jinglin Liang , Jin Zhong , Hanlin Gu , Zhongqi Lu , Xingxing Tang , Gang Dai , Shuangping Huang , Lixin Fan , Qiang Yang

Continual learning (CL) is a learning paradigm that emulates the human capability of learning and accumulating knowledge continually without forgetting the previously learned knowledge and also transferring the learned knowledge to help…

计算与语言 · 计算机科学 2023-05-12 Zixuan Ke , Bing Liu

We introduce Continual Learning via Neural Pruning (CLNP), a new method aimed at lifelong learning in fixed capacity models based on neuronal model sparsification. In this method, subsequent tasks are trained using the inactive neurons and…

机器学习 · 计算机科学 2019-03-12 Siavash Golkar , Michael Kagan , Kyunghyun Cho

Multimodal Continual Instruction Tuning (MCIT) aims to enable Multimodal Large Language Models (MLLMs) to incrementally learn new tasks without catastrophic forgetting. In this paper, we explore forgetting in this context, categorizing it…

机器学习 · 计算机科学 2025-05-06 Jinpeng Chen , Runmin Cong , Yuzhi Zhao , Hongzheng Yang , Guangneng Hu , Horace Ho Shing Ip , Sam Kwong

A significant challenge in achieving ubiquitous Artificial Intelligence is the limited ability of models to rapidly learn new information in real-world scenarios where data follows long-tailed distributions, all while avoiding forgetting…

机器学习 · 计算机科学 2024-04-09 Siddeshwar Raghavan , Jiangpeng He , Fengqing Zhu

In this paper, we address the challenges of online Continual Learning (CL) by introducing a density distribution-based learning framework. CL, especially the Class Incremental Learning, enables adaptation to new test distributions while…

机器学习 · 计算机科学 2023-11-27 Shilin Zhang , Jiahui Wang

Spatial scene understanding, including monocular depth estimation, is an important problem in various applications, such as robotics and autonomous driving. While improvements in unsupervised monocular depth estimation have potentially…

计算机视觉与模式识别 · 计算机科学 2023-11-07 Hemang Chawla , Arnav Varma , Elahe Arani , Bahram Zonooz

In many real-world scenarios, data to train machine learning models becomes available over time. Unfortunately, these models struggle to continually learn new concepts without forgetting what has been learnt in the past. This phenomenon is…

计算与语言 · 计算机科学 2023-01-16 Beyza Ermis , Giovanni Zappella , Martin Wistuba , Aditya Rawal , Cedric Archambeau

In the realm of high-frequency data streams, achieving real-time learning within varying memory constraints is paramount. This paper presents Ferret, a comprehensive framework designed to enhance online accuracy of Online Continual Learning…

机器学习 · 计算机科学 2025-03-18 Yuhao Zhou , Yuxin Tian , Jindi Lv , Mingjia Shi , Yuanxi Li , Qing Ye , Shuhao Zhang , Jiancheng Lv

Forgetting presents a significant challenge during incremental training, making it particularly demanding for contemporary AI systems to assimilate new knowledge in streaming data environments. To address this issue, most approaches in…

机器学习 · 计算机科学 2024-08-27 Monica Millunzi , Lorenzo Bonicelli , Angelo Porrello , Jacopo Credi , Petter N. Kolm , Simone Calderara

A growing body of research in continual learning focuses on the catastrophic forgetting problem. While many attempts have been made to alleviate this problem, the majority of the methods assume a single model in the continual learning…

机器学习 · 计算机科学 2023-07-06 Thang Doan , Seyed Iman Mirzadeh , Mehrdad Farajtabar

Adversarial continual learning is effective for continual learning problems because of the presence of feature alignment process generating task-invariant features having low susceptibility to the catastrophic forgetting problem.…

机器学习 · 计算机科学 2022-09-07 Tanmoy Dam , Mahardhika Pratama , MD Meftahul Ferdaus , Sreenatha Anavatti , Hussein Abbas

Continual learning for Semantic Segmentation (CSS) is a rapidly emerging field, in which the capabilities of the segmentation model are incrementally improved by learning new classes or new domains. A central challenge in Continual Learning…

计算机视觉与模式识别 · 计算机科学 2022-09-21 Tobias Kalb , Björn Mauthe , Jürgen Beyerer

This paper studies class incremental learning (CIL) of continual learning (CL). Many approaches have been proposed to deal with catastrophic forgetting (CF) in CIL. Most methods incrementally construct a single classifier for all classes of…

机器学习 · 计算机科学 2022-08-23 Gyuhak Kim , Zixuan Ke , Bing Liu

We propose a novel framework DropTop that suppresses the shortcut bias in online continual learning (OCL) while being adaptive to the varying degree of the shortcut bias incurred by continuously changing environment. By the observed…

机器学习 · 计算机科学 2023-12-15 Doyoung Kim , Dongmin Park , Yooju Shin , Jihwan Bang , Hwanjun Song , Jae-Gil Lee