English
Related papers

Related papers: Memory Efficient Experience Replay for Streaming L…

200 papers

Continual learning aims to provide intelligent agents capable of learning multiple tasks sequentially with neural networks. One of its main challenging, catastrophic forgetting, is caused by the neural networks non-optimal ability to learn…

Machine Learning · Computer Science 2021-01-29 Ghada Sokar , Decebal Constantin Mocanu , Mykola Pechenizkiy

Training Deep Neural Networks (DNNs) is still highly time-consuming and compute-intensive. It has been shown that adapting a pretrained model may significantly accelerate this process. With a focus on classification, we show that current…

Neural and Evolutionary Computing · Computer Science 2020-12-01 Farshid Varno , Lucas May Petry , Lisa Di Jorio , Stan Matwin

Despite huge success, deep networks are unable to learn effectively in sequential multitask learning settings as they forget the past learned tasks after learning new tasks. Inspired from complementary learning systems theory, we address…

Machine Learning · Computer Science 2019-06-04 Mohammad Rostami , Soheil Kolouri , Praveen K. Pilly

Rehearsal-based methods have shown superior performance in addressing catastrophic forgetting in continual learning (CL) by storing and training on a subset of past data alongside new data in current task. While such a concurrent rehearsal…

Machine Learning · Computer Science 2025-06-03 Junze Deng , Qinhang Wu , Peizhong Ju , Sen Lin , Yingbin Liang , Ness Shroff

In online continual learning, a neural network incrementally learns from a non-i.i.d. data stream. Nearly all online continual learning methods employ experience replay to simultaneously prevent catastrophic forgetting and underfitting on…

Machine Learning · Computer Science 2024-07-22 Jason Yoo , Yunpeng Liu , Frank Wood , Geoff Pleiss

Memory replay may be key to learning in biological brains, which manage to learn new tasks continually without catastrophically interfering with previous knowledge. On the other hand, artificial neural networks suffer from catastrophic…

Machine Learning · Computer Science 2022-01-06 Haitz Sáez de Ocáriz Borde

Artificial neural networks have exceeded human-level performance in accomplishing several individual tasks (e.g. voice recognition, object recognition, and video games). However, such success remains modest compared to human intelligence…

Machine Learning · Computer Science 2019-10-21 Rahaf Aljundi

A plain well-trained deep learning model often does not have the ability to learn new knowledge without forgetting the previously learned knowledge, which is known as catastrophic forgetting. Here we propose a novel method, SupportNet, to…

Neural and Evolutionary Computing · Computer Science 2018-12-31 Yu Li , Zhongxiao Li , Lizhong Ding , Yijie Pan , Chao Huang , Yuhui Hu , Wei Chen , Xin Gao

Continual learning tries to learn new tasks without forgetting previously learned ones. In reality, most of the existing artificial neural network(ANN) models fail, while humans do the same by remembering previous works throughout their…

Computer Vision and Pattern Recognition · Computer Science 2021-05-18 Subhankar Ghosh

The online learning of deep neural networks is an interesting problem of machine learning because, for example, major IT companies want to manage the information of the massive data uploaded on the web daily, and this technology can…

Machine Learning · Computer Science 2015-06-16 Sang-Woo Lee , Min-Oh Heo , Jiwon Kim , Jeonghee Kim , Byoung-Tak Zhang

Continual learning is increasingly sought after in real world machine learning applications, as it enables learning in a more human-like manner. Conventional machine learning approaches fail to achieve this, as incrementally updating the…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Joe Khawand , Peter Hanappe , David Colliaux

Catastrophic forgetting occurs when a neural network loses the information learned in a previous task after training on subsequent tasks. This problem remains a hurdle for artificial intelligence systems with sequential learning…

Machine Learning · Computer Science 2018-05-30 Joan Serrà , Dídac Surís , Marius Miron , Alexandros Karatzoglou

Deep neural networks are known to suffer the catastrophic forgetting problem, where they tend to forget the knowledge from the previous tasks when sequentially learning new tasks. Such failure hinders the application of deep learning based…

Machine Learning · Computer Science 2018-12-04 Junfeng Wen , Yanshuai Cao , Ruitong Huang

Recent years have witnessed growing interest in the application of deep neural networks (DNNs) for receiver design, which can potentially be applied in complex environments without relying on knowledge of the channel model. However, the…

Information Theory · Computer Science 2023-02-14 Tomer Raviv , Sangwoo Park , Osvaldo Simeone , Yonina C. Eldar , Nir Shlezinger

Replay-based methods have proved their effectiveness on online continual learning by rehearsing past samples from an auxiliary memory. With many efforts made on improving training schemes based on the memory, however, the information…

Computer Vision and Pattern Recognition · Computer Science 2024-01-10 Jianyang Gu , Kai Wang , Wei Jiang , Yang You

Lifelong learning with deep neural networks is well-known to suffer from catastrophic forgetting: the performance on previous tasks drastically degrades when learning a new task. To alleviate this effect, we propose to leverage a large…

Computer Vision and Pattern Recognition · Computer Science 2019-10-29 Kibok Lee , Kimin Lee , Jinwoo Shin , Honglak Lee

Neural networks tend to gradually forget the previously learned knowledge when learning multiple tasks sequentially from dynamic data distributions. This problem is called \textit{catastrophic forgetting}, which is a fundamental challenge…

Computation and Language · Computer Science 2022-03-21 Chenze Shao , Yang Feng

Catastrophic forgetting is a problem caused by neural networks' inability to learn data in sequence. After learning two tasks in sequence, performance on the first one drops significantly. This is a serious disadvantage that prevents many…

Machine Learning · Computer Science 2020-04-30 Wojciech Masarczyk , Ivona Tautkute

Deep neural networks (DNNs) are often trained on the premise that the complete training data set is provided ahead of time. However, in real-world scenarios, data often arrive in chunks over time. This leads to important considerations…

Machine Learning · Computer Science 2023-03-21 Vijaya Raghavan T. Ramkumar , Elahe Arani , Bahram Zonooz

Deep Reinforcement Learning (DRL) has been highly effective in learning from and adapting to RF environments and thus detecting and mitigating jamming effects to facilitate reliable wireless communications. However, traditional DRL methods…

Machine Learning · Computer Science 2024-10-15 Kemal Davaslioglu , Sastry Kompella , Tugba Erpek , Yalin E. Sagduyu