English
Related papers

Related papers: RECALL: Replay-based Continual Learning in Semanti…

200 papers

Continual learning -- the ability to acquire knowledge incrementally without forgetting previous skills -- is fundamental to natural intelligence. While the human brain excels at this, artificial neural networks struggle with "catastrophic…

Machine Learning · Computer Science 2025-09-16 Aoi Otani

A popular strategy to train recurrent neural networks (RNNs), known as ``teacher forcing'' takes the ground truth as input at each time step and makes the later predictions partly conditioned on those inputs. Such training strategy impairs…

Computation and Language · Computer Science 2021-03-23 Liping Yuan , Jiangtao Feng , Xiaoqing Zheng , Xuanjing Huang

Data streams are rarely static in dynamic environments like Industry 4.0. Instead, they constantly change, making traditional offline models outdated unless they can quickly adjust to the new data. This need can be adequately addressed by…

Comprehensive surgical planning require complex patient-specific anatomical models. For instance, functional muskuloskeletal simulations necessitate all relevant structures to be segmented, which could be performed in real-time using deep…

Image and Video Processing · Electrical Eng. & Systems 2019-05-20 Firat Ozdemir , Orcun Goksel

In this work, we improve the generative replay in a continual learning setting to perform well on challenging scenarios. Current generative rehearsal methods are usually benchmarked on small and simple datasets as they are not powerful…

Machine Learning · Computer Science 2023-09-20 Valeriya Khan , Sebastian Cygert , Kamil Deja , Tomasz Trzciński , Bartłomiej Twardowski

In continual learning, the learner faces a stream of data whose distribution changes over time. Modern neural networks are known to suffer under this setting, as they quickly forget previously acquired knowledge. To address such…

Machine Learning · Computer Science 2021-03-03 Arslan Chaudhry , Albert Gordo , Puneet K. Dokania , Philip Torr , David Lopez-Paz

Although data-free incremental learning methods are memory-friendly, accurately estimating and counteracting representation shifts is challenging in the absence of historical data. This paper addresses this thorny problem by proposing a…

Computer Vision and Pattern Recognition · Computer Science 2023-03-27 Zhiheng Ma , Xiaopeng Hong , Beinan Liu , Yabin Wang , Pinyue Guo , Huiyun Li

Continually learning to segment more and more types of image regions is a desired capability for many intelligent systems. However, such continual semantic segmentation suffers from the same catastrophic forgetting issue as in continual…

Computer Vision and Pattern Recognition · Computer Science 2023-02-14 Yiqiao Qiu , Yixing Shen , Zhuohao Sun , Yanchong Zheng , Xiaobin Chang , Weishi Zheng , Ruixuan Wang

Human memory is inherently prone to forgetting. To address this, multimodal embedding models have been introduced, which transform diverse real-world data into a unified embedding space. These embeddings can be retrieved efficiently, aiding…

Information Retrieval · Computer Science 2024-09-25 Dongqi Cai , Shangguang Wang , Chen Peng , Zeling Zhang , Mengwei Xu

Residual connections are one of the most important components in neural network architectures for mitigating the vanishing gradient problem and facilitating the training of much deeper networks. One possible explanation for how residual…

Machine Learning · Computer Science 2024-11-15 Sejik Park

Inferring an adversary's goals from exhibited behavior is crucial for counterplanning and non-cooperative multi-agent systems in domains like cybersecurity, military, and strategy games. Deep Inverse Reinforcement Learning (IRL) methods…

Machine Learning · Computer Science 2025-10-07 Paul Ghanem , Owen Howell , Michael Potter , Pau Closas , Alireza Ramezani , Deniz Erdogmus , Tales Imbiriba

The catastrophic forgetting of previously learnt classes is one of the main obstacles to the successful development of a reliable and accurate generative continual learning model. When learning new classes, the internal representation of…

Machine Learning · Computer Science 2021-11-24 Jack Millichamp , Xi Chen

Recurrent large language models that compete with Transformers in language modeling perplexity are emerging at a rapid rate (e.g., Mamba, RWKV). Excitingly, these architectures use a constant amount of memory during inference. However, due…

Computation and Language · Computer Science 2024-07-09 Simran Arora , Aman Timalsina , Aaryan Singhal , Benjamin Spector , Sabri Eyuboglu , Xinyi Zhao , Ashish Rao , Atri Rudra , Christopher Ré

A key attribute that drives the unprecedented success of modern Recurrent Neural Networks (RNNs) on learning tasks which involve sequential data, is their ability to model intricate long-term temporal dependencies. However, a well…

Machine Learning · Computer Science 2018-06-07 Yoav Levine , Or Sharir , Alon Ziv , Amnon Shashua

Most modern neural networks for classification fail to take into account the concept of the unknown. Trained neural networks are usually tested in an unrealistic scenario with only examples from a closed set of known classes. In an attempt…

Machine Learning · Computer Science 2022-12-27 Justin Leo , Jugal Kalita

In Continual learning (CL) balancing effective adaptation while combating catastrophic forgetting is a central challenge. Many of the recent best-performing methods utilize various forms of prior task data, e.g. a replay buffer, to tackle…

Machine Learning · Computer Science 2023-06-07 Nader Asadi , MohammadReza Davari , Sudhir Mudur , Rahaf Aljundi , Eugene Belilovsky

Deep neural networks (DNNs) excel on fixed datasets but struggle with incremental and shifting data in real-world scenarios. Continual learning addresses this challenge by allowing models to learn from new data while retaining previously…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Lu Yu , Zhe Tao , Dipam Goswami , Hantao Yao , Bartłomiej Twardowski , Joost Van de Weijer , Changsheng Xu

We introduce iterative retrieval, a novel framework that empowers retrievers to make iterative decisions through policy optimization. Finding an optimal portfolio of retrieved items is a combinatorial optimization problem, generally…

Computation and Language · Computer Science 2024-06-24 Yunmo Chen , Tongfei Chen , Harsh Jhamtani , Patrick Xia , Richard Shin , Jason Eisner , Benjamin Van Durme

Recent years have witnessed a great development of Convolutional Neural Networks in semantic segmentation, where all classes of training images are simultaneously available. In practice, new images are usually made available in a…

Computer Vision and Pattern Recognition · Computer Science 2022-03-17 Hanbin Zhao , Fengyu Yang , Xinghe Fu , Xi Li

Continual Learning entails progressively acquiring knowledge from new data while retaining previously acquired knowledge, thereby mitigating ``Catastrophic Forgetting'' in neural networks. Our work presents a novel uncertainty-driven…

Computer Vision and Pattern Recognition · Computer Science 2025-05-12 Sriram Mandalika , Harsha Vardhan , Athira Nambiar