English
Related papers

Related papers: Generative Memory for Lifelong Reinforcement Learn…

200 papers

Lifelong learning is a long-standing aim for artificial agents that act in dynamic environments, in which an agent needs to accumulate knowledge incrementally without forgetting previously learned representations. We investigate methods for…

Machine Learning · Computer Science 2021-11-17 Vadym Gryshchuk , Cornelius Weber , Chu Kiong Loo , Stefan Wermter

Humans and animals have the ability to continually acquire, fine-tune, and transfer knowledge and skills throughout their lifespan. This ability, referred to as lifelong learning, is mediated by a rich set of neurocognitive mechanisms that…

Machine Learning · Computer Science 2019-02-12 German I. Parisi , Ronald Kemker , Jose L. Part , Christopher Kanan , Stefan Wermter

Continual learning refers to the ability of a biological or artificial system to seamlessly learn from continuous streams of information while preventing catastrophic forgetting, i.e., a condition in which new incoming information strongly…

Machine Learning · Computer Science 2019-07-04 German I. Parisi , Christopher Kanan

Despite huge success, deep networks are unable to learn effectively in sequential multitask learning settings as they forget the past learned tasks after learning new tasks. Inspired from complementary learning systems theory, we address…

Machine Learning · Computer Science 2019-06-04 Mohammad Rostami , Soheil Kolouri , Praveen K. Pilly

Learning to act in an environment to maximise rewards is among the brain's key functions. This process has often been conceptualised within the framework of reinforcement learning, which has also gained prominence in machine learning and…

Machine Learning · Computer Science 2021-09-22 Emma L. Roscow , Raymond Chua , Rui Ponte Costa , Matt W. Jones , Nathan Lepora

Continual learning is the ability to sequentially learn over time by accommodating knowledge while retaining previously learned experiences. Neural networks can learn multiple tasks when trained on them jointly, but cannot maintain…

Machine Learning · Computer Science 2018-10-26 Frantzeska Lavda , Jason Ramapuram , Magda Gregorova , Alexandros Kalousis

Artificial neural networks (ANNs) continue to face challenges in continual learning, particularly due to catastrophic forgetting, the loss of previously learned knowledge when acquiring new tasks. Inspired by memory consolidation in the…

Machine Learning · Computer Science 2025-09-03 Jina Kim

Online reinforcement learning agents are currently able to process an increasing amount of data by converting it into a higher order value functions. This expansion of the information collected from the environment increases the agent's…

Machine Learning · Computer Science 2021-02-04 Mirza Ramicic , Andrea Bonarini

This paper presents a novel framework for automatic learning of complex strategies in human decision making. The task that we are interested in is to better facilitate long term planning for complex, multi-step events. We observe temporal…

Computer Vision and Pattern Recognition · Computer Science 2018-05-15 Tharindu Fernando , Simon Denman , Sridha Sridharan , Clinton Fookes

Neural networks can achieve excellent results in a wide variety of applications. However, when they attempt to sequentially learn, they tend to learn the new task while catastrophically forgetting previous ones. We propose a model that…

Machine Learning · Computer Science 2020-12-18 Craig Atkinson , Brendan McCane , Lech Szymanski , Anthony Robins

Humans accumulate knowledge in a lifelong fashion. Modern deep neural networks, on the other hand, are susceptible to catastrophic forgetting: when adapted to perform new tasks, they often fail to preserve their performance on previously…

Computer Vision and Pattern Recognition · Computer Science 2021-04-27 Mengyao Zhai , Lei Chen , Jiawei He , Megha Nawhal , Frederick Tung , Greg Mori

Deep Generative AI has been a long-standing essential topic in the machine learning community, which can impact a number of application areas like text generation and computer vision. The major paradigm to train a generative model is…

Machine Learning · Computer Science 2025-02-25 Yuanjiang Cao , Quan Z. Sheng , Julian McAuley , Lina Yao

Humans spend a remarkable fraction of waking life engaged in acts of "mental time travel". We dwell on our actions in the past and experience satisfaction or regret. More than merely autobiographical storytelling, we use these event…

Artificial Intelligence · Computer Science 2018-12-24 Chia-Chun Hung , Timothy Lillicrap , Josh Abramson , Yan Wu , Mehdi Mirza , Federico Carnevale , Arun Ahuja , Greg Wayne

In model-based reinforcement learning, generative and temporal models of environments can be leveraged to boost agent performance, either by tuning the agent's representations during training or via use as part of an explicit planning…

Lifelong learning requires models that can continuously learn from sequential streams of data without suffering catastrophic forgetting due to shifts in data distributions. Deep learning models have thrived in the non-sequential learning…

Computation and Language · Computer Science 2021-07-27 Nithin Holla , Pushkar Mishra , Helen Yannakoudakis , Ekaterina Shutova

With the capacity of continual learning, humans can continuously acquire knowledge throughout their lifespan. However, computational systems are not, in general, capable of learning tasks sequentially. This long-standing challenge for deep…

Machine Learning · Computer Science 2022-08-05 Qihan Yang , Fan Feng , Rosa Chan

Unlike humans, who are capable of continual learning over their lifetimes, artificial neural networks have long been known to suffer from a phenomenon known as catastrophic forgetting, whereby new learning can lead to abrupt erasure of…

Artificial Intelligence · Computer Science 2018-06-20 Christos Kaplanis , Murray Shanahan , Claudia Clopath

Developments in deep generative models have allowed for tractable learning of high-dimensional data distributions. While the employed learning procedures typically assume that training data is drawn i.i.d. from the distribution of interest,…

Machine Learning · Computer Science 2017-05-24 Ari Seff , Alex Beatson , Daniel Suo , Han Liu

Catastrophic forgetting of previously learned knowledge while learning new tasks is a widely observed limitation of contemporary neural networks. Although many continual learning methods are proposed to mitigate this drawback, the main…

Computer Vision and Pattern Recognition · Computer Science 2021-09-07 Wojciech Masarczyk , Kamil Deja , Tomasz Trzciński

Continual learning tries to learn new tasks without forgetting previously learned ones. In reality, most of the existing artificial neural network(ANN) models fail, while humans do the same by remembering previous works throughout their…

Computer Vision and Pattern Recognition · Computer Science 2021-05-18 Subhankar Ghosh