English
Related papers

Related papers: Episodic memory governs choices: An RNN-based rein…

200 papers

Reinforcement learning (RL) provides a naturalistic framing for learning through trial and error, which is appealing both because of its simplicity and effectiveness and because of its resemblance to how humans and animals acquire skills…

Machine Learning · Computer Science 2022-08-09 Archit Sharma , Kelvin Xu , Nikhil Sardana , Abhishek Gupta , Karol Hausman , Sergey Levine , Chelsea Finn

Despite the growing interest in robot control utilizing the computation of biological neurons, context-dependent behavior by neuron-connected robots remains a challenge. Context-dependent behavior here is defined as behavior that is not the…

Episodic memory is a psychology term which refers to the ability to recall specific events from the past. We suggest one advantage of this particular type of memory is the ability to easily assign credit to a specific state when remembered…

Machine Learning · Computer Science 2018-06-05 Kenny J. Young , Richard S. Sutton , Shuo Yang

Humans and animals show remarkable learning efficiency, adapting to new environments with minimal experience. This capability is not well captured by standard reinforcement learning algorithms that rely on incremental value updates. Rapid…

Artificial Intelligence · Computer Science 2025-12-03 Ching Fang , Kanaka Rajan

Replay is a powerful strategy to promote learning in artificial intelligence and the brain. However, the conditions to generate it and its functional advantages have not been fully recognized. In this study, we develop a modular…

Systems and Control · Electrical Eng. & Systems 2024-10-08 Jiyi Wang , Likai Tang , Huimiao Chen , Marcelo G Mattar , Sen Song

Understanding cognitive processes in multi-agent interactions is a primary goal in cognitive science. It can guide the direction of artificial intelligence (AI) research toward social decision-making in multi-agent systems, which includes…

Machine Learning · Computer Science 2024-10-24 Dongsu Lee , Minhae Kwon

Humans excel at remembering concrete experiences along spatiotemporal contexts and performing reasoning across those events, i.e., the capacity for episodic memory. In contrast, memory in language agents remains mainly semantic, and current…

Artificial Intelligence · Computer Science 2026-03-03 Yiheng Shu , Saisri Padmaja Jonnalagedda , Xiang Gao , Bernal Jiménez Gutiérrez , Weijian Qi , Kamalika Das , Huan Sun , Yu Su

A fundamental question in neuroscience is how the brain creates an internal model of the world to guide actions using sequences of ambiguous sensory information. This is naturally formulated as a reinforcement learning problem under partial…

Machine Learning · Computer Science 2020-11-02 Minhae Kwon , Saurabh Daptardar , Paul Schrater , Xaq Pitkow

Accumulating evidence suggest that human behavior in trial-and-error learning tasks based on decisions between discrete actions may involve a combination of reinforcement learning (RL) and working-memory (WM). While the understanding of…

Artificial Intelligence · Computer Science 2019-04-30 Guillaume Viejo , Benoît Girard , Emmanuel Procyk , Mehdi Khamassi

Recurrent Neural Networks (RNNs) are popular models of brain function. The typical training strategy is to adjust their input-output behavior so that it matches that of the biological circuit of interest. Even though this strategy ensures…

Neurons and Cognition · Quantitative Biology 2020-11-09 Alessandro Salatiello , Martin A. Giese

The ability to estimate temporal relationships is critical for both animals and artificial agents. Cognitive science and neuroscience provide remarkable insights into behavioral and neural aspects of temporal credit assignment. In…

Artificial Intelligence · Computer Science 2024-12-23 Md Rysul Kabir , James Mochizuki-Freeman , Zoran Tiganj

Reinforcement learning (RL) is a branch of machine learning which is employed to solve various sequential decision making problems without proper supervision. Due to the recent advancement of deep learning, the newly proposed Deep-RL…

Artificial Intelligence · Computer Science 2019-04-17 Dhruv Ramani

Understanding the intricate operations of Recurrent Neural Networks (RNNs) mechanistically is pivotal for advancing their capabilities and applications. In this pursuit, we propose the Episodic Memory Theory (EMT), illustrating that RNNs…

Neural and Evolutionary Computing · Computer Science 2023-10-05 Arjun Karuvally , Peter Delmastro , Hava T. Siegelmann

Episodic memory plays an important role in the behavior of animals and humans. It allows the accumulation of information about current state of the environment in a task-agnostic way. This episodic representation can be later accessed by…

Neural and Evolutionary Computing · Computer Science 2019-05-08 Artyom Y. Sorokin , Mikhail S. Burtsev

Reinforcement Learning faces an important challenge in partial observable environments that has long-term dependencies. In order to learn in an ambiguous environment, an agent has to keep previous perceptions in a memory. Earlier memory…

Machine Learning · Computer Science 2023-02-22 Alper Demir

Observational learning is a type of learning that occurs as a function of observing, retaining and possibly replicating or imitating the behaviour of another agent. It is a core mechanism appearing in various instances of social learning…

Machine Learning · Computer Science 2017-06-22 Diana Borsa , Bilal Piot , Rémi Munos , Olivier Pietquin

Episodic memory lets reinforcement learning algorithms remember and exploit promising experience from the past to improve agent performance. Previous works on memory mechanisms show benefits of using episodic-based data structures for…

Machine Learning · Computer Science 2021-06-17 Igor Kuznetsov , Andrey Filchenkov

Complementary Learning Systems theory holds that intelligent agents need two learning systems. Semantic memory is encoded in the neocortex with dense, overlapping representations and acquires structured knowledge. Episodic memory is encoded…

Machine Learning · Computer Science 2025-09-03 Lucie Fontaine , Frédéric Alexandre

Designing an effective reward function has long been a challenge in reinforcement learning, particularly for complex tasks in unstructured environments. To address this, various learning paradigms have emerged that leverage different forms…

Machine Learning · Computer Science 2025-04-29 Muhammad Qasim Elahi , Somtochukwu Oguchienti , Maheed H. Ahmed , Mahsa Ghasemi

Recent advances in deep reinforcement learning algorithms have shown great potential and success for solving many challenging real-world problems, including Go game and robotic applications. Usually, these algorithms need a carefully…

Machine Learning · Computer Science 2019-06-03 Yang Liu , Yunan Luo , Yuanyi Zhong , Xi Chen , Qiang Liu , Jian Peng