English
Related papers

Related papers: Episodic memory governs choices: An RNN-based rein…

200 papers

The deployment of reinforcement learning (RL) in the real world comes with challenges in calibrating user trust and expectations. As a step toward developing RL systems that are able to communicate their competencies, we present a method of…

Machine Learning · Computer Science 2020-11-19 Aastha Acharya , Rebecca Russell , Nisar R. Ahmed

A fundamental challenge in machine learning today is to build a model that can learn from few examples. Here, we describe a reservoir based spiking neural model for learning to recognize actions with a limited number of labeled videos.…

Neural and Evolutionary Computing · Computer Science 2017-10-23 Priyadarshini Panda , Narayan Srinivasa

Decision-making is critical for lane change in autonomous driving. Reinforcement learning (RL) algorithms aim to identify the values of behaviors in various situations and thus they become a promising pathway to address the decision-making…

Robotics · Computer Science 2022-07-08 Jingda Wu , Wenhui Huang , Niels de Boer , Yanghui Mo , Xiangkun He , Chen Lv

Catastrophic forgetting has remained a significant challenge for efficient reinforcement learning for decades (Ring 1994, Rivest and Precup 2003). While recent works have proposed effective methods to mitigate this issue, they mainly focus…

Machine Learning · Computer Science 2025-09-24 Qingfeng Lan , Gautham Vasan , A. Rupam Mahmood

The Hierarchical Reasoning Model (HRM) has impressive reasoning abilities given its small size, but has only been applied to supervised, static, fully-observable problems. One of HRM's strengths is its ability to adapt its computational…

Artificial Intelligence · Computer Science 2025-10-28 Long H Dang , David Rawlinson

Model-based Reinforcement Learning approaches have the promise of being sample efficient. Much of the progress in learning dynamics models in RL has been made by learning models via supervised learning. But traditional model-based…

Machine Learning · Computer Science 2019-06-12 Shagun Sodhani , Anirudh Goyal , Tristan Deleu , Yoshua Bengio , Sergey Levine , Jian Tang

What is the role of real-time control and learning in the formation of social conventions? To answer this question, we propose a computational model that matches human behavioral data in a social decision-making game that was analyzed both…

Multiagent Systems · Computer Science 2020-01-03 Ismael T. Freire , Clement Moulin-Frier , Marti Sanchez-Fibla , Xerxes D. Arsiwalla , Paul Verschure

A self-learning optimal control algorithm for episodic fixed-horizon manufacturing processes with time-discrete control actions is proposed and evaluated on a simulated deep drawing process. The control model is built during consecutive…

Systems and Control · Computer Science 2020-01-07 Johannes Dornheim , Norbert Link , Peter Gumbsch

Encoding models are used for predicting brain activity in response to sensory stimuli with the objective of elucidating how sensory information is represented in the brain. Encoding models typically comprise a nonlinear transformation of…

Neurons and Cognition · Quantitative Biology 2017-03-13 Umut Güçlü , Marcel A. J. van Gerven

Learning by interaction is the key to skill acquisition for most living organisms, which is formally called Reinforcement Learning (RL). RL is efficient in finding optimal policies for endowing complex systems with sophisticated behavior.…

Robotics · Computer Science 2025-11-21 Karim Farid , Nourhan Sakr

Experience replay is one of the most commonly used approaches to improve the sample efficiency of reinforcement learning algorithms. In this work, we propose an approach to select and replay sequences of transitions in order to accelerate…

Artificial Intelligence · Computer Science 2022-09-29 Thommen George Karimpanal , Roland Bouffanais

Temporal reasoning over long, multi-session dialogues is a critical capability for conversational agents. However, existing works and our pilot study have shown that as dialogue histories grow in length and accumulate noise, current…

Reinforcement Learning (RL) has emerged as a powerful paradigm for training LLM-based agents, yet remains limited by low sample efficiency, stemming not only from sparse outcome feedback but also from the agent's inability to leverage prior…

Machine Learning · Computer Science 2026-03-19 Dilxat Muhtar , Jiashun Liu , Wei Gao , Weixun Wang , Shaopan Xiong , Ju Huang , Siran Yang , Wenbo Su , Jiamang Wang , Ling Pan , Bo Zheng

It is now widely accepted that one of the roles of the hippocampus is to maintain episodic spatial representations, while parallel striatal pathways contribute to both declarative and procedural value computations by encoding different…

Neurons and Cognition · Quantitative Biology 2014-12-10 Fabian Chersi

We apply reinforcement learning (RL) to robotics tasks. One of the drawbacks of traditional RL algorithms has been their poor sample efficiency. One approach to improve the sample efficiency is model-based RL. In our model-based RL…

Machine Learning · Computer Science 2023-05-16 Adithya Ramesh , Balaraman Ravindran

We propose a novel memory-enhancing mechanism for recurrent neural networks that exploits the effect of human cognitive appraisal in sequential assessment tasks. We conceptualize the memory-enhancing mechanism as Reinforcement Memory Unit…

Computer Vision and Pattern Recognition · Computer Science 2022-08-09 Yaosi Hu , Zhenzhong Chen

Robotic manipulation often requires memory: occlusion and state changes can make decision-time observations perceptually aliased, making action selection non-Markovian at the observation level because the same observation may arise from…

Robotics · Computer Science 2026-03-26 Xinying Guo , Chenxi Jiang , Hyun Bin Kim , Ying Sun , Yang Xiao , Yuhang Han , Jianfei Yang

Humans spend a remarkable fraction of waking life engaged in acts of "mental time travel". We dwell on our actions in the past and experience satisfaction or regret. More than merely autobiographical storytelling, we use these event…

Artificial Intelligence · Computer Science 2018-12-24 Chia-Chun Hung , Timothy Lillicrap , Josh Abramson , Yan Wu , Mehdi Mirza , Federico Carnevale , Arun Ahuja , Greg Wayne

Reinforcement Learning (RL) agents often exhibit learning behaviors that are not intuitively interpretable by human observers, which can result in suboptimal feedback in collaborative teaching settings. Yet, how humans perceive and…

Human-Computer Interaction · Computer Science 2025-06-17 Bernhard Hilpert , Muhan Hou , Kim Baraka , Joost Broekens

Replay in neural networks involves training on sequential data with memorized samples, which counteracts forgetting of previous behavior caused by non-stationarity. We present a method where these auxiliary samples are generated on the fly,…

Machine Learning · Computer Science 2020-12-15 Xu Ji , Joao Henriques , Tinne Tuytelaars , Andrea Vedaldi