English
Related papers

Related papers: Optimizing Agent Behavior over Long Time Scales by…

200 papers

Temporal credit assignment is crucial for learning and skill development in natural and artificial intelligence. While computational methods like the TD approach in reinforcement learning have been proposed, it's unclear if they accurately…

Artificial Intelligence · Computer Science 2023-07-18 Thuy Ngoc Nguyen , Chase McDonald , Cleotilde Gonzalez

AI agents are increasingly used in long, multi-turn workflows in both research and enterprise settings. As interactions grow, agent behavior often degrades due to loss of constraint focus, error accumulation, and memory-induced drift. This…

Neurons and Cognition · Quantitative Biology 2026-02-05 Fouad Bousetouane

A long-term goal of language agents is to learn and improve through their own experience, ultimately outperforming humans in complex, real-world tasks. However, training agents from experience data with reinforcement learning remains…

Most current AI models have little ability to store and later retrieve a record or representation of what they do. In human cognition, episodic memories play an important role in both recall of the past as well as planning for the future.…

Artificial Intelligence · Computer Science 2025-01-23 Chad DeChant

Understanding decision-making in multi-AI-agent frameworks is crucial for analyzing strategic interactions in network-effect-driven contexts. This study investigates how AI agents navigate network-effect games, where individual payoffs…

Multiagent Systems · Computer Science 2025-12-16 Yu Liu , Wenwen Li , Yifan Dou , Guangnan Ye

Experience replay is one of the most commonly used approaches to improve the sample efficiency of reinforcement learning algorithms. In this work, we propose an approach to select and replay sequences of transitions in order to accelerate…

Artificial Intelligence · Computer Science 2022-09-29 Thommen George Karimpanal , Roland Bouffanais

The main challenge of multiagent reinforcement learning is the difficulty of learning useful policies in the presence of other simultaneously learning agents whose changing behaviors jointly affect the environment's transition and reward…

A fundamental aspect of behaviour is the ability to encode salient features of experience in memory and use these memories, in combination with current sensory information, to predict the best action for each situation such that long-term…

Neural and Evolutionary Computing · Computer Science 2021-06-25 Stephen Kelly , Tatiana Voegerl , Wolfgang Banzhaf , Cedric Gondro

Episodic memory lets reinforcement learning algorithms remember and exploit promising experience from the past to improve agent performance. Previous works on memory mechanisms show benefits of using episodic-based data structures for…

Machine Learning · Computer Science 2021-06-17 Igor Kuznetsov , Andrey Filchenkov

In the future we can expect that artificial intelligent agents, once deployed, will be required to learn continually from their experience during their operational lifetime. Such agents will also need to communicate with humans and other…

Artificial Intelligence · Computer Science 2021-10-01 David Murphy , Thomas S. Paula , Wagston Staehler , Juliano Vacaro , Gabriel Paz , Guilherme Marques , Bruna Oliveira

Memory has emerged, and will continue to remain, a core capability of foundation model-based agents. As research on agent memory rapidly expands and attracts unprecedented attention, the field has also become increasingly fragmented.…

Current model-based reinforcement learning (MBRL) agents struggle with long-term dependencies. This limits their ability to effectively solve tasks involving extended time gaps between actions and outcomes, or tasks demanding the recalling…

Machine Learning · Computer Science 2024-03-08 Mohammad Reza Samsami , Artem Zholus , Janarthanan Rajendran , Sarath Chandar

Modern AI agents increasingly combine conversational interaction with autonomous task execution, such as coding and web research, raising a natural question: What happens when an agent engaged in long-horizon tasks is exposed to user…

Artificial Intelligence · Computer Science 2026-05-22 Hyejun Jeong , Amir Houmansadr , Shlomo Zilberstein , Eugene Bagdasarian

As AI becomes more prevalent throughout society, effective methods of integrating humans and AI systems that leverage their respective strengths and mitigate risk have become an important priority. In this paper, we introduce the paradigm…

Machine Learning · Computer Science 2023-10-24 Jiayi Wang , Zhengling Qi , Chengchun Shi

Assistive agents should make humans' lives easier. Classically, such assistance is studied through the lens of inverse reinforcement learning, where an assistive agent (e.g., a chatbot, a robot) infers a human's intention and then selects…

Artificial Intelligence · Computer Science 2025-01-17 Vivek Myers , Evan Ellis , Sergey Levine , Benjamin Eysenbach , Anca Dragan

Practical uses of Artificial Intelligence (AI) in the real world have demonstrated the importance of embedding moral choices into intelligent agents. They have also highlighted that defining top-down ethical constraints on AI according to…

Multiagent Systems · Computer Science 2023-08-31 Elizaveta Tennant , Stephen Hailes , Mirco Musolesi

Experience replay enables reinforcement learning agents to memorize and reuse past experiences, just as humans replay memories for the situation at hand. Contemporary off-policy algorithms either replay past experiences uniformly or utilize…

Machine Learning · Computer Science 2019-06-21 Daochen Zha , Kwei-Herng Lai , Kaixiong Zhou , Xia Hu

AI agents are being developed to support high stakes decision-making processes from driving cars to prescribing drugs, making it increasingly important for human users to understand their behavior. Policy summarization methods aim to convey…

Machine Learning · Computer Science 2019-06-03 Isaac Lage , Daphna Lifschitz , Finale Doshi-Velez , Ofra Amir

In model-based reinforcement learning, the agent interleaves between model learning and planning. These two components are inextricably intertwined. If the model is not able to provide sensible long-term prediction, the executed planner…

Machine Learning · Statistics 2019-03-19 Nan Rosemary Ke , Amanpreet Singh , Ahmed Touati , Anirudh Goyal , Yoshua Bengio , Devi Parikh , Dhruv Batra