English
Related papers

Related papers: Memory Lens: How Much Memory Does an Agent Use?

200 papers

We introduce a new virtual environment for simulating a card game known as "Big 2". This is a four-player game of imperfect information with a relatively complicated action space (being allowed to play 1,2,3,4 or 5 card combinations from an…

Machine Learning · Computer Science 2018-09-03 Henry Charlesworth

In this work we present a method for using Deep Q-Networks (DQNs) in multi-objective environments. Deep Q-Networks provide remarkable performance in single objective problems learning from high-level visual state representations. However,…

Artificial Intelligence · Computer Science 2018-02-26 Tomasz Tajmajer

Advances in reinforcement learning (RL) often rely on massive compute resources and remain notoriously sample inefficient. In contrast, the human brain is able to efficiently learn effective control strategies using limited resources. This…

Machine Learning · Computer Science 2024-01-30 Burcu Küçükoğlu , Walraaf Borkent , Bodo Rueckauer , Nasir Ahmad , Umut Güçlü , Marcel van Gerven

Self-play, a learning paradigm where agents iteratively refine their policies by interacting with historical or concurrent versions of themselves or other evolving agents, has shown remarkable success in solving complex non-cooperative…

Artificial Intelligence · Computer Science 2025-10-21 Ruize Zhang , Zelai Xu , Chengdong Ma , Chao Yu , Wei-Wei Tu , Wenhao Tang , Shiyu Huang , Deheng Ye , Wenbo Ding , Yaodong Yang , Yu Wang

Reinforcement learning has become one of the most trending subjects in the recent decade. It has seen applications in various fields such as robot manipulations, autonomous driving, path planning, computer gaming, etc. We accomplished three…

Artificial Intelligence · Computer Science 2021-10-18 Hanzhi Yang

Real-world reinforcement learning tasks often involve some form of partial observability where the observations only give a partial or noisy view of the true state of the world. Such tasks typically require some form of memory, where the…

Machine Learning · Computer Science 2022-11-11 Kevin Esslinger , Robert Platt , Christopher Amato

We study the effect of imperfect memory on decision making in the context of a stochastic sequential action-reward problem. An agent chooses a sequence of actions which generate discrete rewards at different rates. She is allowed to make…

Probability · Mathematics 2019-09-20 Kuang Xu , Se-Young Yun

This paper introduces a reinforcement learning framework that enables controllable and diverse player behaviors without relying on human gameplay data. Existing approaches often require large-scale player trajectories, train separate models…

Machine Learning · Computer Science 2025-12-12 Atahan Cilan , Atay Özgövde

Most existing approaches for goal-oriented dialogue policy learning used reinforcement learning, which focuses on the target agent policy and simply treat the opposite agent policy as part of the environment. While in real-world scenarios,…

Computation and Language · Computer Science 2020-04-22 Zheng Zhang , Lizi Liao , Xiaoyan Zhu , Tat-Seng Chua , Zitao Liu , Yan Huang , Minlie Huang

We introduce two tactics to attack agents trained by deep reinforcement learning algorithms using adversarial examples, namely the strategically-timed attack and the enchanting attack. In the strategically-timed attack, the adversary aims…

Machine Learning · Computer Science 2019-11-14 Yen-Chen Lin , Zhang-Wei Hong , Yuan-Hong Liao , Meng-Li Shih , Ming-Yu Liu , Min Sun

The rise of process data availability has recently led to the development of data-driven learning approaches. However, most of these approaches restrict the use of the learned model to predict the future of ongoing process executions. The…

Artificial Intelligence · Computer Science 2025-07-25 Stefano Branchi , Chiara Di Francescomarino , Chiara Ghidini , David Massimo , Francesco Ricci , Massimiliano Ronzani

Reinforcement learning has been explored for many problems, from video games with deterministic environments to portfolio and operations management in which scenarios are stochastic; however, there have been few attempts to test these…

General Finance · Quantitative Finance 2024-02-19 Sherly Alfonso-Sánchez , Jesús Solano , Alejandro Correa-Bahnsen , Kristina P. Sendova , Cristián Bravo

This work considers a repeated principal-agent bandit game, where the principal can only interact with her environment through the agent. The principal and the agent have misaligned objectives and the choice of action is only left to the…

The effects of policy sharing between agents in a multi-agent dynamical system has not been studied extensively. I simulate a system of agents optimizing the same task using reinforcement learning, to study the effects of different…

Multiagent Systems · Computer Science 2008-12-10 Jake Ellowitz

In Formula 1, race strategies are adapted according to evolving race conditions and competitors' actions. This paper proposes a reinforcement learning approach for multi-agent race strategy optimization. Agents learn to balance energy…

Artificial Intelligence · Computer Science 2026-02-27 Giona Fieni , Joschua Wüthrich , Marc-Philippe Neumann , Christopher H. Onder

Animals execute goal-directed behaviours despite the limited range and scope of their sensors. To cope, they explore environments and store memories maintaining estimates of important information that is not presently available. Recently,…

Nowadays, model-free reinforcement learning algorithms have achieved remarkable performance on many decision making and control tasks, but high sample complexity and low sample efficiency still hinder the wide use of model-free…

Artificial Intelligence · Computer Science 2020-10-27 Jingbin Liu , Xinyang Gu , Shuai Liu

Personalized agents that interact with users over long periods must maintain persistent memory across sessions and update it as circumstances change. However, existing benchmarks predominantly frame long-term memory evaluation as fact…

Computation and Language · Computer Science 2026-04-23 Md Nayem Uddin , Kumar Shubham , Eduardo Blanco , Chitta Baral , Gengyu Wang

Fictitious play with reinforcement learning is a general and effective framework for zero-sum games. However, using the current deep neural network models, the implementation of fictitious play faces crucial challenges. Neural network model…

Machine Learning · Computer Science 2019-12-02 Rong-Jun Qin , Jing-Cheng Pang , Yang Yu

The main challenge of multiagent reinforcement learning is the difficulty of learning useful policies in the presence of other simultaneously learning agents whose changing behaviors jointly affect the environment's transition and reward…