English
Related papers

Related papers: Mastering Atari with Discrete World Models

200 papers

Reinforcement learning has achieved great success in many applications. However, sample efficiency remains a key challenge, with prominent methods requiring millions (or even billions) of environment steps to train. Recently, there has been…

Machine Learning · Computer Science 2021-12-14 Weirui Ye , Shaohuai Liu , Thanard Kurutach , Pieter Abbeel , Yang Gao

In an unfamiliar setting, a model-based reinforcement learning agent can be limited by the accuracy of its world model. In this work, we present a novel, training-free approach to improving the performance of such agents separately from…

Machine Learning · Computer Science 2024-02-26 Martin Benfeghoul , Umais Zahid , Qinghai Guo , Zafeirios Fountas

When playing video-games we immediately detect which entity we control and we center the attention towards it to focus the learning and reduce its dimensionality. Reinforcement Learning (RL) has been able to deal with big state spaces,…

Machine Learning · Computer Science 2020-01-01 Berkay Demirel , Martí Sánchez-Fibla

Agentic reinforcement learning increasingly relies on experience-driven scaling, yet real-world environments remain non-adaptive, limited in coverage, and difficult to scale. World models offer a potential way to improve learning efficiency…

Computation and Language · Computer Science 2026-03-06 Yixia Li , Hongru Wang , Jiahao Qiu , Zhenfei Yin , Dongdong Zhang , Cheng Qian , Zeping Li , Pony Ma , Guanhua Chen , Heng Ji

We evaluate the use of original game curricula supported by the Atari 2600 console as a heterogeneous transfer benchmark for deep reinforcement learning agents. Game designers created curricula using combinations of several discrete…

Machine Learning · Computer Science 2022-10-25 Andrei A. Rusu , Sebastian Flennerhag , Dushyant Rao , Razvan Pascanu , Raia Hadsell

Developing agents for complex and underspecified tasks, where no clear objective exists, remains challenging but offers many opportunities. This is especially true in video games, where simulated players (bots) need to play realistically,…

Machine Learning · Computer Science 2025-04-15 Emilien Biré , Anthony Kobanda , Ludovic Denoyer , Rémy Portelas

Understanding the interactions of agents trained with deep reinforcement learning is crucial for deploying agents in games or the real world. In the former, unreasonable actions confuse players. In the latter, that effect is even more…

Artificial Intelligence · Computer Science 2023-09-08 Manuel Eberhardinger , Johannes Maucher , Setareh Maghsudi

Intelligent agents need to select long sequences of actions to solve complex tasks. While humans easily break down tasks into subgoals and reach them through millions of muscle commands, current artificial intelligence is limited to tasks…

Artificial Intelligence · Computer Science 2022-06-10 Danijar Hafner , Kuang-Huei Lee , Ian Fischer , Pieter Abbeel

Video reasoning constitutes a comprehensive assessment of a model's capabilities, as it demands robust perceptual and interpretive skills, thereby serving as a means to explore the boundaries of model performance. While recent research has…

Computer Vision and Pattern Recognition · Computer Science 2026-02-06 Yudi Shi , Shangzhe Di , Qirui Chen , Qinian Wang , Jiayin Cai , Xiaolong Jiang , Yao Hu , Weidi Xie

Recent breakthroughs in Go play and strategic games have witnessed the great potential of reinforcement learning in intelligently scheduling in uncertain environment, but some bottlenecks are also encountered when we generalize this…

Machine Learning · Computer Science 2018-12-27 Xingxing Liang , Qi Wang , Yanghe Feng , Zhong Liu , Jincai Huang

Continual RL requires an agent to learn new tasks without forgetting previous ones, while improving on both past and future tasks. The most common approaches use model-free algorithms and replay buffers can help to mitigate catastrophic…

Machine Learning · Computer Science 2024-07-17 Luke Yang , Levin Kuhlmann , Gideon Kowadlo

Scaling up deep Reinforcement Learning (RL) methods presents a significant challenge. Following developments in generative modelling, model-based RL positions itself as a strong contender. Recent advances in sequence modelling have led to…

Machine Learning · Computer Science 2024-06-28 Vincent Micheli , Eloi Alonso , François Fleuret

For an autonomous vehicle to plan a path in its environment, it must be able to accurately forecast the trajectory of all dynamic objects in its proximity. While many traditional methods encode observations in the scene to solve this…

Robotics · Computer Science 2024-06-21 Hunter Schofield , Hamidreza Mirkhani , Mohammed Elmahgiubi , Kasra Rezaee , Jinjun Shan

Robotic imitation learning typically assumes access to optimal demonstrations, yet real-world data collection often yields suboptimal, exploratory, or even failed trajectories. Discarding such data wastes valuable information about…

Robotics · Computer Science 2026-05-12 Lianghao Luo , Xizhou Bu , Ruyan Liu , Qingqiu Huang , Chufeng Tang , Xiaoshuai Hao , Hongbo Wang , Wei Li

Agent self-improvement, where the backbone Large Language Model (LLM) of the agent are trained on trajectories sampled autonomously based on their own policies, has emerged as a promising approach for enhancing performance. Recent…

Computation and Language · Computer Science 2025-08-22 Tianqing Fang , Hongming Zhang , Zhisong Zhang , Kaixin Ma , Wenhao Yu , Haitao Mi , Dong Yu

Reinforcement learning (RL) promises to unlock capabilities beyond imitation learning for Vision-Language-Action (VLA) models, but its requirement for massive real-world interaction prevents direct deployment on physical robots. Recent work…

Recent progress in reasoning with large language models (LLMs), such as DeepSeek-R1, demonstrates impressive capabilities in domains like mathematics and coding, by exhibiting complex cognitive behaviors such as verification, goal…

Artificial Intelligence · Computer Science 2025-10-14 Xiao Yu , Baolin Peng , Ruize Xu , Michel Galley , Hao Cheng , Suman Nath , Jianfeng Gao , Zhou Yu

Nowadays, model-free reinforcement learning algorithms have achieved remarkable performance on many decision making and control tasks, but high sample complexity and low sample efficiency still hinder the wide use of model-free…

Artificial Intelligence · Computer Science 2020-10-27 Jingbin Liu , Xinyang Gu , Shuai Liu

Real-world reinforcement learning demands adaptation to unseen environmental conditions without costly retraining. Contextual Markov Decision Processes (cMDP) model this challenge, but existing methods often require explicit context…

Machine Learning · Computer Science 2026-01-19 Frank Röder , Jan Benad , Manfred Eppe , Pradeep Kr. Banerjee

For over a decade now, robotics and the use of artificial agents have become a common thing.Testing the performance of new path finding or search space optimization algorithms has also become a challenge as they require simulation or an…

Machine Learning · Computer Science 2022-07-29 Jerin Paul Selvan , Pravin S. Game