English
Related papers

Related papers: Is Policy Learning Overrated?: Width-Based Plannin…

200 papers

Recent reinforcement learning (RL) approaches have shown strong performance in complex domains such as Atari games, but are often highly sample inefficient. A common approach to reduce interaction time with the environment is to use reward…

Machine Learning · Computer Science 2019-06-03 Prasoon Goyal , Scott Niekum , Raymond J. Mooney

We pursue a life-long learning approach to artificial intelligence that makes extensive use of reinforcement learning algorithms. We build on our prior work with general value functions (GVFs) and the Horde architecture. GVFs have been…

Artificial Intelligence · Computer Science 2012-06-28 Adam White , Joseph Modayil , Richard S. Sutton

Active learning aims to develop label-efficient algorithms by sampling the most representative queries to be labeled by an oracle. We describe a pool-based semi-supervised active learning algorithm that implicitly learns this sampling…

Machine Learning · Computer Science 2019-10-30 Samarth Sinha , Sayna Ebrahimi , Trevor Darrell

The combination of deep learning and Monte Carlo Tree Search (MCTS) has shown to be effective in various domains, such as board and video games. AlphaGo represented a significant step forward in our ability to learn complex board games, and…

Machine Learning · Computer Science 2021-04-29 Alexandre Borges , Arlindo Oliveira

World-Action Models (WAM) initialized from pre-trained video generation backbones have demonstrated remarkable potential for robot policy learning. However, existing approaches face two critical bottlenecks that hinder performance and…

We consider an active visual exploration scenario, where an agent must intelligently select its camera motions to efficiently reconstruct the full environment from only a limited set of narrow field-of-view glimpses. While the agent has…

Computer Vision and Pattern Recognition · Computer Science 2018-07-31 Santhosh K. Ramakrishnan , Kristen Grauman

We train a reinforcement learner to play a simplified version of the game Angry Birds. The learner is provided with a game state in a manner similar to the output that could be produced by computer vision algorithms. We improve on the…

Artificial Intelligence · Computer Science 2016-01-08 Imanol Arrieta Ibarra , Bernardo Ramos , Lars Roemheld

Model-based reinforcement learning agents utilizing transformers have shown improved sample efficiency due to their ability to model extended context, resulting in more accurate world models. However, for complex reasoning and planning…

Machine Learning · Computer Science 2024-06-04 Pranav Agarwal , Sheldon Andrews , Samira Ebrahimi Kahou

In distributional reinforcement learning (RL), the estimated distribution of value function models both the parametric and intrinsic uncertainties. We propose a novel and efficient exploration method for deep RL that has two components. The…

Machine Learning · Computer Science 2019-05-16 Borislav Mavrin , Shangtong Zhang , Hengshuai Yao , Linglong Kong , Kaiwen Wu , Yaoliang Yu

Recent advances in large reasoning models have leveraged reinforcement learning with verifiable rewards (RLVR) to improve reasoning capabilities. However, scaling these methods typically requires extensive rollout computation and large…

Machine Learning · Computer Science 2025-09-03 Xinyu Tang , Zhenduo Zhang , Yurou Liu , Wayne Xin Zhao , Zujie Wen , Zhiqiang Zhang , Jun Zhou

Vision-Language-Action (VLA) models have shown strong potential for general-purpose robotic manipulation, but their reliance on expert demonstrations limits their ability to learn from failures and perform self-corrections. Reinforcement…

Robotics · Computer Science 2025-11-13 Fangqi Zhu , Zhengyang Yan , Zicong Hong , Quanxin Shou , Xiao Ma , Song Guo

In offline reinforcement learning, the challenge of out-of-distribution (OOD) is pronounced. To address this, existing methods often constrain the learned policy through policy regularization. However, these methods often suffer from the…

Machine Learning · Computer Science 2024-07-16 Tenglong Liu , Yang Li , Yixing Lan , Hao Gao , Wei Pan , Xin Xu

Recently, AlphaZero has achieved landmark results in deep reinforcement learning, by providing a single self-play architecture that learned three different games at super human level. AlphaZero is a large and complicated system with many…

Artificial Intelligence · Computer Science 2021-01-11 Hui Wang , Mike Preuss , Aske Plaat

Deep reinforcement learning (DRL) is applied in safety-critical domains such as robotics and autonomous driving. It achieves superhuman abilities in many tasks, however whether DRL agents can be shown to act safely is an open problem. Atari…

Artificial Intelligence · Computer Science 2021-01-25 Mirco Giacobbe , Mohammadhosein Hasanbeig , Daniel Kroening , Hjalmar Wijk

Deep Q-Network (DQN) marked a major milestone for reinforcement learning, demonstrating for the first time that human-level control policies could be learned directly from raw visual inputs via reward maximization. Even years after its…

Machine Learning · Computer Science 2021-11-03 Brett Daley , Christopher Amato

Inspired by recent developments in attention models for image classification and natural language processing, we present various Attention based architectures in reinforcement learning (RL) domain, capable of performing well on OpenAI Gym…

Machine Learning · Computer Science 2023-10-06 Victor Vadakechirayath George

Reinforcement learning (RL) approaches for Large Language Models (LLMs) frequently use on-policy algorithms, such as PPO or GRPO. However, policy lag from distributed training architectures and differences between the training and inference…

Machine Learning · Computer Science 2026-03-03 Daniel Ritter , Owen Oertell , Bradley Guo , Jonathan Chang , Kianté Brantley , Wen Sun

This paper addresses the problem of policy selection in domains with abundant logged data, but with a restricted interaction budget. Solving this problem would enable safe evaluation and deployment of offline reinforcement learning policies…

Artificial agents' adaptability to novelty and alignment with intended behavior is crucial for their effective deployment. Reinforcement learning (RL) leverages novelty as a means of exploration, yet agents often struggle to handle novel…

Artificial Intelligence · Computer Science 2024-06-07 Quentin Delfosse , Jannis Blüml , Bjarne Gregori , Kristian Kersting

Deep reinforcement learning agents are notoriously sample inefficient, which considerably limits their application to real-world problems. Recently, many model-based methods have been designed to address this issue, with learning in the…

Machine Learning · Computer Science 2023-03-02 Vincent Micheli , Eloi Alonso , François Fleuret