English
Related papers

Related papers: Bootstrapped Representations in Reinforcement Lear…

200 papers

Reinforcement Learning (RL) can model complex behavior policies for goal-directed sequential decision making tasks. A hallmark of RL algorithms is Temporal Difference (TD) learning: value function for the current state is moved towards a…

Machine Learning · Computer Science 2017-11-07 Sahil Sharma , Girish Raguvir J , Srivatsan Ramesh , Balaraman Ravindran

Model-based Reinforcement Learning approaches have the promise of being sample efficient. Much of the progress in learning dynamics models in RL has been made by learning models via supervised learning. But traditional model-based…

Machine Learning · Computer Science 2019-06-12 Shagun Sodhani , Anirudh Goyal , Tristan Deleu , Yoshua Bengio , Sergey Levine , Jian Tang

Several self-supervised representation learning methods have been proposed for reinforcement learning (RL) with rich observations. For real-world applications of RL, recovering underlying latent states is crucial, particularly when sensory…

Recent deep reinforcement learning (DRL) successes rely on end-to-end learning from fixed-size observational inputs (e.g. image, state-variables). However, many challenging and interesting problems in decision making involve observations or…

Machine Learning · Computer Science 2022-06-08 Vince Jankovics , Michael Garcia Ortiz , Eduardo Alonso

Reasoning at multiple levels of temporal abstraction is one of the key attributes of intelligence. In reinforcement learning, this is often modeled through temporally extended courses of actions called options. Options allow agents to make…

Machine Learning · Computer Science 2023-04-13 Marlos C. Machado , Andre Barreto , Doina Precup , Michael Bowling

As AI agents generate increasingly sophisticated behaviors, manually encoding human preferences to guide these agents becomes more challenging. To address this, it has been suggested that agents instead learn preferences from human choice…

Machine Learning · Computer Science 2024-12-24 Henrik Marklund , Benjamin Van Roy

Having access to a forward model enables the use of planning algorithms such as Monte Carlo Tree Search and Rolling Horizon Evolution. Where a model is unavailable, a natural aim is to learn a model that reflects accurately the dynamics of…

Machine Learning · Computer Science 2020-04-16 Alvaro Ovalle , Simon M. Lucas

Reinforcement learning with function approximation can be unstable and even divergent, especially when combined with off-policy learning and Bellman updates. In deep reinforcement learning, these issues have been dealt with empirically by…

Machine Learning · Computer Science 2020-10-06 Dibya Ghosh , Marc G. Bellemare

State representation learning aims to capture latent factors of an environment. Contrastive methods have performed better than generative models in previous state representation learning research. Although some researchers realize the…

Machine Learning · Computer Science 2023-03-15 Li Meng , Morten Goodwin , Anis Yazidi , Paal Engelstad

The use of deep reinforcement learning allows for high-dimensional state descriptors, but little is known about how the choice of action representation impacts the learning difficulty and the resulting performance. We compare the impact of…

Machine Learning · Computer Science 2017-10-20 Xue Bin Peng , Michiel van de Panne

When playing video-games we immediately detect which entity we control and we center the attention towards it to focus the learning and reduce its dimensionality. Reinforcement Learning (RL) has been able to deal with big state spaces,…

Machine Learning · Computer Science 2020-01-01 Berkay Demirel , Martí Sánchez-Fibla

Imitation learning (IL) from a state-based reinforcement learning (RL) policy is a common approach to overcome the curse of dimensionality in complex and high-dimensional observation spaces prevalent in robotics. This paper addresses the…

Machine Learning · Computer Science 2026-05-28 Meraj Mammadov , Pedro Zuidberg Dos Martires , Johannes Andreas Stork

Deep Reinforcement Learning (RL) is mainly studied in a setting where the training and the testing environments are similar. But in many practical applications, these environments may differ. For instance, in control systems, the robot(s)…

Machine Learning · Computer Science 2022-10-25 Jean-Baptiste Gaya , Laure Soulier , Ludovic Denoyer

A key challenge in model-based reinforcement learning (RL) is to synthesize computationally efficient and accurate environment models. We show that carefully designed generative models that learn and operate on compact state…

In this paper, we explore deep reinforcement learning algorithms for vision-based robotic grasping. Model-free deep reinforcement learning (RL) has been successfully applied to a range of challenging environments, but the proliferation of…

Robotics · Computer Science 2018-03-30 Deirdre Quillen , Eric Jang , Ofir Nachum , Chelsea Finn , Julian Ibarz , Sergey Levine

With the development of deep representation learning, the domain of reinforcement learning (RL) has become a powerful learning framework now capable of learning complex policies in high dimensional environments. This review summarises deep…

Machine Learning · Computer Science 2021-01-26 B Ravi Kiran , Ibrahim Sobh , Victor Talpaert , Patrick Mannion , Ahmad A. Al Sallab , Senthil Yogamani , Patrick Pérez

Vision-based robotics often separates the control loop into one module for perception and a separate module for control. It is possible to train the whole system end-to-end (e.g. with deep RL), but doing it "from scratch" comes with a high…

Robotics · Computer Science 2020-11-16 Bryan Chen , Alexander Sax , Gene Lewis , Iro Armeni , Silvio Savarese , Amir Zamir , Jitendra Malik , Lerrel Pinto

In reinforcement learning-based (RL-based) traffic signal control (TSC), decisions on the signal timing are made based on the available information on vehicles at a road intersection. This forms the state representation for the RL…

Systems and Control · Electrical Eng. & Systems 2024-11-13 Lawrence Francis , Blessed Guda , Ahmed Biyabani

Reinforcement learning has been successful across several applications in which agents have to learn to act in environments with sparse feedback. However, despite this empirical success there is still a lack of theoretical understanding of…

Machine Learning · Statistics 2023-11-08 Blake Bordelon , Paul Masset , Henry Kuo , Cengiz Pehlevan

We study reinforcement learning (RL) in settings where observations are high-dimensional, but where an RL agent has access to abstract knowledge about the structure of the state space, as is the case, for example, when a robot is tasked to…

Machine Learning · Computer Science 2022-05-31 Yao Liu , Dipendra Misra , Miro Dudík , Robert E. Schapire