English
Related papers

Related papers: Guided Policy Search with Delayed Sensor Measureme…

200 papers

In many real-world settings, agents must learn from an offline dataset gathered by some prior behavior policy. Such a setting naturally leads to distribution shift between the behavior policy and the target policy being trained - requiring…

Machine Learning · Computer Science 2024-04-10 Matthew Thomas Jackson , Michael Tryfan Matthews , Cong Lu , Benjamin Ellis , Shimon Whiteson , Jakob Foerster

Traditional robotic approaches rely on an accurate model of the environment, a detailed description of how to perform the task, and a robust perception system to keep track of the current state. On the other hand, reinforcement learning…

Adapting an agent's behaviour to new environments has been one of the primary focus areas of physics based reinforcement learning. Although recent approaches such as universal policy networks partially address this issue by enabling the…

Machine Learning · Computer Science 2022-02-15 Buddhika Laknath Semage , Thommen George Karimpanal , Santu Rana , Svetha Venkatesh

Reinforcement learning is a framework for interactive decision-making with incentives sequentially revealed across time without a system dynamics model. Due to its scaling to continuous spaces, we focus on policy search where one…

Machine Learning · Computer Science 2023-01-04 Amrit Singh Bedi , Anjaly Parayil , Junyu Zhang , Mengdi Wang , Alec Koppel

Reinforcement Learning Algorithms are predominantly developed for stationary environments, and the limited literature that considers nonstationary environments often involves specific assumptions about changes that can occur in transition…

Machine Learning · Computer Science 2025-09-25 Ranga Shaarad Ayyagari , Revanth Raj Eega , Ambedkar Dukkipati

A longstanding objective in classical planning is to synthesize policies that generalize across multiple problems from the same domain. In this work, we study generalized policy search-based methods with a focus on the score function used…

Artificial Intelligence · Computer Science 2022-04-25 Ryan Yang , Tom Silver , Aidan Curtis , Tomas Lozano-Perez , Leslie Pack Kaelbling

Sampling-based motion planners have experienced much success due to their ability to efficiently and evenly explore the state space. However, for many tasks, it may be more efficient to not uniformly explore the state space, especially when…

Robotics · Computer Science 2018-06-07 Clark Zhang , Jinwook Huh , Daniel D. Lee

Contextual policy search allows adapting robotic movement primitives to different situations. For instance, a locomotion primitive might be adapted to different terrain inclinations or desired walking speeds. Such an adaptation is often…

Machine Learning · Statistics 2015-11-17 Jan Hendrik Metzen

Policy gradient is a generic and flexible reinforcement learning approach that generally enjoys simplicity in analysis, implementation, and deployment. In the last few decades, this approach has been extensively advanced for fully…

Machine Learning · Computer Science 2020-05-26 Kamyar Azizzadenesheli , Yisong Yue , Animashree Anandkumar

Reinforcement learning and Imitation Learning approaches utilize policy learning strategies that are difficult to generalize well with just a few examples of a task. In this work, we propose a language-conditioned semantic search-based…

Robotics · Computer Science 2023-12-12 Jannik Sheikh , Andrew Melnik , Gora Chand Nandi , Robert Haschke

Most policy search algorithms require thousands of training episodes to find an effective policy, which is often infeasible with a physical robot. This survey article focuses on the extreme other end of the spectrum: how can a robot adapt…

The goal of this paper is to analyze distributional Markov Decision Processes as a class of control problems in which the objective is to learn policies that steer the distribution of a cumulative reward toward a prescribed target law,…

Optimization and Control · Mathematics 2026-02-09 Nicole Bäuerle , Athanasios Vasileiadis

A policy in deep reinforcement learning (RL), either deterministic or stochastic, is commonly parameterized as a Gaussian distribution alone, limiting the learned behavior to be unimodal. However, the nature of many practical…

Machine Learning · Computer Science 2025-08-20 SM Mazharul Islam , Manfred Huber

Policy learning for partially observed control tasks requires policies that can remember salient information from past observations. In this paper, we present a method for learning policies with internal memory for high-dimensional,…

Machine Learning · Computer Science 2015-09-24 Marvin Zhang , Zoe McCarthy , Chelsea Finn , Sergey Levine , Pieter Abbeel

A diagnostic policy specifies what test to perform next, based on the results of previous tests, and when to stop and make a diagnosis. Cost-sensitive diagnostic policies perform tradeoffs between (a) the cost of tests and (b) the cost of…

Artificial Intelligence · Computer Science 2012-07-19 Valentina Bayer-Zubek

PID control architectures are widely used in industrial applications. Despite their low number of open parameters, tuning multiple, coupled PID controllers can become tedious in practice. In this paper, we extend PILCO, a model-based policy…

Machine Learning · Computer Science 2017-03-09 Andreas Doerr , Duy Nguyen-Tuong , Alonso Marco , Stefan Schaal , Sebastian Trimpe

The environments of such large industrial machines as waste cranes in waste incineration plants are often weakly observable, where little information about the environmental state is contained in the observations due to technical difficulty…

Robotics · Computer Science 2022-05-10 Hikaru Sasaki , Terushi Hirabayashi , Kaoru Kawabata , Takamitsu Matsubara

We consider the task of evaluating a policy for a Markov decision process (MDP). The standard unbiased technique for evaluating a policy is to deploy the policy and observe its performance. We show that the data collected from deploying a…

Artificial Intelligence · Computer Science 2017-06-13 Josiah P. Hanna , Philip S. Thomas , Peter Stone , Scott Niekum

Traditional controllers have limitations as they rely on prior knowledge about the physics of the problem, require modeling of dynamics, and struggle to adapt to abnormal situations. Deep reinforcement learning has the potential to address…

Machine Learning · Computer Science 2023-10-24 Ammar N. Abbas , Georgios C. Chasparis , John D. Kelleher

Controllers trained with Reinforcement Learning tend to be very specialized and thus generalize poorly when their testing environment differs from their training one. We propose a Model-Based approach to increase generalization where both…

Machine Learning · Computer Science 2025-04-15 Valentin Charvet , Sebastian Stein , Roderick Murray-Smith