English
Related papers

Related papers: Diverse Exploration for Fast and Safe Policy Impro…

200 papers

This paper investigates the automatic exploration problem under the unknown environment, which is the key point of applying the robotic system to some social tasks. The solution to this problem via stacking decision rules is impossible to…

Robotics · Computer Science 2020-07-24 Haoran Li , Qichao Zhang , Dongbin Zhao

The exploration-exploitation dilemma has been an intriguing and unsolved problem within the framework of reinforcement learning. "Optimism in the face of uncertainty" and model building play central roles in advanced exploration methods.…

Artificial Intelligence · Computer Science 2008-10-21 István Szita , András Lőrincz

Transfer learning significantly accelerates the reinforcement learning process by exploiting relevant knowledge from previous experiences. The problem of optimally selecting source policies during the learning process is of great importance…

Artificial Intelligence · Computer Science 2017-09-26 Siyuan Li , Chongjie Zhang

Reinforcement learning algorithms typically necessitate extensive exploration of the state space to find optimal policies. However, in safety-critical applications, the risks associated with such exploration can lead to catastrophic…

Machine Learning · Computer Science 2025-02-28 Kaustubh Mani , Vincent Mai , Charlie Gauthier , Annie Chen , Samer Nashed , Liam Paull

Exploration is a crucial and distinctive aspect of reinforcement learning (RL) that remains a fundamental open problem. Several methods have been proposed to tackle this challenge. Commonly used methods inject random noise directly into the…

Machine Learning · Computer Science 2024-11-06 Sebastian Griesbach , Carlo D'Eramo

In reinforcement learning, temporal abstraction in the action space, exemplified by action repetition, is a technique to facilitate policy learning through extended actions. However, a primary limitation in previous studies of action…

Machine Learning · Computer Science 2024-02-09 Joongkyu Lee , Seung Joon Park , Yunhao Tang , Min-hwan Oh

Policy search reinforcement learning allows robots to acquire skills by themselves. However, the learning procedure is inherently unsafe as the robot has no a-priori way to predict the consequences of the exploratory actions it takes.…

Robotics · Computer Science 2018-10-09 Jens Lundell , Robert Krug , Erik Schaffernicht , Todor Stoyanov , Ville Kyrki

Deep Reinforcement Learning (DRL) and Deep Multi-agent Reinforcement Learning (MARL) have achieved significant successes across a wide range of domains, including game AI, autonomous vehicles, robotics, and so on. However, DRL and deep MARL…

Artificial Intelligence · Computer Science 2023-02-03 Jianye Hao , Tianpei Yang , Hongyao Tang , Chenjia Bai , Jinyi Liu , Zhaopeng Meng , Peng Liu , Zhen Wang

A key challenge in reinforcement learning (RL) is environment generalization: a policy trained to solve a task in one environment often fails to solve the same task in a slightly different test environment. A common approach to improve…

Robotics · Computer Science 2019-07-30 Wenxuan Zhou , Lerrel Pinto , Abhinav Gupta

Differential Evolution (DE) is a renowned optimization stratagem that can easily solve nonlinear and comprehensive problems. DE is a well known and uncomplicated population based probabilistic approach for comprehensive optimization. It has…

Neural and Evolutionary Computing · Computer Science 2015-06-22 Sandeep Kumar , Vivek Kumar Sharma , Rajani Kumari

In reinforcement learning, classic on-policy evaluation methods often suffer from high variance and require massive online data to attain the desired accuracy. Previous studies attempt to reduce evaluation variance by searching for or…

Machine Learning · Computer Science 2025-03-21 Claire Chen , Shuze Daniel Liu , Shangtong Zhang

In order for reinforcement learning techniques to be useful in real-world decision making processes, they must be able to produce robust performance from limited data. Deep policy optimization methods have achieved impressive results on…

Machine Learning · Computer Science 2020-12-22 James Queeney , Ioannis Ch. Paschalidis , Christos G. Cassandras

Learning diverse policies for non-prehensile manipulation is essential for improving skill transfer and generalization to out-of-distribution scenarios. In this work, we enhance exploration through a two-fold approach within a hybrid…

Robotics · Computer Science 2025-04-29 Huy Le , Tai Hoang , Miroslav Gabriel , Gerhard Neumann , Ngo Anh Vien

Evaluating the performance of an ongoing policy plays a vital role in many areas such as medicine and economics, to provide crucial instructions on the early-stop of the online experiment and timely feedback from the environment. Policy…

Machine Learning · Statistics 2024-08-05 Ye Shen , Hengrui Cai , Rui Song

The quest for optimal operation in environments with unknowns and uncertainties is highly desirable but critically challenging across numerous fields. This paper develops a dual control framework for exploration and exploitation (DCEE) to…

Systems and Control · Electrical Eng. & Systems 2024-03-13 Zhongguo Li , Wen-Hua Chen , Jun Yang , Yunda Yan

Proximal Policy Optimization with Adaptive Exploration (axPPO) is introduced as a novel learning algorithm. This paper investigates the exploration-exploitation tradeoff within the context of reinforcement learning and aims to contribute…

Machine Learning · Computer Science 2024-05-09 Andrei Lixandru

One of the remaining challenges in reinforcement learning is to develop agents that can generalise to novel scenarios they might encounter once deployed. This challenge is often framed in a multi-task setting where agents train on a fixed…

Machine Learning · Computer Science 2024-09-19 Max Weltevrede , Felix Kaubek , Matthijs T. J. Spaan , Wendelin Böhmer

Being able to solve a task in diverse ways makes agents more robust to task variations and less prone to local optima. In this context, constrained diversity optimization has become a useful reinforcement learning (RL) framework for…

Machine Learning · Computer Science 2026-05-13 Cornelius V. Braun , Sayantan Auddy , Marc Toussaint

Climate Change is an incredibly complicated problem that humanity faces. When many variables interact with each other, it can be difficult for humans to grasp the causes and effects of the very large-scale problem of climate change. The…

Machine Learning · Computer Science 2022-12-01 Theodore Wolf

A practical approach to robot reinforcement learning is to first collect a large batch of real or simulated robot interaction data, using some data collection policy, and then learn from this data to perform various tasks, using offline…

Robotics · Computer Science 2021-06-02 Shadi Endrawis , Gal Leibovich , Guy Jacob , Gal Novik , Aviv Tamar