中文
相关论文

相关论文: Exploration via Hindsight Goal Generation

200 篇论文

This paper focuses on robotic reinforcement learning with sparse rewards for natural language goal representations. An open problem is the sample-inefficiency that stems from the compositionality of natural language, and from the grounding…

机器学习 · 计算机科学 2022-09-12 Frank Röder , Manfred Eppe , Stefan Wermter

Goal-conditioned hierarchical reinforcement learning (HRL) has shown promising results for solving complex and long-horizon RL tasks. However, the action space of high-level policy in the goal-conditioned HRL is often large, so it results…

机器学习 · 计算机科学 2021-12-07 Junsu Kim , Younggyo Seo , Jinwoo Shin

Learning a policy capable of moving an agent between any two states in the environment is important for many robotics problems involving navigation and manipulation. Due to the sparsity of rewards in such tasks, applying reinforcement…

人工智能 · 计算机科学 2018-07-05 Artem Molchanov , Karol Hausman , Stan Birchfield , Gaurav Sukhatme

Hierarchical Reinforcement Learning (HRL) exploits temporally extended actions, or options, to make decisions from a higher-dimensional perspective to alleviate the sparse reward problem, one of the most challenging problems in…

机器学习 · 计算机科学 2019-05-15 Libo Xing

This paper presents CONTHER, a novel reinforcement learning algorithm designed to efficiently and rapidly train robotic agents for goal-oriented manipulation tasks and obstacle avoidance. The algorithm uses a modified replay buffer inspired…

机器人学 · 计算机科学 2025-03-21 Maria Makarova , Qian Liu , Dzmitry Tsetserukou

Reinforcement learning (RL) enables agents to take decision based on a reward function. However, in the process of learning, the choice of values for learning algorithm parameters can significantly impact the overall learning process. In…

神经与进化计算 · 计算机科学 2019-05-13 Adarsh Sehgal , Hung Manh La , Sushil J. Louis , Hai Nguyen

Reinforcement learning has shown great potential in solving complex tasks when large amounts of data can be generated with little effort. In robotics, one approach to generate training data builds on simulations based on dynamics models…

机器人学 · 计算机科学 2023-03-10 Simon Guist , Jan Schneider , Alexander Dittrich , Vincent Berenz , Bernhard Schölkopf , Dieter Büchler

Agents can base decisions made using reinforcement learning (RL) on a reward function. The selection of values for the learning algorithm parameters can, nevertheless, have a substantial impact on the overall learning process. In order to…

机器人学 · 计算机科学 2022-11-21 Adarsh Sehgal , Nicholas Ward , Hung Manh La , Christos Papachristos , Sushil Louis

Reinforcement Learning(RL) with sparse rewards is a major challenge. We propose \emph{Hindsight Trust Region Policy Optimization}(HTRPO), a new RL algorithm that extends the highly successful TRPO algorithm with \emph{hindsight} to tackle…

机器学习 · 计算机科学 2021-05-18 Hanbo Zhang , Site Bai , Xuguang Lan , David Hsu , Nanning Zheng

Reinforcement learning (RL) often struggles to accomplish a sparse-reward long-horizon task in a complex environment. Goal-conditioned reinforcement learning (GCRL) has been employed to tackle this difficult problem via a curriculum of…

机器学习 · 计算机科学 2023-12-20 Lisheng Wu , Ke Chen

Sparse rewards pose a significant challenge to achieving high sample efficiency in goal-conditioned reinforcement learning (RL). Specifically, in sequential manipulation tasks, the agent receives failure rewards until it successfully…

机器人学 · 计算机科学 2024-06-24 Yuming Huang , Bin Ren , Ziming Xu , Lianghong Wu

Efficient learning in the environment with sparse rewards is one of the most important challenges in Deep Reinforcement Learning (DRL). In continuous DRL environments such as robotic arms control, Hindsight Experience Replay (HER) has been…

人工智能 · 计算机科学 2020-02-07 Qiwei He , Liansheng Zhuang , Houqiang Li

Exploration in environments with sparse feedback remains a challenging research problem in reinforcement learning (RL). When the RL agent explores the environment randomly, it results in low exploration efficiency, especially in robotic…

机器人学 · 计算机科学 2020-11-19 Boyao Li , Tao Lu , Jiayi Li , Ning Lu , Yinghao Cai , Shuo Wang

Open-ended learning benefits immensely from the use of symbolic methods for goal representation as they offer ways to structure knowledge for efficient and transferable learning. However, the existing Hierarchical Reinforcement Learning…

机器学习 · 计算机科学 2023-09-15 Mehdi Zadem , Sergio Mover , Sao Mai Nguyen

In Multi-Goal Reinforcement Learning, an agent learns to achieve multiple goals with a goal-conditioned policy. During learning, the agent first collects the trajectories into a replay buffer, and later these trajectories are selected…

机器学习 · 计算机科学 2020-05-26 Rui Zhao , Xudong Sun , Volker Tresp

Hierarchical reinforcement learning has been a compelling approach for achieving goal directed behavior over long sequences of actions. However, it has been challenging to implement in realistic or open-ended environments. A main challenge…

机器学习 · 计算机科学 2023-09-22 Arun Ahuja , Kavya Kopparapu , Rob Fergus , Ishita Dasgupta

Long-horizon precision manipulation in laboratory automation, such as pipette tip attachment and liquid transfer, requires policies that respect strict procedural logic while operating in continuous, high-dimensional state spaces. However,…

机器人学 · 计算机科学 2026-03-03 Yibo Qiu , Shu'ang Sun , Haoliang Ye , Ronald X Xu , Mingzhai Sun

Current reinforcement learning (RL) often suffers when solving a challenging exploration problem where the desired outcomes or high rewards are rarely observed. Even though curriculum RL, a framework that solves complex tasks by proposing a…

机器学习 · 计算机科学 2023-02-21 Daesol Cho , Seungjae Lee , H. Jin Kim

In goal-conditioned hierarchical reinforcement learning (HRL), a high-level policy specifies a subgoal for the low-level policy to reach. Effective HRL hinges on a suitable subgoal represen tation function, abstracting state space into…

Hierarchical reinforcement learning (HRL) learns to make decisions on multiple levels of temporal abstraction. A key challenge in HRL is that the low-level policy changes over time, making it difficult for the high-level policy to generate…

机器学习 · 计算机科学 2025-05-29 Vivienne Huiling Wang , Tinghuai Wang , Joni Pajarinen