中文
相关论文

相关论文: Self-Imitation Learning for Robot Tasks with Spars…

200 篇论文

Reinforcement learning (RL) can align language models with non-differentiable reward signals, such as human preferences. However, a major challenge arises from the sparsity of these reward signals - typically, there is only a single reward…

计算与语言 · 计算机科学 2024-02-20 Meng Cao , Lei Shu , Lei Yu , Yun Zhu , Nevan Wichers , Yinxiao Liu , Lei Meng

Typical reinforcement learning (RL) methods show limited applicability for real-world industrial control problems because industrial systems involve various constraints and simultaneously require continuous and discrete control. To overcome…

人工智能 · 计算机科学 2021-05-20 Hyungjun Park , Daiki Min , Jong-hyun Ryu , Dong Gu Choi

In robotic systems, the performance of reinforcement learning depends on the rationality of predefined reward functions. However, manually designed reward functions often lead to policy failures due to inaccuracies. Inverse Reinforcement…

机器人学 · 计算机科学 2025-09-12 Yongkai Tian , Yirong Qi , Xin Yu , Wenjun Wu , Jie Luo

This paper presents a novel method for learning reward functions for robotic motions by harnessing the power of a CLIP-based model. Traditional reward function design often hinges on manual feature engineering, which can struggle to…

机器人学 · 计算机科学 2025-01-30 Xuzhe Dang , Stefan Edelkamp

Common approaches to Reinforcement Learning (RL) are seriously challenged by large-scale applications involving huge state spaces and sparse delayed reward feedback. Hierarchical Reinforcement Learning (HRL) methods attempt to address this…

人工智能 · 计算机科学 2019-04-15 Jacob Rafati , David C. Noelle

Reward function design and exploration time are arguably the biggest obstacles to the deployment of reinforcement learning (RL) agents in the real world. In many real-world tasks, designing a reward function takes considerable hand…

计算机视觉与模式识别 · 计算机科学 2017-06-14 Pierre Sermanet , Kelvin Xu , Sergey Levine

Explicit engineering of reward functions for given environments has been a major hindrance to reinforcement learning methods. While Inverse Reinforcement Learning (IRL) is a solution to recover reward functions from demonstrations only,…

机器学习 · 计算机科学 2020-02-24 David Venuto , Jhelum Chakravorty , Leonard Boussioux , Junhao Wang , Gavin McCracken , Doina Precup

Continuously learning new tasks using high-level ideas or knowledge is a key capability of humans. In this paper, we propose Lifelong reinforcement learning with Sequential linear temporal logic formulas and Reward Machines (LSRM), which…

人工智能 · 计算机科学 2021-11-19 Xuejing Zheng , Chao Yu , Chen Chen , Jianye Hao , Hankz Hankui Zhuo

Reinforcement learning (RL) has shown to be a valuable tool in training neural networks for autonomous motion planning. The application of RL to a specific problem is dependent on a reward signal to quantify how good or bad a certain action…

机器人学 · 计算机科学 2024-10-28 Benjamin Evans , Herman A. Engelbrecht , Hendrik W. Jordaan

A significant challenge for the practical application of reinforcement learning in the real world is the need to specify an oracle reward function that correctly defines a task. Inverse reinforcement learning (IRL) seeks to avoid this…

机器学习 · 计算机科学 2019-10-16 Kelvin Xu , Ellis Ratner , Anca Dragan , Sergey Levine , Chelsea Finn

Reinforcement learning (RL), particularly in sparse reward settings, often requires prohibitively large numbers of interactions with the environment, thereby limiting its applicability to complex problems. To address this, several prior…

机器学习 · 计算机科学 2020-11-20 Prasoon Goyal , Scott Niekum , Raymond J. Mooney

Modern approaches to autonomous driving rely heavily on learned components trained with large amounts of human driving data via imitation learning. However, these methods require large amounts of expensive data collection and even then face…

It has been a recent trend to leverage the power of supervised learning (SL) towards more effective reinforcement learning (RL) methods. We propose a novel phasic approach by alternating online RL and offline SL for tackling sparse-reward…

机器学习 · 计算机科学 2022-06-27 Yunfei Li , Tian Gao , Jiaqi Yang , Huazhe Xu , Yi Wu

Despite the considerable potential of reinforcement learning (RL), robotic control tasks predominantly rely on imitation learning (IL) due to its better sample efficiency. However, it is costly to collect comprehensive expert demonstrations…

机器学习 · 计算机科学 2024-05-22 Hengyuan Hu , Suvir Mirchandani , Dorsa Sadigh

Reinforcement learning (RL) depends critically on the choice of reward functions used to capture the de- sired behavior and constraints of a robot. Usually, these are handcrafted by a expert designer and represent heuristics for relatively…

人工智能 · 计算机科学 2017-03-03 Xiao Li , Cristian-Ioan Vasile , Calin Belta

Reinforcement learning (RL) methods work in discrete time. In order to apply RL to inherently continuous problems like robotic control, a specific time discretization needs to be defined. This is a choice between sparse time control, which…

人工智能 · 计算机科学 2023-08-09 Jakub Łyskawa , Paweł Wawrzyński

Appropriate credit assignment for delay rewards is a fundamental challenge for reinforcement learning. To tackle this problem, we introduce a delay reward calibration paradigm inspired from a classification perspective. We hypothesize that…

机器学习 · 计算机科学 2021-08-26 Yixuan Liu , Hu Wang , Xiaowei Wang , Xiaoyue Sun , Liuyue Jiang , Minhui Xue

Observing a human demonstrator manipulate objects provides a rich, scalable and inexpensive source of data for learning robotic policies. However, transferring skills from human videos to a robotic manipulator poses several challenges, not…

机器人学 · 计算机科学 2023-03-08 Minttu Alakuijala , Gabriel Dulac-Arnold , Julien Mairal , Jean Ponce , Cordelia Schmid

We propose a distributional framework for offline Inverse Reinforcement Learning (IRL) that jointly models uncertainty over reward functions and full distributions of returns. Unlike conventional IRL approaches that recover a deterministic…

机器学习 · 计算机科学 2026-05-29 Feiyang Wu , Ye Zhao , Anqi Wu

In safety-critical domains, reinforcement learning (RL) agents must often satisfy strict, zero-cost safety constraints while accomplishing tasks. Existing model-free methods frequently either fail to achieve near-zero safety violations or…

机器学习 · 计算机科学 2026-05-11 Dominik Wagner , Ankit Kanwar , Luke Ong