中文
相关论文

相关论文: Imitation Learning from Observation through Optima…

200 篇论文

Imitation learning (IL) from a state-based reinforcement learning (RL) policy is a common approach to overcome the curse of dimensionality in complex and high-dimensional observation spaces prevalent in robotics. This paper addresses the…

机器学习 · 计算机科学 2026-05-28 Meraj Mammadov , Pedro Zuidberg Dos Martires , Johannes Andreas Stork

Many imitation learning (IL) algorithms use inverse reinforcement learning (IRL) to infer a reward function that aligns with the demonstration. However, the inferred reward functions often fail to capture the underlying task objectives. In…

机器学习 · 计算机科学 2024-11-01 Weichao Zhou , Wenchao Li

Imitation learning (IL) enables robots to acquire skills quickly by transferring expert knowledge, which is widely adopted in reinforcement learning (RL) to initialize exploration. However, in long-horizon motion planning tasks, a…

机器人学 · 计算机科学 2021-03-30 Sha Luo , Hamidreza Kasaei , Lambert Schomaker

Inverse reinforcement learning (IRL) seeks to learn the reward function from expert trajectories, to understand the task for imitation or collaboration thereby removing the need for manual reward engineering. However, IRL in the context of…

机器学习 · 计算机科学 2023-11-13 Yikang Gui , Prashant Doshi

Imitation Learning (IL) techniques aim to replicate human behaviors in specific tasks. While IL has gained prominence due to its effectiveness and efficiency, traditional methods often focus on datasets collected from experts to produce a…

机器学习 · 计算机科学 2025-04-28 Mathieu Petitbois , Rémy Portelas , Sylvain Lamprier , Ludovic Denoyer

Inverse Reinforcement Learning (IRL) and Reinforcement Learning from Human Feedback (RLHF) are pivotal methodologies in reward learning, which involve inferring and shaping the underlying reward function of sequential decision-making…

机器学习 · 计算机科学 2024-10-16 Kihyun Kim , Jiawei Zhang , Asuman Ozdaglar , Pablo A. Parrilo

We consider the problem of imitation learning from a finite set of expert trajectories, without access to reinforcement signals. The classical approach of extracting the expert's reward function via inverse reinforcement learning, followed…

机器学习 · 计算机科学 2019-06-10 Ruohan Wang , Carlo Ciliberto , Pierluigi Amadori , Yiannis Demiris

Learning from human video demonstrations offers a scalable alternative to teleoperation or kinesthetic teaching, but poses challenges for robot manipulators due to embodiment differences and joint feasibility constraints. We address this…

机器人学 · 计算机科学 2025-09-26 Xiaoxiang Dong , Matthew Johnson-Roberson , Weiming Zhi

In offline Imitation Learning (IL), one of the main challenges is the \textit{covariate shift} between the expert observations and the actual distribution encountered by the agent, because it is difficult to determine what action an agent…

机器学习 · 计算机科学 2024-06-19 Jie-Jing Shao , Hao-Sen Shi , Lan-Zhe Guo , Yu-Feng Li

Acquiring complex behaviors is essential for artificially intelligent agents, yet learning these behaviors in high-dimensional settings poses a significant challenge due to the vast search space. Traditional reinforcement learning (RL)…

机器学习 · 计算机科学 2025-04-22 Mert Albaba , Sammy Christen , Thomas Langarek , Christoph Gebhardt , Otmar Hilliges , Michael J. Black

Imitation learning (IL) aims to mimic the behavior of an expert in a sequential decision making task by learning from demonstrations, and has been widely applied to robotics, autonomous driving, and autoregressive text generation. The…

机器学习 · 计算机科学 2024-12-03 Dylan J. Foster , Adam Block , Dipendra Misra

Imitation learning (IL) is notably effective for robotic tasks where directly programming behaviors or defining optimal control costs is challenging. In this work, we address a scenario where the imitator relies solely on observed behavior…

机器学习 · 计算机科学 2024-08-20 Rishabh Agrawal , Nathan Dahlin , Rahul Jain , Ashutosh Nayyar

Often times in imitation learning (IL), the environment we collect expert demonstrations in and the environment we want to deploy our learned policy in aren't exactly the same (e.g. demonstrations collected in simulation but deployment in…

神经与进化计算 · 计算机科学 2024-06-19 Silvia Sapora , Gokul Swamy , Chris Lu , Yee Whye Teh , Jakob Nicolaus Foerster

Imitation learning often assumes that demonstrations are close to optimal according to some fixed, but unknown, cost function. However, according to satisficing theory, humans often choose acceptable behavior based on their personal (and…

Model-free deep reinforcement learning (RL) has demonstrated its superiority on many complex sequential decision-making problems. However, heavy dependence on dense rewards and high sample-complexity impedes the wide adoption of these…

机器学习 · 计算机科学 2020-04-02 Zhuangdi Zhu , Kaixiang Lin , Bo Dai , Jiayu Zhou

This paper focuses on inverse reinforcement learning (IRL) to enable safe and efficient autonomous navigation in unknown partially observable environments. The objective is to infer a cost function that explains expert-demonstrated…

机器学习 · 计算机科学 2020-02-27 Tianyu Wang , Vikas Dhiman , Nikolay Atanasov

Offline imitation learning (offline IL) enables training effective policies without requiring explicit reward annotations. Recent approaches attempt to estimate rewards for unlabeled datasets using a small set of expert demonstrations.…

机器学习 · 计算机科学 2025-11-19 Shengjie Sun , Jiafei Lyu , Runze Liu , Mengbei Yan , Bo Liu , Deheng Ye , Xiu Li

With the advent of large datasets, offline reinforcement learning (RL) is a promising framework for learning good decision-making policies without the need to interact with the real environment. However, offline RL requires the dataset to…

机器学习 · 计算机科学 2023-03-27 Yicheng Luo , Zhengyao Jiang , Samuel Cohen , Edward Grefenstette , Marc Peter Deisenroth

Imitation Learning (IL) has proven highly effective for robotic and control tasks where manually designing reward functions or explicit controllers is infeasible. However, standard IL methods implicitly assume that the environment dynamics…

机器学习 · 计算机科学 2025-11-12 Rishabh Agrawal , Yusuf Alvi , Rahul Jain , Ashutosh Nayyar

We develop a simple framework to learn bio-inspired foraging policies using human data. We conduct an experiment where humans are virtually immersed in an open field foraging environment and are trained to collect the highest amount of…