中文
相关论文

相关论文: Offline Learning of Controllable Diverse Behaviors

200 篇论文

We study the problem of offline Imitation Learning (IL) where an agent aims to learn an optimal expert behavior policy without additional online environment interactions. Instead, the agent is provided with a supplementary offline dataset…

机器学习 · 计算机科学 2022-07-21 Haoran Xu , Xianyuan Zhan , Honglei Yin , Huiling Qin

Teaching robots to autonomously complete everyday tasks remains a challenge. Imitation Learning (IL) is a powerful approach that imbues robots with skills via demonstrations, but is limited by the labor-intensive process of collecting…

机器人学 · 计算机科学 2025-10-14 Juntao Ren , Priya Sundaresan , Dorsa Sadigh , Sanjiban Choudhury , Jeannette Bohg

Model-free learning-based control methods have recently shown significant advantages over traditional control methods in avoiding complex vehicle characteristic estimation and parameter tuning. As a primary policy learning method, imitation…

机器人学 · 计算机科学 2024-04-29 C. Gong , C. Lu , Z. Li , Z. Liu , J. Gong , X. Chen

Imitation learning with human data has demonstrated remarkable success in teaching robots in a wide range of skills. However, the inherent diversity in human behavior leads to the emergence of multi-modal data distributions, thereby…

机器人学 · 计算机科学 2024-02-23 Xiaogang Jia , Denis Blessing , Xinkai Jiang , Moritz Reuss , Atalay Donat , Rudolf Lioutikov , Gerhard Neumann

We focus on offline imitation learning (IL), which aims to mimic an expert's behavior using demonstrations without any interaction with the environment. One of the main challenges in offline IL is the limited support of expert…

机器学习 · 计算机科学 2024-10-14 Huy Hoang , Tien Mai , Pradeep Varakantham

Offline imitation learning (IL) promises the ability to learn performant policies from pre-collected demonstrations without interactions with the environment. However, imitating behaviors fully offline typically requires numerous expert…

机器学习 · 计算机科学 2023-03-07 Lantao Yu , Tianhe Yu , Jiaming Song , Willie Neiswanger , Stefano Ermon

Existing imitation learning (IL) methods such as inverse reinforcement learning (IRL) usually have a double-loop training process, alternating between learning a reward function and a policy and tend to suffer long training time and high…

机器学习 · 计算机科学 2022-06-13 Siwei Chen , Xiao Ma , Zhongwen Xu

Imitation learning aims to extract knowledge from human experts' demonstrations or artificially created agents in order to replicate their behaviors. Its success has been demonstrated in areas such as video games, autonomous driving,…

机器学习 · 计算机科学 2022-10-24 Boyuan Zheng , Sunny Verma , Jianlong Zhou , Ivor Tsang , Fang Chen

Imitation learning (IL) consists of a set of tools that leverage expert demonstrations to quickly learn policies. However, if the expert is suboptimal, IL can yield policies with inferior performance compared to reinforcement learning (RL).…

机器学习 · 计算机科学 2018-05-29 Ching-An Cheng , Xinyan Yan , Nolan Wagener , Byron Boots

In this paper, we study offline-to-online Imitation Learning (IL) that pretrains an imitation policy from static demonstration data, followed by fast finetuning with minimal environmental interaction. We find the na\"ive combination of…

机器学习 · 计算机科学 2024-05-31 Sheng Yue , Xingyuan Hua , Ju Ren , Sen Lin , Junshan Zhang , Yaoxue Zhang

Imitation learning (IL) is a framework that learns to imitate expert behavior from demonstrations. Recently, IL shows promising results on high dimensional and control tasks. However, IL typically suffers from sample inefficiency in terms…

机器学习 · 计算机科学 2021-11-24 Lihua Zhang

Online imitation learning (IL) is an algorithmic framework that leverages interactions with expert policies for efficient policy optimization. Here policies are optimized by performing online learning on a sequence of loss functions that…

机器学习 · 计算机科学 2021-02-23 Xinyan Yan , Byron Boots , Ching-An Cheng

Imitation learning (IL) provides a data-driven framework for approximating policies for large-scale combinatorial optimisation problems formulated as sequential decision problems (SDPs), where exact solution methods are computationally…

机器学习 · 计算机科学 2026-04-13 Prakash Gawas , Antoine Legrain , Louis-Martin Rousseau

Limited data has become a major bottleneck in scaling up offline imitation learning (IL). In this paper, we propose enhancing IL performance under limited expert data by introducing a pre-training stage that learns dynamics representations,…

机器人学 · 计算机科学 2025-08-21 Haitong Ma , Bo Dai , Zhaolin Ren , Yebin Wang , Na Li

Imitation Learning (IL) is an important paradigm within the broader reinforcement learning (RL) methodology. Unlike most of RL, it does not assume availability of reward-feedback. Reward inference and shaping are known to be difficult and…

机器学习 · 计算机科学 2023-08-25 Rishabh Agrawal , Nathan Dahlin , Rahul Jain , Ashutosh Nayyar

In sequential decision-making environments, the primary approaches for training agents are Reinforcement Learning (RL) and Imitation Learning (IL). Unlike RL, which relies on modeling a reward function, IL leverages expert demonstrations,…

人工智能 · 计算机科学 2024-12-11 Jonas Nüßlein , Maximilian Zorn , Philipp Altmann , Claudia Linnhoff-Popien

Imitation learning (IL) enables autonomous behavior by learning from expert demonstrations. While more sample-efficient than comparative alternatives like reinforcement learning, IL is sensitive to compounding errors induced by distribution…

系统与控制 · 电气工程与系统科学 2025-12-22 Aditya Gahlawat , Ahmed Aboudonia , Sandeep Banik , Naira Hovakimyan , Nikolai Matni , Aaron D. Ames , Gioele Zardini , Alberto Speranzon

Recently, motion generation by machine learning has been actively researched to automate various tasks. Imitation learning is one such method that learns motions from data collected in advance. However, executing long-term tasks remains…

机器人学 · 计算机科学 2022-03-17 Kazuki Hayashi , Sho Sakaino , Toshiaki Tsuji

Offline imitation learning (IL) refers to learning expert behavior solely from demonstrations, without any additional interaction with the environment. Despite significant advances in offline IL, existing techniques find it challenging to…

机器学习 · 计算机科学 2023-12-19 Abhinav Jain , Vaibhav Unhelkar

Imitation learning is an effective approach for autonomous systems to acquire control policies when an explicit reward function is unavailable, using supervision provided as demonstrations from an expert, typically a human operator.…

机器学习 · 计算机科学 2018-06-20 YuXuan Liu , Abhishek Gupta , Pieter Abbeel , Sergey Levine