中文
相关论文

相关论文: Model-based Offline Imitation Learning with Non-ex…

200 篇论文

Offline reinforcement learning (RL) enables policy optimization from fixed datasets, making it suitable for safety-critical applications where online exploration is infeasible. However, these datasets are often contaminated by adversarial…

机器学习 · 计算机科学 2026-05-19 Shriram Karpoora Sundara Pandian , Ali Baheri

Offline Reinforcement Learning (RL) via Supervised Learning is a simple and effective way to learn robotic skills from a dataset collected by policies of different expertise levels. It is as simple as supervised learning and Behavior…

机器学习 · 统计学 2022-10-25 Alexandre Piche , Rafael Pardinas , David Vazquez , Igor Mordatch , Chris Pal

Imitation learning is a widely used approach for training agents to replicate expert behavior in complex decision-making tasks. However, existing methods often struggle with compounding errors and limited generalization, due to the inherent…

机器学习 · 计算机科学 2025-04-21 Haldun Balim , Yang Hu , Yuyang Zhang , Na Li

We propose an imitation learning system for autonomous driving in urban traffic with interactions. We train a Behavioral Cloning~(BC) policy to imitate driving behavior collected from the real urban traffic, and apply the data aggregation…

机器人学 · 计算机科学 2021-09-06 Zhao-Heng Yin , Chenran Li , Liting Sun , Masayoshi Tomizuka , Wei Zhan

In offline imitation learning (IL), an agent aims to learn an optimal expert behavior policy without additional online environment interactions. However, in many real-world scenarios, such as robotics manipulation, the offline dataset is…

机器学习 · 计算机科学 2024-01-01 Bowei He , Zexu Sun , Jinxin Liu , Shuai Zhang , Xu Chen , Chen Ma

Behavioral cloning (BC) provides a straightforward solution to offline RL by mimicking offline trajectories via supervised learning. Recent advances (Chen et al., 2021; Janner et al., 2021; Emmons et al., 2021) have shown that by…

机器学习 · 计算机科学 2023-02-07 Tung Nguyen , Qinqing Zheng , Aditya Grover

Offline Imitation Learning (IL) with imperfect demonstrations has garnered increasing attention owing to the scarcity of expert data in many real-world domains. A fundamental problem in this scenario is how to extract positive behaviors…

机器学习 · 计算机科学 2024-05-31 Sheng Yue , Jiani Liu , Xingyuan Hua , Ju Ren , Sen Lin , Junshan Zhang , Yaoxue Zhang

We consider offline Imitation Learning from corrupted demonstrations where a constant fraction of data can be noise or even arbitrary outliers. Classical approaches such as Behavior Cloning assumes that demonstrations are collected by an…

机器学习 · 计算机科学 2022-02-01 Liu Liu , Ziyang Tang , Lanqing Li , Dijun Luo

Behavioral cloning is an imitation learning technique that teaches an agent how to behave through expert demonstrations. Recent approaches use self-supervision of fully-observable unlabeled snapshots of the states to decode state-pairs into…

机器学习 · 计算机科学 2020-08-14 Nathan Gavenski , Juarez Monteiro , Roger Granada , Felipe Meneguzzi , Rodrigo C. Barros

Imitation learning is the problem of recovering an expert policy without access to a reward signal. Behavior cloning and GAIL are two widely used methods for performing imitation learning. Behavior cloning converges in a few iterations but…

机器学习 · 计算机科学 2020-11-11 Rohit Jena , Changliu Liu , Katia Sycara

Offline reinforcement learning, by learning from a fixed dataset, makes it possible to learn agent behaviors without interacting with the environment. However, depending on the quality of the offline dataset, such pre-trained agents may…

机器学习 · 计算机科学 2022-10-26 Yi Zhao , Rinu Boney , Alexander Ilin , Juho Kannala , Joni Pajarinen

Imitation of expert behaviour is a highly desirable and safe approach to the problem of sequential decision making. We provide an easy-to-implement, novel algorithm for imitation learning under a strict data paradigm, in which the agent…

机器学习 · 计算机科学 2023-02-07 Matthew Smith , Lucas Maystre , Zhenwen Dai , Kamil Ciosek

Learning from demonstration is widely used as an efficient way for robots to acquire new skills. However, it typically requires that demonstrations provide full access to the state and action sequences. In contrast, learning from…

机器学习 · 计算机科学 2020-08-05 Zachary W. Robertson , Matthew R. Walter

Imitation Learning (IL) has proven highly effective for robotic and control tasks where manually designing reward functions or explicit controllers is infeasible. However, standard IL methods implicitly assume that the environment dynamics…

机器学习 · 计算机科学 2025-11-12 Rishabh Agrawal , Yusuf Alvi , Rahul Jain , Ashutosh Nayyar

Behavior Cloning (BC) is a widely adopted visual imitation learning method in robot manipulation. Current BC approaches often enhance generalization by leveraging large datasets and incorporating additional visual and textual modalities to…

机器人学 · 计算机科学 2025-05-14 Shuanghao Bai , Wanqi Zhou , Pengxiang Ding , Wei Zhao , Donglin Wang , Badong Chen

Imitation learning is a class of promising policy learning algorithms that is free from many practical issues with reinforcement learning, such as the reward design issue and the exploration hardness. However, the current imitation…

机器学习 · 计算机科学 2022-10-19 Zhao-Heng Yin , Weirui Ye , Qifeng Chen , Yang Gao

Imitation from observation is a computational technique that teaches an agent on how to mimic the behavior of an expert by observing only the sequence of states from the expert demonstrations. Recent approaches learn the inverse dynamics of…

人工智能 · 计算机科学 2020-04-29 Juarez Monteiro , Nathan Gavenski , Roger Granada , Felipe Meneguzzi , Rodrigo Barros

Imitation learning enables autonomous agents to learn from human examples, without the need for a reward signal. Still, if the provided dataset does not encapsulate the task correctly, or when the task is too complex to be modeled, such…

人工智能 · 计算机科学 2024-06-10 Federico Malato , Ville Hautamaki

Since the introduction of GAIL, adversarial imitation learning (AIL) methods attract lots of research interests. Among these methods, ValueDice has achieved significant improvements: it beats the classical approach Behavioral Cloning (BC)…

机器学习 · 计算机科学 2022-05-30 Ziniu Li , Tian Xu , Yang Yu , Zhi-Quan Luo

Recent advances in batch (offline) reinforcement learning have shown promising results in learning from available offline data and proved offline reinforcement learning to be an essential toolkit in learning control policies in a model-free…

机器学习 · 计算机科学 2022-12-19 Ashish Kumar , Ilya Kuzovkin