English
Related papers

Related papers: Robot-Gated Interactive Imitation Learning with Ad…

200 papers

Assistant AI agents should be capable of rapidly acquiring novel skills and adapting to new user preferences. Traditional frameworks like imitation learning and reinforcement learning do not facilitate this capability because they support…

Machine Learning · Computer Science 2023-10-23 Ruijie Zheng , Khanh Nguyen , Hal Daumé , Furong Huang , Karthik Narasimhan

Imitation Learning (IL) aims to discover a policy by minimizing the discrepancy between the agent's behavior and expert demonstrations. However, IL is susceptible to limitations imposed by noisy demonstrations from non-expert behaviors,…

Machine Learning · Computer Science 2023-10-25 Ye Yuan , Xin Li , Yong Heng , Leiji Zhang , MingZhong Wang

Prompt-based learning has emerged as a successful paradigm in natural language processing, where a single general-purpose language model can be instructed to perform any task specified by input prompts. Yet task specification in robotics…

The study of unsupervised learning can be generally divided into two categories: imitation learning and reinforcement learning. In imitation learning the machine learns by mimicking the behavior of an expert system whereas in reinforcement…

Machine Learning · Computer Science 2020-04-07 Xiao Lei Zhang , Anish Agarwal

Adversarial imitation learning (AIL) is a popular method that has recently achieved much success. However, the performance of AIL is still unsatisfactory on the more challenging tasks. We find that one of the major reasons is due to the low…

Machine Learning · Computer Science 2023-07-07 Jialei Huang , Zhaoheng Yin , Yingdong Hu , Yang Gao

Learning and adaptation is a fundamental property of intelligent agents. In the context of adaptive information filtering, a filtering agent's beliefs about a user's information needs have to be revised regularly with reference to the…

Artificial Intelligence · Computer Science 2007-05-23 Raymond Lau , Arthur H. M. ter Hofstede , Peter D. Bruza

Model-free deep reinforcement learning (RL) has demonstrated its superiority on many complex sequential decision-making problems. However, heavy dependence on dense rewards and high sample-complexity impedes the wide adoption of these…

Machine Learning · Computer Science 2020-04-02 Zhuangdi Zhu , Kaixiang Lin , Bo Dai , Jiayu Zhou

The development of algorithms that learn multi-agent behavioral models using human demonstrations has led to increasingly realistic simulations in the field of autonomous driving. In general, such models learn to jointly predict…

Imitation learning has proven to be useful for many real-world problems, but approaches such as behavioral cloning suffer from data mismatch and compounding error issues. One attempt to address these limitations is the DAgger algorithm,…

Robotics · Computer Science 2019-03-12 Michael Kelly , Chelsea Sidrane , Katherine Driggs-Campbell , Mykel J. Kochenderfer

We present an approach for mobile robots to learn to navigate in dynamic environments with pedestrians via raw depth inputs, in a socially compliant manner. To achieve this, we adopt a generative adversarial imitation learning (GAIL)…

Robotics · Computer Science 2018-02-27 Lei Tai , Jingwei Zhang , Ming Liu , Wolfram Burgard

As AI systems become increasingly autonomous, reliably aligning their decision-making with human preferences is essential. Inverse reinforcement learning (IRL) offers a promising approach to infer preferences from demonstrations. These…

Machine Learning · Computer Science 2025-09-22 Ondrej Bajgar , Dewi S. W. Gould , Jonathon Liu , Alessandro Abate , Konstantinos Gatsis , Michael A. Osborne

Adversarial Imitation Learning (AIL) is a class of popular state-of-the-art Imitation Learning algorithms commonly used in robotics. In AIL, an artificial adversary's misclassification is used as a reward signal that is optimized by any…

Machine Learning · Computer Science 2022-12-01 Ankur Deka , Changliu Liu , Katia Sycara

Imitation Learning (IL) algorithms offer an efficient way to train an agent by mimicking an expert's behavior without requiring a reward function. IL algorithms often necessitate access to state and action information from expert…

Machine Learning · Computer Science 2025-09-25 Returaj Burnwal , Hriday Mehta , Nirav Pravinbhai Bhatt , Balaraman Ravindran

In generative adversarial imitation learning (GAIL), the agent aims to learn a policy from an expert demonstration so that its performance cannot be discriminated from the expert policy on a certain predefined reward set. In this paper, we…

Machine Learning · Computer Science 2021-08-20 Zhihan Liu , Yufeng Zhang , Zuyue Fu , Zhuoran Yang , Zhaoran Wang

Imitation learning is the problem of recovering an expert policy without access to a reward signal. Behavior cloning and GAIL are two widely used methods for performing imitation learning. Behavior cloning converges in a few iterations but…

Machine Learning · Computer Science 2020-11-11 Rohit Jena , Changliu Liu , Katia Sycara

Current reinforcement learning (RL) algorithms can be brittle and difficult to use, especially when learning goal-reaching behaviors from sparse rewards. Although supervised imitation learning provides a simple and stable alternative, it…

Machine Learning · Computer Science 2020-10-06 Dibya Ghosh , Abhishek Gupta , Ashwin Reddy , Justin Fu , Coline Devin , Benjamin Eysenbach , Sergey Levine

Generative adversarial imitation learning (GAIL) is a model-free algorithm that has been shown to provide strong results in imitating complex behaviors in high-dimensional environments. In this paper, we utilize the GAIL model for text…

Computation and Language · Computer Science 2021-05-28 Pratyush Muthukumar , Karishma Muthukumar , Deepan Muthirayan , Pramod Khargonekar

This paper proposes a method to combine reinforcement learning (RL) and imitation learning (IL) using a dynamic, performance-based modulation over learning signals. The proposed method combines RL and behavioral cloning (IL), or corrective…

Robotics · Computer Science 2024-05-17 Francisco Leiva , Javier Ruiz-del-Solar

Model-based reinforcement learning algorithms make decisions by building and utilizing a model of the environment. However, none of the existing algorithms attempts to infer the dynamics of any state-action pair from known state-action…

Machine Learning · Computer Science 2020-02-25 Yanchao Sun , Furong Huang

Expert programmers' eye-movements during source code reading are valuable sources that are considered to be associated with their domain expertise. We advocate a vision of new intelligent systems incorporating expertise of experts for…

Software Engineering · Computer Science 2019-03-18 Yoshiharu Ikutani , Nishanth Koganti , Hideaki Hata , Takatomi Kubo , Kenichi Matsumoto