中文
相关论文

相关论文: A Pragmatic Look at Deep Imitation Learning

200 篇论文

In recent years, Hypergraph Neural Networks (HNNs) have demonstrated immense potential in handling complex systems with high-order interactions. However, acquiring large-scale, high-quality labeled data for these models is costly, making…

机器学习 · 计算机科学 2025-07-29 Yanheng Hou , Xunkai Li , Zhenjun Li , Bing Zhou , Ronghua Li , Guoren Wang

Recent work on imitation learning has generated policies that reproduce expert behavior from multi-modal data. However, past approaches have focused only on recreating a small number of distinct, expert maneuvers, or have relied on…

机器学习 · 计算机科学 2017-10-17 Alex Kuefler , Mykel J. Kochenderfer

Autonomous driving (AD) agents generate driving policies based on online perception results, which are obtained at multiple levels of abstraction, e.g., behavior planning, motion planning and control. Driving policies are crucial to the…

机器人学 · 计算机科学 2022-01-21 Zeyu Zhu , Huijing Zhao

While reinforcement learning (RL) has shown promising performance, its sample complexity continues to be a substantial hurdle, restricting its broader application across a variety of domains. Imitation learning (IL) utilizes oracles to…

机器学习 · 计算机科学 2025-08-12 Xuefeng Liu , Takuma Yoneda , Rick L. Stevens , Matthew R. Walter , Yuxin Chen

Hierarchical reinforcement learning (HRL) is a promising approach to extend traditional reinforcement learning (RL) methods to solve more complex tasks. Yet, the majority of current HRL methods require careful task-specific design and…

机器学习 · 计算机科学 2018-10-08 Ofir Nachum , Shixiang Gu , Honglak Lee , Sergey Levine

A major bottleneck in imitation learning is the requirement of a large number of expert demonstrations, which can be expensive or inaccessible. Learning from supplementary demonstrations without strict quality requirements has emerged as a…

机器学习 · 计算机科学 2024-12-31 Jiangdong Fan , Hongcai He , Paul Weng , Hui Xu , Jie Shao

Interactive Imitation Learning (IIL) allows agents to acquire desired behaviors through human interventions, but current methods impose high cognitive demands on human supervisors. We propose the Adaptive Intervention Mechanism (AIM), a…

人工智能 · 计算机科学 2025-06-12 Haoyuan Cai , Zhenghao Peng , Bolei Zhou

We propose an adversarial deep reinforcement learning (ADRL) algorithm for high-dimensional stochastic control problems. Inspired by the information relaxation duality, ADRL reformulates the control problem as a min-max optimization between…

最优化与控制 · 数学 2025-07-03 Nan Chen , Mengzhou Liu , Xiaoyan Wang , Nanyi Zhang

We seek to align agent policy with human expert behavior in a reinforcement learning (RL) setting, without any prior knowledge about dynamics, reward function, and unsafe states. There is a human expert knowing the rewards and unsafe states…

机器学习 · 计算机科学 2020-01-01 Daniel Hsu

We provide a unifying view of a large family of previous imitation learning algorithms through the lens of moment matching. At its core, our classification scheme is based on whether the learner attempts to match (1) reward or (2)…

机器学习 · 计算机科学 2021-06-14 Gokul Swamy , Sanjiban Choudhury , J. Andrew Bagnell , Zhiwei Steven Wu

Multi-objective reinforcement learning (MORL) algorithms tackle sequential decision problems where agents may have different preferences over (possibly conflicting) reward functions. Such algorithms often learn a set of policies (each…

机器学习 · 计算机科学 2023-08-16 Lucas N. Alegre , Ana L. C. Bazzan , Diederik M. Roijers , Ann Nowé , Bruno C. da Silva

We study Imitation Learning (IL) from Observations alone (ILFO) in large-scale MDPs. While most IL algorithms rely on an expert to directly provide actions to the learner, in this setting the expert only supplies sequences of observations.…

机器学习 · 计算机科学 2019-06-12 Wen Sun , Anirudh Vemula , Byron Boots , J. Andrew Bagnell

Imitation learning (IL) is a general learning paradigm for tackling sequential decision-making problems. Interactive imitation learning, where learners can interactively query for expert demonstrations, has been shown to achieve provably…

机器学习 · 计算机科学 2022-09-27 Yichen Li , Chicheng Zhang

The aim in imitation learning is to learn effective policies by utilizing near-optimal expert demonstrations. However, high-quality demonstrations from human experts can be expensive to obtain in large numbers. On the other hand, it is…

机器学习 · 计算机科学 2021-10-29 Mengjiao Yang , Sergey Levine , Ofir Nachum

Deep neural networks coupled with fast simulation and improved computation have led to recent successes in the field of reinforcement learning (RL). However, most current RL-based approaches fail to generalize since: (a) the gap between…

机器学习 · 计算机科学 2017-03-09 Lerrel Pinto , James Davidson , Rahul Sukthankar , Abhinav Gupta

Aligning generative diffusion models with human preferences via reinforcement learning (RL) is critical yet challenging. Most existing algorithms are often vulnerable to reward hacking, such as quality degradation, over-stylization, or…

Standard imitation learning can fail when the expert demonstrators have different sensory inputs than the imitating agent. This is because partial observability gives rise to hidden confounders in the causal graph. In previous work, to work…

机器学习 · 计算机科学 2024-08-27 Risto Vuorio , Pim de Haan , Johann Brehmer , Hanno Ackermann , Daniel Dijkman , Taco Cohen

Multi-agent adversarial inverse reinforcement learning (MA-AIRL) is a recent approach that applies single-agent AIRL to multi-agent problems where we seek to recover both policies for our agents and reward functions that promote expert-like…

多智能体系统 · 计算机科学 2020-02-26 Wonseok Jeon , Paul Barde , Derek Nowrouzezahrai , Joelle Pineau

To achieve general intelligence, agents must learn how to interact with others in a shared environment: this is the challenge of multiagent reinforcement learning (MARL). The simplest form is independent reinforcement learning (InRL), where…

Inverse Reinforcement Learning (IRL) aims to reconstruct the reward function from expert demonstrations to facilitate policy learning, and has demonstrated its remarkable success in imitation learning. To promote expert-like behavior,…

机器学习 · 计算机科学 2023-06-16 Shunyu Liu , Yunpeng Qing , Shuqi Xu , Hongyan Wu , Jiangtao Zhang , Jingyuan Cong , Tianhao Chen , Yunfu Liu , Mingli Song