English
Related papers

Related papers: RAIL: Risk-Averse Imitation Learning

200 papers

Inverse Reinforcement Learning (IRL) is a powerful set of techniques for imitation learning that aims to learn a reward function that rationalizes expert demonstrations. Unfortunately, traditional IRL methods suffer from a computational…

Machine Learning · Computer Science 2024-01-31 Gokul Swamy , Sanjiban Choudhury , J. Andrew Bagnell , Zhiwei Steven Wu

Recent years have seen substantial progress in neural generation of text, images, and audio, supported by mature training pipelines and large-scale optimization. For graphs, however, comparable progress has been more limited. We attribute…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 André Eberhard , Gerhard Neumann , Pascal Friederich

End-to-end autonomous driving models trained solely with imitation learning (IL) often suffer from poor generalization. In contrast, reinforcement learning (RL) promotes exploration through reward maximization but faces challenges such as…

Computer Vision and Pattern Recognition · Computer Science 2025-10-15 Xiaoji Zheng , Ziyuan Yang , Yanhao Chen , Yuhang Peng , Yuanrong Tang , Gengyuan Liu , Bokui Chen , Jiangtao Gong

Consider learning an imitation policy on the basis of demonstrated behavior from multiple environments, with an eye towards deployment in an unseen environment. Since the observable features from each setting may be different, directly…

Machine Learning · Statistics 2023-11-06 Ioana Bica , Daniel Jarrett , Mihaela van der Schaar

Automated Uncrewed Aerial Vehicle (UAV) landing is crucial for autonomous UAV services such as monitoring, surveying, and package delivery. It involves detecting landing targets, perceiving obstacles, planning collision-free paths, and…

Realistic traffic simulation is critical for the development of autonomous driving systems and urban mobility planning, yet existing imitation learning approaches often fail to model realistic traffic behaviors. Behavior cloning suffers…

Machine Learning · Computer Science 2026-01-27 Ke Guo , Haochen Liu , Xiaojun Wu , Chen Lv

Reinforcement learning agents are prone to undesired behaviors due to reward mis-specification. Finding a set of reward functions to properly guide agent behaviors is particularly challenging in multi-agent scenarios. Inverse reinforcement…

Machine Learning · Computer Science 2019-08-01 Lantao Yu , Jiaming Song , Stefano Ermon

Multi-task Imitation Learning (MIL) aims to train a policy capable of performing a distribution of tasks based on multi-task expert demonstrations, which is essential for general-purpose robots. Existing MIL algorithms suffer from low data…

Machine Learning · Computer Science 2023-06-29 Jiayu Chen , Dipesh Tamboli , Tian Lan , Vaneet Aggarwal

Imitation learning (IL) is a general learning paradigm for tackling sequential decision-making problems. Interactive imitation learning, where learners can interactively query for expert demonstrations, has been shown to achieve provably…

Machine Learning · Computer Science 2022-09-27 Yichen Li , Chicheng Zhang

In this paper, we propose Sparse Imitation Reinforcement Learning (SIRL), a hybrid end-to-end control policy that combines the sparse expert driving knowledge with reinforcement learning (RL) policy for autonomous driving (AD) task in CARLA…

Computer Vision and Pattern Recognition · Computer Science 2022-05-25 Yuci Han , Alper Yilmaz

In this paper, we study the problem of obtaining a control policy that can mimic and then outperform expert demonstrations in Markov decision processes where the reward function is unknown to the learning agent. One main relevant approach…

Machine Learning · Computer Science 2020-09-24 Feng Tao , Yongcan Cao

Offline inverse reinforcement learning (Offline IRL) aims to recover the structure of rewards and environment dynamics that underlie observed actions in a fixed, finite set of demonstrations from an expert agent. Accurate models of…

Machine Learning · Computer Science 2024-03-01 Siliang Zeng , Chenliang Li , Alfredo Garcia , Mingyi Hong

In Imitation Learning (IL), utilizing suboptimal and heterogeneous demonstrations presents a substantial challenge due to the varied nature of real-world data. However, standard IL algorithms consider these datasets as homogeneous, thereby…

Machine Learning · Computer Science 2024-12-16 Mark Beliaev , Ramtin Pedarsani

Imitation learning is the task of replicating expert policy from demonstrations, without access to a reward function. This task becomes particularly challenging when the expert exhibits a mixture of behaviors. Prior work has introduced…

Machine Learning · Computer Science 2022-05-10 Arash Vahabpour , Tianyi Wang , Qiujing Lu , Omead Pooladzandi , Vwani Roychowdhury

Continual learning (CL) with Vision-Language Models (VLMs) has overcome the constraints of traditional CL, which only focuses on previously encountered classes. During the CL of VLMs, we need not only to prevent the catastrophic forgetting…

Computer Vision and Pattern Recognition · Computer Science 2024-12-19 Yicheng Xu , Yuxin Chen , Jiahao Nie , Yusong Wang , Huiping Zhuang , Manabu Okumura

Long-tail motion forecasting is a core challenge for autonomous driving, where rare yet safety-critical events-such as abrupt maneuvers and dense multi-agent interactions-dominate real-world risk. Existing approaches struggle in these…

Computational Engineering, Finance, and Science · Computer Science 2025-11-11 Bin Rao , Chengyue Wang , Haicheng Liao , Qianfang Wang , Yanchen Guan , Jiaxun Zhang , Xingcheng Liu , Meixin Zhu , Kanye Ye Wang , Zhenning Li

Inverse reinforcement learning (IRL) offers a powerful and general framework for learning humans' latent preferences in route recommendation, yet no approach has successfully addressed planetary-scale problems with hundreds of millions of…

Machine Learning · Computer Science 2024-03-07 Matt Barnes , Matthew Abueg , Oliver F. Lange , Matt Deeds , Jason Trader , Denali Molitor , Markus Wulfmeier , Shawn O'Banion

Offline Reinforcement Learning (RL) addresses the problem of sequential decision-making by learning optimal policy through pre-collected data, without interacting with the environment. As yet, it has remained somewhat impractical, because…

Machine Learning · Computer Science 2024-10-07 Maksim Bobrin , Nazar Buzun , Dmitrii Krylov , Dmitry V. Dylov

Autonomous Intersection Management (AIM) provides a signal-free intersection scheduling paradigm for Connected Autonomous Vehicles (CAVs). Distributed learning method has emerged as an attractive branch of AIM research. Compared with…

Multiagent Systems · Computer Science 2023-03-07 Guanzhou Li , Jianping Wu , Yujing He

There has recently been a surge in research in batch Deep Reinforcement Learning (DRL), which aims for learning a high-performing policy from a given dataset without additional interactions with the environment. We propose a new algorithm,…

Machine Learning · Computer Science 2020-11-03 Xinyue Chen , Zijian Zhou , Zheng Wang , Che Wang , Yanqiu Wu , Keith Ross