English
Related papers

Related papers: Driving Behavior Modeling using Naturalistic Human…

200 papers

One of the key challenges in current Reinforcement Learning (RL)-based Automated Driving (AD) agents is achieving flexible, precise, and human-like behavior cost-effectively. This paper introduces an innovative approach that uses large…

Artificial Intelligence · Computer Science 2024-12-30 Ziqi Zhou , Jingyue Zhang , Jingyuan Zhang , Yangfan He , Boyue Wang , Tianyu Shi , Alaa Khamis

We consider the problem of modeling trajectories of drivers in a road network from the perspective of inverse reinforcement learning. Cars are detected by sensors placed on sparsely distributed points on the street network of a city. As…

Artificial Intelligence · Computer Science 2024-01-22 Anselmo R. Pitombeira-Neto , Helano P. Santos , Ticiana L. Coelho da Silva , José Antonio F. de Macedo

Driving in a human-like manner is important for an autonomous vehicle to be a smart and predictable traffic participant. To achieve this goal, parameters of the motion planning module should be carefully tuned, which needs great effort and…

Computer Vision and Pattern Recognition · Computer Science 2020-05-26 Donghao Xu , Zhezhang Ding , Xu He , Huijing Zhao , Mathieu Moze , François Aioun , Franck Guillemard

In this paper we investigate the effect of the unpredictability of surrounding cars on an ego-car performing a driving maneuver. We use Maximum Entropy Inverse Reinforcement Learning to model reward functions for an ego-car conducting a…

Robotics · Computer Science 2024-02-09 Sepehr Samavi , Florian Shkurti , Angela P. Schoellig

Inverse reinforcement learning methods aim to retrieve the reward function of a Markov decision process based on a dataset of expert demonstrations. The commonplace scarcity and heterogeneous sources of such demonstrations can lead to the…

Machine Learning · Computer Science 2024-09-13 Ivan Ovinnikov , Eugene Bykovets , Joachim M. Buhmann

Reinforcement learning (RL) is an effective approach to motion planning in autonomous driving, where an optimal driving policy can be automatically learned using the interaction data with the environment. Nevertheless, the reward function…

Robotics · Computer Science 2023-08-28 Lin-Chi Wu , Zengjie Zhang , Sofie Haesaert , Zhiqiang Ma , Zhiyong Sun

We propose an inverse reinforcement learning (IRL) approach using Deep Q-Networks to extract the rewards in problems with large state spaces. We evaluate the performance of this approach in a simulation-based autonomous driving scenario.…

Artificial Intelligence · Computer Science 2017-09-22 Sahand Sharifzadeh , Ioannis Chiotellis , Rudolph Triebel , Daniel Cremers

Model-based Reinforcement Learning (MBRL) has emerged as a promising paradigm for autonomous driving, where data efficiency and robustness are critical. Yet, existing solutions often rely on carefully crafted, task specific extrinsic…

Robotics · Computer Science 2025-03-10 Feeza Khan Khanzada , Jaerock Kwon

It can be difficult to autonomously produce driver behavior so that it appears natural to other traffic participants. Through Inverse Reinforcement Learning (IRL), we can automate this process by learning the underlying reward function from…

Robotics · Computer Science 2022-01-19 Keuntaek Lee , David Isele , Evangelos A. Theodorou , Sangjae Bae

Inverse Reinforcement Learning (IRL) describes the problem of learning an unknown reward function of a Markov Decision Process (MDP) from observed behavior of an agent. Since the agent's behavior originates in its policy and MDP policies…

Artificial Intelligence · Computer Science 2016-04-14 Michael Herman , Tobias Gindele , Jörg Wagner , Felix Schmitt , Wolfram Burgard

Inverse reinforcement learning (IRL) methods assume that the expert data is generated by an agent optimizing some reward function. However, in many settings, the agent may optimize a reward function subject to some constraints, where the…

Machine Learning · Computer Science 2023-05-01 Ashish Gaurav , Kasra Rezaee , Guiliang Liu , Pascal Poupart

Providing a suitable reward function to reinforcement learning can be difficult in many real world applications. While inverse reinforcement learning (IRL) holds promise for automatically learning reward functions from demonstrations,…

Machine Learning · Computer Science 2019-10-29 Lantao Yu , Tianhe Yu , Chelsea Finn , Stefano Ermon

An open problem in autonomous vehicle safety validation is building reliable models of human driving behavior in simulation. This work presents an approach to learn neural driving policies from real world driving demonstration data. We…

Artificial Intelligence · Computer Science 2023-02-08 Raunak Bhattacharyya , Blake Wulfe , Derek Phillips , Alex Kuefler , Jeremy Morton , Ransalu Senanayake , Mykel Kochenderfer

Recent advances in reinforcement learning have inspired increasing interest in learning user modeling adaptively through dynamic interactions, e.g., in reinforcement learning based recommender systems. Reward function is crucial for most of…

Machine Learning · Computer Science 2021-05-06 Xiaocong Chen , Lina Yao , Xianzhi Wang , Aixin Sun , Wenjie Zhang , Quan Z. Sheng

The literature on Inverse Reinforcement Learning (IRL) typically assumes that humans take actions in order to minimize the expected value of a cost function, i.e., that humans are risk neutral. Yet, in practice, humans are often far from…

Artificial Intelligence · Computer Science 2018-03-23 Sumeet Singh , Jonathan Lacotte , Anirudha Majumdar , Marco Pavone

Designing effective reward functions is crucial to training reinforcement learning (RL) algorithms. However, this design is non-trivial, even for domain experts, due to the subjective nature of certain tasks that are hard to quantify…

Neural and Evolutionary Computing · Computer Science 2025-05-26 Rishi Hazra , Alkis Sygkounas , Andreas Persson , Amy Loutfi , Pedro Zuidberg Dos Martires

Accurate driving behavior modeling is fundamental to safe and efficient trajectory prediction, yet remains challenging in complex traffic scenarios. This paper presents a novel Inverse Reinforcement Learning (IRL) framework that captures…

Machine Learning · Computer Science 2026-02-06 Wenyun Li , Wenjie Huang , Zejian Deng , Chen Sun

Being able to predict human gaze behavior has obvious importance for behavioral vision and for computer vision applications. Most models have mainly focused on predicting free-viewing behavior using saliency maps, but these predictions do…

Computer Vision and Pattern Recognition · Computer Science 2020-06-26 Zhibo Yang , Lihan Huang , Yupei Chen , Zijun Wei , Seoyoung Ahn , Gregory Zelinsky , Dimitris Samaras , Minh Hoai

In the simulation-based testing and evaluation of autonomous vehicles (AVs), how background vehicles (BVs) drive directly influences the AV's driving behavior and further impacts the testing result. Existing simulation platforms use either…

Systems and Control · Electrical Eng. & Systems 2021-02-05 Lin Liu , Shuo Feng , Yiheng Feng , Xichan Zhu , Henry X. Liu

This paper proposes a novel learning-based framework for autonomous driving based on the concept of maximal safety probability. Efficient learning requires rewards that are informative of desirable/undesirable states, but such rewards are…

Robotics · Computer Science 2024-09-06 Hikaru Hoshino , Jiaxing Li , Arnav Menon , John M. Dolan , Yorie Nakahira