English

Adaptive Autopilot: Constrained DRL for Diverse Driving Behaviors

Robotics 2024-07-04 v1 Machine Learning

Abstract

In pursuit of autonomous vehicles, achieving human-like driving behavior is vital. This study introduces adaptive autopilot (AA), a unique framework utilizing constrained-deep reinforcement learning (C-DRL). AA aims to safely emulate human driving to reduce the necessity for driver intervention. Focusing on the car-following scenario, the process involves (i) extracting data from the highD natural driving study and categorizing it into three driving styles using a rule-based classifier; (ii) employing deep neural network (DNN) regressors to predict human-like acceleration across styles; and (iii) using C-DRL, specifically the soft actor-critic Lagrangian technique, to learn human-like safe driving policies. Results indicate effectiveness in each step, with the rule-based classifier distinguishing driving styles, the regressor model accurately predicting acceleration, outperforming traditional car-following models, and C-DRL agents learning optimal policies for humanlike driving across styles.

Keywords

Cite

@article{arxiv.2407.02546,
  title  = {Adaptive Autopilot: Constrained DRL for Diverse Driving Behaviors},
  author = {Dinesh Cyril Selvaraj and Christian Vitale and Tania Panayiotou and Panayiotis Kolios and Carla Fabiana Chiasserini and Georgios Ellinas},
  journal= {arXiv preprint arXiv:2407.02546},
  year   = {2024}
}

Comments

8 pages, 9 figures

R2 v1 2026-06-28T17:27:02.927Z