English
Related papers

Related papers: Learning Realistic Traffic Agents in Closed-loop

200 papers

Evaluating autonomous vehicle stacks (AVs) in simulation typically involves replaying driving logs from real-world recorded traffic. However, agents replayed from offline data are not reactive and hard to intuitively control. Existing…

With the increasing availability of traffic data and advance of deep reinforcement learning techniques, there is an emerging trend of employing reinforcement learning (RL) for traffic signal control. A key question for applying RL to…

Machine Learning · Computer Science 2019-05-14 Guanjie Zheng , Xinshi Zang , Nan Xu , Hua Wei , Zhengyao Yu , Vikash Gayah , Kai Xu , Zhenhui Li

Human-driven vehicles (HVs) exhibit complex and diverse behaviors. Accurately modeling such behavior is crucial for validating Robot Vehicles (RVs) in simulation and realizing the potential of mixed traffic control. However, existing…

Robotics · Computer Science 2024-07-10 Bibek Poudel , Weizi Li , Shuai Li

Reinforcement learning (RL) has attracted increasing interest for adaptive traffic signal control due to its model-free ability to learn control policies directly from interaction with the traffic environment. However, several challenges…

Machine Learning · Computer Science 2026-03-17 Dickens Kwesiga , Angshuman Guin , Khaled Abdelghany , Michael Hunter

Sub-optimal control policies in intersection traffic signal controllers (TSC) contribute to congestion and lead to negative effects on human health and the environment. Reinforcement learning (RL) for traffic signal control is a promising…

Recent advances in high-fidelity simulators have enabled closed-loop training of autonomous driving agents, potentially solving the distribution shift in training v.s. deployment and allowing training to be scaled both safely and cheaply.…

Robotics · Computer Science 2023-06-29 Chris Zhang , Runsheng Guo , Wenyuan Zeng , Yuwen Xiong , Binbin Dai , Rui Hu , Mengye Ren , Raquel Urtasun

Ensuring safety in autonomous driving (AD) remains a significant challenge, especially in highly dynamic and complex traffic environments where diverse agents interact and unexpected hazards frequently emerge. Traditional reinforcement…

Robotics · Computer Science 2025-10-14 Dong Hu , Fenqing Hu , Lidong Yang , Chao Huang

This paper presents an empirical study of reset-free reinforcement learning (RL) for real-world agile driving, in which a physical 1/10-scale vehicle learns continuously on a slippery indoor track without manual resets. High-speed driving…

Robotics · Computer Science 2026-04-10 Kohei Honda , Hirotaka Hosogaya

This work introduces interactive traffic scenarios in the CARLA simulator, which are based on real-world traffic. We concentrate on tactical tasks lasting several seconds, which are especially challenging for current control methods. The…

Automated vehicle control using reinforcement learning (RL) has attracted significant attention due to its potential to learn driving policies through environment interaction. However, RL agents often face training challenges in sample…

Robotics · Computer Science 2025-09-08 Zhihao Zhang , Chengyang Peng , Ekim Yurtsever , Keith A. Redmill

Traffic signal control aims to coordinate traffic signals across intersections to improve the traffic efficiency of a district or a city. Deep reinforcement learning (RL) has been applied to traffic signal control recently and demonstrated…

Machine Learning · Computer Science 2024-04-02 Liwen Zhu , Peixi Peng , Zongqing Lu , Xiangqian Wang , Yonghong Tian

A central challenge for autonomous vehicles is coordinating with humans. Therefore, incorporating realistic human agents is essential for scalable training and evaluation of autonomous driving systems in simulation. Simulation agents are…

Robotics · Computer Science 2024-06-25 Daphne Cornelisse , Eugene Vinitsky

Latest technological improvements increased the quality of transportation. New data-driven approaches bring out a new research direction for all control-based systems, e.g., in transportation, robotics, IoT and power systems. Combining…

Machine Learning · Computer Science 2020-05-05 Ammar Haydari , Yasin Yilmaz

Model-based reinforcement learning (RL) is anticipated to exhibit higher sample efficiency compared to model-free RL by utilizing a virtual environment model. However, it is challenging to obtain sufficiently accurate representations of the…

Artificial Intelligence · Computer Science 2026-01-19 Zihao Sheng , Zilin Huang , Sikai Chen

Scaling adaptive traffic-signal control involves dealing with combinatorial state and action spaces. Multi-agent reinforcement learning attempts to address this challenge by distributing control to specialized agents. However,…

Machine Learning · Computer Science 2021-09-22 François-Xavier Devailly , Denis Larocque , Laurent Charlin

Ineffective and inflexible traffic signal control at urban intersections can often lead to bottlenecks in traffic flows and cause congestion, delay, and environmental problems. How to manage traffic smartly by intelligent signal control is…

Systems and Control · Computer Science 2019-05-21 Mengyu Guo , Pin Wang , Ching-Yao Chan , Sid Askary

Supervised open-loop training has been widely adopted for training traffic simulation models; however, it fails to capture the inherently dynamic, multi-agent interactions common in complex driving scenarios. We introduce RLFTSim, a…

Reinforcement learning (RL) in autonomous driving employs a trial-and-error mechanism, enhancing robustness in unpredictable environments. However, crafting effective reward functions remains challenging, as conventional approaches rely…

Machine Learning · Computer Science 2025-06-02 Yongming Chen , Miner Chen , Liewen Liao , Mingyang Jiang , Xiang Zuo , Hengrui Zhang , Yuchen Xi , Songan Zhang

This paper presents a mixed traffic control policy designed to optimize traffic efficiency across diverse road topologies, addressing issues of congestion prevalent in urban environments. A model-free reinforcement learning (RL) approach is…

Robotics · Computer Science 2025-01-29 Chuyang Xiao , Dawei Wang , Xinzheng Tang , Jia Pan , Yuexin Ma

Implementing an autonomous vehicle that is able to output feasible, smooth and efficient trajectories is a long-standing challenge. Several approaches have been considered, roughly falling under two categories: rule-based and learning-based…

Robotics · Computer Science 2022-03-22 Branka Mirchevska , Moritz Werling , Joschka Boedecker