English
Related papers

Related papers: LightSim: A Lightweight Cell Transmission Model Si…

200 papers

Microscopic traffic simulation plays a crucial role in transportation engineering by providing insights into individual vehicle behavior and overall traffic flow. However, creating a realistic simulator that accurately replicates human…

Artificial Intelligence · Computer Science 2024-05-24 Ke Guo , Zhenwei Miao , Wei Jing , Weiwei Liu , Weizi Li , Dayang Hao , Jia Pan

As the foundation of closed-loop training and evaluation in autonomous driving, traffic simulation still faces two fundamental challenges: covariate shift introduced by open-loop imitation learning and limited capacity to reflect the…

Robotics · Computer Science 2026-02-03 Keyu Chen , Wenchao Sun , Hao Cheng , Zheng Fu , Sifa Zheng

Traffic signal control has the potential to reduce congestion in dynamic networks. Recent studies show that traffic signal control with reinforcement learning (RL) methods can significantly reduce the average waiting time. However, a…

Systems and Control · Electrical Eng. & Systems 2024-06-13 Maonan Wang , Yutong Xu , Xi Xiong , Yuheng Kan , Chengcheng Xu , Man-On Pun

Recent advances in combining deep neural network architectures with reinforcement learning techniques have shown promising potential results in solving complex control problems with high dimensional state and action spaces. Inspired by…

Machine Learning · Computer Science 2017-05-30 Seyed Sajad Mousavi , Michael Schukat , Enda Howley

Simulation is pivotal in evaluating the performance of autonomous driving systems due to the advantages of high efficiency and low cost compared to on-road testing. Bridging the gap between simulation and the real world requires realistic…

Robotics · Computer Science 2025-06-17 Haojie Xin , Xiaodong Zhang , Renzhi Tang , Songyang Yan , Qianrui Zhao , Chunze Yang , Wen Cui , Zijiang Yang

Reinforcement Learning (RL) trains agents to learn optimal behavior by maximizing reward signals from experience datasets. However, RL training often faces memory limitations, leading to execution latencies and prolonged training times. To…

Traffic simulation is important for transportation optimization and policy making. While existing simulators such as SUMO and MATSim offer fully-featured platforms and utilities, users without too much knowledge about these platforms often…

Artificial Intelligence · Computer Science 2025-12-25 Yuwei Du , Jun Zhang , Jie Feng , Zhicheng Liu , Jian Yuan , Yong Li

The goal of this work is to provide a viable solution based on reinforcement learning for traffic signal control problems. Although the state-of-the-art reinforcement learning approaches have yielded great success in a variety of domains,…

Machine Learning · Computer Science 2020-05-20 Yueh-Hua Wu , I-Hau Yeh , David Hu , Hong-Yuan Mark Liao

Traffic signal control (TSC) is a core component of intelligent transportation systems (ITS), aiming to reduce congestion, emissions, and travel time. Recent approaches based on reinforcement learning (RL) and large language models (LLMs)…

Artificial Intelligence · Computer Science 2026-04-14 Qing Guo , Xinhang Li , Junyu Chen , Zheng Guo , Shengzhe Xu , Lin Zhang , Lei Li

Evaluating the performance of autonomous vehicle planning algorithms necessitates simulating long-tail safety-critical traffic scenarios. However, traditional methods for generating such scenarios often fall short in terms of…

Robotics · Computer Science 2024-08-08 Wei-Jer Chang , Francesco Pittaluga , Masayoshi Tomizuka , Wei Zhan , Manmohan Chandraker

Most reinforcement learning methods for adaptive-traffic-signal-control require training from scratch to be applied on any new intersection or after any modification to the road network, traffic distribution, or behavioral constraints…

Machine Learning · Computer Science 2022-08-02 François-Xavier Devailly , Denis Larocque , Laurent Charlin

Neurosim is a fast, real-time, high-performance library for simulating sensors such as dynamic vision sensors, RGB cameras, depth sensors, and inertial sensors. It can also simulate agile dynamics of multi-rotor vehicles in complex and…

Robotics · Computer Science 2026-02-17 Richeek Das , Pratik Chaudhari

This study proposes a novel adaptive traffic signal control method leveraging a Deep Q-Network (DQN) and Proximal Policy Optimization (PPO) to optimize signal timing by integrating variable cell length and multi-channel state…

Systems and Control · Electrical Eng. & Systems 2026-02-16 Maojiang Deng , Shoufeng Lu , Jiazhao Shi , Wen Zhang

We use reinforcement learning in simulation to obtain a driving system controlling a full-size real-world vehicle. The driving policy takes RGB images from a single camera and their semantic segmentation as input. We use mostly synthetic…

Traffic intersections are important scenes that can be seen almost everywhere in the traffic system. Currently, most simulation methods perform well at highways and urban traffic networks. In intersection scenarios, the challenge lies in…

Robotics · Computer Science 2023-04-06 Pei Lv , Xinming Pei , Xinyu Ren , Yuzhen Zhang , Chaochao Li , Mingliang Xu

Efficient traffic signal control (TSC) is crucial for reducing congestion, travel delays, pollution, and for ensuring road safety. Traditional approaches, such as fixed signal control and actuated control, often struggle to handle dynamic…

Systems and Control · Electrical Eng. & Systems 2025-09-29 Anirud Nandakumar , Chayan Banerjee , Lelitha Devi Vanajakshi

Transformer-based neural models are used in many AI applications. Training these models is expensive, as it takes huge GPU resources and long duration. It is challenging because typical data like sentences have variable lengths, and…

Computation and Language · Computer Science 2022-06-17 Xiaohui Wang , Yang Wei , Ying Xiong , Guyue Huang , Xian Qian , Yufei Ding , Mingxuan Wang , Lei Li

Free-flow road networks, such as suburban highways, are increasingly experiencing traffic congestion due to growing commuter inflow and limited infrastructure. Traditional control mechanisms, such as traffic signals or local heuristics, are…

Machine Learning · Computer Science 2025-06-16 Ankit Bhardwaj , Rohail Asim , Sachin Chauhan , Yasir Zaki , Lakshminarayanan Subramanian

Recently the traffic related problems have become strategically important, due to the continuously increasing vehicle number. As a result, microscopic simulation software has become an efficient method in traffic engineering for its…

Other Computer Science · Computer Science 2014-08-01 Yuhan Jia , Jianping Wu , Yiman Du , Geqi Qi

Traffic congestion and collisions represent significant economic, environmental, and social challenges worldwide. Traditional traffic management approaches have shown limited success in addressing these complex, dynamic problems. To address…

Machine Learning · Computer Science 2025-06-05 Mira Nuthakki