English

A Simple Framework Towards Vision-based Traffic Signal Control with Microscopic Simulation

Computer Vision and Pattern Recognition 2025-11-27 v2

Abstract

Traffic signal control (TSC) is crucial for reducing traffic congestion leading to smoother traffic flow, reduced idle time, and mitigated CO2 emissions. In this paper, we explore the computer vision approach for TSC that modulates on-road traffic flows through visual observation. Unlike traditional feature-based approaches, vision-based methods depend much less on heuristics and predefined features, bringing promising potentials for end-to-end learning and optimization of traffic signals. Thus, we introduce a simple traffic simulation framework called TrafficDojo towards vision-based TSC and its benchmark by integrating the microscopic traffic flow provided in SUMO into the 3D driving simulator MetaDrive. This proposed framework offers a versatile traffic environment for in-depth analysis and comprehensive evaluation of traffic signal controllers across diverse traffic conditions and scenarios. We establish and compare baseline algorithms including both traditional and Reinforcement Learning (RL) approaches. This work sheds light on the design and development of vision-based TSC approaches and opens up new research opportunities

Keywords

Cite

@article{arxiv.2403.06884,
  title  = {A Simple Framework Towards Vision-based Traffic Signal Control with Microscopic Simulation},
  author = {Pan He and Quanyi Li and Xiaoyong Yuan and Bolei Zhou},
  journal= {arXiv preprint arXiv:2403.06884},
  year   = {2025}
}

Comments

Accepted for presentation at the Transportation Research Board (TRB) 105th Annual Meeting

R2 v1 2026-06-28T15:16:01.097Z