English
Related papers

Related papers: SymLight: Exploring Interpretable and Deployable S…

200 papers

Traffic Signal Control (TSC) plays a critical role in urban traffic management by optimizing traffic flow and mitigating congestion. While Large Language Models (LLMs) have recently emerged as promising tools for TSC due to their…

Machine Learning · Computer Science 2025-03-18 Zirui Yuan , Siqi Lai , Hao Liu

Reinforcement learning (RL) has seen significant success across various domains, but its adoption is often limited by the black-box nature of neural network policies, making them difficult to interpret. In contrast, symbolic policies allow…

Machine Learning · Computer Science 2025-03-12 Sascha Marton , Tim Grams , Florian Vogt , Stefan Lüdtke , Christian Bartelt , Heiner Stuckenschmidt

This paper develops a decentralized reinforcement learning (RL) scheme for multi-intersection adaptive traffic signal control (TSC), called "CVLight", that leverages data collected from connected vehicles (CVs). The state and reward design…

Machine Learning · Computer Science 2022-07-04 Mobin Zhao , Wangzhi Li , Yongjie Fu , Kangrui Ruan , Xuan Di

The optimization of traffic signal control (TSC) is critical for an efficient transportation system. In recent years, reinforcement learning (RL) techniques have emerged as a popular approach for TSC and show promising results for highly…

Artificial Intelligence · Computer Science 2023-11-28 Jianxiong Li , Shichao Lin , Tianyu Shi , Chujie Tian , Yu Mei , Jian Song , Xianyuan Zhan , Ruimin Li

Reinforcement learning methods have proposed promising traffic signal control policy that can be trained on large road networks. Current SOTA methods model road networks as topological graph structures, incorporate graph attention into deep…

Multiagent Systems · Computer Science 2024-12-25 Sunbowen Lee , Hongqin Lyu , Yicheng Gong , Yingying Sun , Chao Deng

We consider the popular tree-based search strategy within the framework of reinforcement learning, the Monte Carlo Tree Search (MCTS), in the context of finite-horizon Markov decision process. We propose a dynamic sampling tree policy that…

Artificial Intelligence · Computer Science 2023-05-09 Gongbo Zhang , Yijie Peng , Yilong Xu

Recently, Intelligent Transportation Systems are leveraging the power of increased sensory coverage and computing power to deliver data-intensive solutions achieving higher levels of performance than traditional systems. Within Traffic…

Machine Learning · Computer Science 2021-05-03 Alvaro Cabrejas-Egea , Raymond Zhang , Neil Walton

This paper develops a novel methodology for using symbolic knowledge in deep learning. From first principles, we derive a semantic loss function that bridges between neural output vectors and logical constraints. This loss function captures…

Artificial Intelligence · Computer Science 2018-06-11 Jingyi Xu , Zilu Zhang , Tal Friedman , Yitao Liang , Guy Van den Broeck

Nonlinear dynamics is ubiquitous in nature and commonly seen in various science and engineering disciplines. Distilling analytical expressions that govern nonlinear dynamics from limited data remains vital but challenging. To tackle this…

Artificial Intelligence · Computer Science 2023-02-03 Fangzheng Sun , Yang Liu , Jian-Xun Wang , Hao Sun

Urban congestion remains a critical challenge, with traffic signal control (TSC) emerging as a potent solution. TSC is often modeled as a Markov Decision Process problem and then solved using reinforcement learning (RL), which has proven…

Artificial Intelligence · Computer Science 2024-07-09 Aoyu Pang , Maonan Wang , Man-On Pun , Chung Shue Chen , Xi Xiong

Model-based reinforcement learning (RL) methods that leverage search are responsible for many milestone breakthroughs in RL. Sequential Monte Carlo (SMC) recently emerged as an alternative to the Monte Carlo Tree Search (MCTS) algorithm…

Machine Learning · Computer Science 2026-05-22 Yaniv Oren , Joery A. de Vries , Pascal R. van der Vaart , Matthijs T. J. Spaan , Wendelin Böhmer

Signalized intersections are managed by controllers that assign right of way (green, yellow, and red lights) to non-conflicting directions. Optimizing the actuation policy of such controllers is expected to alleviate traffic congestion and…

Machine Learning · Computer Science 2020-02-28 James Ault , Josiah P. Hanna , Guni Sharon

Bridges, as critical components of civil infrastructure, are increasingly affected by deterioration, making reliable traffic monitoring essential for assessing their remaining service life. Among operational loads, traffic load plays a…

Machine Learning · Computer Science 2026-01-21 Hanshuo Wu , Xudong Jian , Christos Lataniotis , Cyprien Hoelzl , Eleni Chatzi , Yves Reuland

Traffic signal control TSC requires strategies that are both effective and interpretable for deployment, yet reinforcement learning produces opaque neural policies while program synthesis depends on restrictive domain-specific languages. We…

Artificial Intelligence · Computer Science 2026-04-08 Da Lei , Feng Xiao , Lu Li , Yuzhan Liu

The issue of traffic congestion poses a significant obstacle to the development of global cities. One promising solution to tackle this problem is intelligent traffic signal control (TSC). Recently, TSC strategies leveraging reinforcement…

Human-Computer Interaction · Computer Science 2024-10-03 Yutian Zhang , Guohong Zheng , Zhiyuan Liu , Quan Li , Haipeng Zeng

Traffic signal control aims to coordinate traffic signals across intersections to improve the traffic efficiency of a district or a city. Deep reinforcement learning (RL) has been applied to traffic signal control recently and demonstrated…

Machine Learning · Computer Science 2024-04-02 Liwen Zhu , Peixi Peng , Zongqing Lu , Xiangqian Wang , Yonghong Tian

Recent progress in deep reinforcement learning (DRL) can be largely attributed to the use of neural networks. However, this black-box approach fails to explain the learned policy in a human understandable way. To address this challenge and…

Artificial Intelligence · Computer Science 2021-03-17 Zhihao Ma , Yuzheng Zhuang , Paul Weng , Hankz Hankui Zhuo , Dong Li , Wulong Liu , Jianye Hao

Multi-agent reinforcement learning (MARL) has shown significant potential in traffic signal control (TSC). However, current MARL-based methods often suffer from insufficient generalization due to the fixed traffic patterns and road network…

Multiagent Systems · Computer Science 2025-03-13 Yihong Li , Chengwei Zhang , Furui Zhan , Wanting Liu , Kailing Zhou , Longji Zheng

Traffic signal control is of critical importance for the effective use of transportation infrastructures. The rapid increase of vehicle traffic and changes in traffic patterns make traffic signal control more and more challenging.…

Machine Learning · Computer Science 2021-12-08 Xingshuai Huang , Di Wu , Michael Jenkin , Benoit Boulet

With the aim of improving performance in Markov Decision Problem in an Off-Policy setting, we suggest taking inspiration from what is done in Offline Reinforcement Learning (RL). In Offline RL, it is a common practice during policy learning…

Artificial Intelligence · Computer Science 2024-10-29 Jérôme Arjonilla , Abdallah Saffidine , Tristan Cazenave