English
Related papers

Related papers: Spatial Influence-aware Reinforcement Learning for…

200 papers

The next generation networks offers significant potential to advance Intelligent Transportation Systems (ITS), particularly through the integration of Digital Twins (DTs). However, ensuring the uninterrupted operation of DTs through…

Networking and Internet Architecture · Computer Science 2025-08-18 Mohammad Sajid Shahriar , Suresh Subramaniam , Motoharu Matsuura , Hiroshi Hasegawa , Shih-Chun Lin

The shortest-time route recommendations offered by modern navigation systems fuel selfish routing in urban vehicular traffic networks and are therefore one of the main reasons for the growth of congestion. In contrast, intelligent…

Computer Science and Game Theory · Computer Science 2025-04-16 Doris E. M. Brown , Venkata Sriram Siddhardh Nadendla , Sajal K. Das

This paper proposes implicit cooperation, a framework enabling decentralized agents to approximate optimal coordination in local energy markets without explicit peer-to-peer communication. We formulate the problem as a decentralized…

Systems and Control · Electrical Eng. & Systems 2026-02-19 Nelson Salazar-Pena , Alejandra Tabares , Andres Gonzalez-Mancera

The future of mobility-as-a-Service (Maas)should embrace an integrated system of ride-hailing, street-hailing and ride-sharing with optimised intelligent vehicle routing in response to a real-time, stochastic demand pattern. We aim to…

Machine Learning · Computer Science 2020-10-23 Shen Ren , Qianxiao Li , Liye Zhang , Zheng Qin , Bo Yang

Connected and automated vehicles (CAVs) have attracted more and more attention recently. The fast actuation time allows them having the potential to promote the efficiency and safety of the whole transportation system. Due to technical…

Machine Learning · Statistics 2021-10-26 Tianyu Shi , Jiawei Wang , Yuankai Wu , Luis Miranda-Moreno , Lijun Sun

Despite advances in hierarchical reinforcement learning, its applications to path planning in autonomous driving on highways are challenging. One reason is that conventional hierarchical reinforcement learning approaches are not amenable to…

Machine Learning · Computer Science 2021-11-11 Jaehyun Kim , Jaeseung Jeong

Road congestion induces significant costs across the world, and road network disturbances, such as traffic accidents, can cause highly congested traffic patterns. If a planner had control over the routing of all vehicles in the network,…

Optimization and Control · Mathematics 2021-06-07 Daniel A. Lazar , Erdem Bıyık , Dorsa Sadigh , Ramtin Pedarsani

The increasing complexity of Intelligent Transportation Systems (ITS) has led to significant interest in computational offloading to external infrastructures such as edge servers, vehicular nodes, and UAVs. These dynamic and heterogeneous…

Machine Learning · Computer Science 2026-05-27 Ashab Uddin , Ahmed Hamdi Sakr , Ning Zhang

Load Balancing is a fundamental technology for scaling cloud infrastructure. It enables systems to distribute incoming traffic across backend servers using predefined algorithms such as round robin, weighted round robin, least connections,…

Networking and Internet Architecture · Computer Science 2025-05-14 Raju Singh

Considerable research efforts have been devoted to the development of motion planning algorithms, which form a cornerstone of the autonomous driving system (ADS). Nonetheless, acquiring an interactive and secure trajectory for the ADS…

Robotics · Computer Science 2024-02-19 Yingbing Chen , Jie Cheng , Lu Gan , Sheng Wang , Hongji Liu , Xiaodong Mei , Ming Liu

Mobile power sources (MPSs) have been gradually deployed in microgrids as critical resources to coordinate with repair crews (RCs) towards resilience enhancement owing to their flexibility and mobility in handling the complex coupled…

Systems and Control · Electrical Eng. & Systems 2025-07-25 Yi Wang , Dawei Qiu , Fei Teng , Goran Strbac

Deep reinforcement learning (DRL) provides a promising way for intelligent agents (e.g., autonomous vehicles) to learn to navigate complex scenarios. However, DRL with neural networks as function approximators is typically considered a…

Robotics · Computer Science 2023-11-28 Jiachen Li , David Isele , Kanghoon Lee , Jinkyoo Park , Kikuo Fujimura , Mykel J. Kochenderfer

Decision making in dense traffic can be challenging for autonomous vehicles. An autonomous system only relying on predefined road priorities and considering other drivers as moving objects will cause the vehicle to freeze and fail the…

Robotics · Computer Science 2019-06-27 Maxime Bouton , Alireza Nakhaei , Kikuo Fujimura , Mykel J. Kochenderfer

The paper studies the problem of designing the Intelligent Reflecting Surface (IRS) phase shifters for Multiple Input Single Output (MISO) communication systems in spatiotemporally correlated channel environments, where the destination can…

Information Theory · Computer Science 2022-11-18 Spilios Evmorfos , Athina P. Petropulu , H. Vincent Poor

The paper considers independent reinforcement learning (IRL) for multi-agent collaborative decision-making in the paradigm of federated learning (FL). However, FL generates excessive communication overheads between agents and a remote…

Machine Learning · Computer Science 2023-05-30 Xing Xu , Rongpeng Li , Zhifeng Zhao , Honggang Zhang

Navigating through intersections is one of the main challenging tasks for an autonomous vehicle. However, for the majority of intersections regulated by traffic lights, the problem could be solved by a simple rule-based method in which the…

Robotics · Computer Science 2021-05-04 Alessandro Paolo Capasso , Paolo Maramotti , Anthony Dell'Eva , Alberto Broggi

Urban congestion remains a critical challenge, with traffic signal control (TSC) emerging as a potent solution. TSC is often modeled as a Markov Decision Process problem and then solved using reinforcement learning (RL), which has proven…

Artificial Intelligence · Computer Science 2024-07-09 Aoyu Pang , Maonan Wang , Man-On Pun , Chung Shue Chen , Xi Xiong

Routing strategies for traffics and vehicles have been historically studied. However, in the absence of considering drivers' preferences, current route planning algorithms are developed under ideal situations where all drivers are expected…

Robotics · Computer Science 2021-05-04 Jizhe Zhou , Qiwei Chen , Qin Li

Urban traffic congestion is a critical predicament that plagues modern road networks. To alleviate this issue and enhance traffic efficiency, traffic signal control and vehicle routing have proven to be effective measures. In this paper, we…

Systems and Control · Electrical Eng. & Systems 2023-10-18 Xianyue Peng , Hang Gao , Gengyue Han , Hao Wang , Michael Zhang

Intelligent Traffic Light Control System (ITLCS) is a typical Multi-Agent System (MAS), which comprises multiple roads and traffic lights.Constructing a model of MAS for ITLCS is the basis to alleviate traffic congestion. Existing…

Machine Learning · Computer Science 2022-07-06 Ruijie Zhu , Lulu Li , Shuning Wu , Pei Lv , Yafai Li , Mingliang Xu