English
Related papers

Related papers: Scalable Deep Reinforcement Learning for Ride-Hail…

200 papers

Ride-hailing is a sustainable transportation paradigm where riders access door-to-door traveling services through a mobile phone application, which has attracted a colossal amount of usage. There are two major planning tasks in a…

Machine Learning · Computer Science 2023-03-28 Dacheng Wen , Yupeng Li , Francis C. M. Lau

Ride-hailing services are growing rapidly and becoming one of the most disruptive technologies in the transportation realm. Accurate prediction of ride-hailing trip demand not only enables cities to better understand people's activity…

Machine Learning · Computer Science 2019-11-11 Chao Wang , Yi Hou , Matthew Barth

The increasing complexity of Intelligent Transportation Systems (ITS) has led to significant interest in computational offloading to external infrastructures such as edge servers, vehicular nodes, and UAVs. These dynamic and heterogeneous…

Machine Learning · Computer Science 2026-05-27 Ashab Uddin , Ahmed Hamdi Sakr , Ning Zhang

Cellular Vehicle-to-Everything (C-V2X) is currently at the forefront of the digital transformation of our society. By enabling vehicles to communicate with each other and with the traffic environment using cellular networks, we redefine…

Artificial Intelligence · Computer Science 2025-06-10 Cyril Shih-Huan Hsu , Jorge Martín-Pérez , Danny De Vleeschauwer , Luca Valcarenghi , Xi Li , Chrysa Papagianni

Electric Vehicles (EVs) are becoming increasingly prevalent nowadays, with studies highlighting their potential as mobile energy storage systems to provide grid support. Realising this potential requires effective charging coordination,…

Systems and Control · Electrical Eng. & Systems 2025-07-22 Jun Kang Yap , Vishnu Monn Baskaran , Wen Shan Tan , Ze Yang Ding , Hao Wang , David L. Dowe

The ubiquitous growth of mobility-on-demand services for passenger and goods delivery has brought various challenges and opportunities within the realm of transportation systems. As a result, intelligent transportation systems are being…

Artificial Intelligence · Computer Science 2021-11-15 Kaushik Manchella , Marina Haliem , Vaneet Aggarwal , Bharat Bhargava

The explosive growth of dynamic and heterogeneous data traffic brings great challenges for 5G and beyond mobile networks. To enhance the network capacity and reliability, we propose a learning-based dynamic time-frequency division duplexing…

Machine Learning · Computer Science 2023-03-22 Ziyan Yin , Zhe Wang , Jun Li , Ming Ding , Wen Chen , Shi Jin

This paper presents a Predictive Maneuver Planning with Deep Reinforcement Learning (PMP-DRL) model for maneuver planning. Traditional rule-based maneuver planning approaches often have to improve their abilities to handle the variabilities…

Reinforcement learning (RL) algorithms have been around for decades and employed to solve various sequential decision-making problems. These algorithms however have faced great challenges when dealing with high-dimensional environments. The…

Machine Learning · Computer Science 2020-04-01 Thanh Thi Nguyen , Ngoc Duy Nguyen , Saeid Nahavandi

Autonomous driving is a multi-agent setting where the host vehicle must apply sophisticated negotiation skills with other road users when overtaking, giving way, merging, taking left and right turns and while pushing ahead in unstructured…

Artificial Intelligence · Computer Science 2016-10-12 Shai Shalev-Shwartz , Shaked Shammah , Amnon Shashua

This paper targets the efficient construction of a safety shield for decision making in scenarios that incorporate uncertainty. Markov decision processes (MDPs) are prominent models to capture such planning problems. Reinforcement learning…

Artificial Intelligence · Computer Science 2019-11-26 Nils Jansen , Bettina Könighofer , Sebastian Junges , Alexandru C. Serban , Roderick Bloem

We propose an actor-critic, model-free, and online Reinforcement Learning (RL) framework for continuous-state continuous-action Markov Decision Processes (MDPs) when the reward is highly sparse but encompasses a high-level temporal…

Machine Learning · Computer Science 2019-11-26 Lim Zun Yuan , Mohammadhosein Hasanbeig , Alessandro Abate , Daniel Kroening

Urban autonomous driving decision making is challenging due to complex road geometry and multi-agent interactions. Current decision making methods are mostly manually designing the driving policy, which might result in sub-optimal solutions…

Machine Learning · Computer Science 2019-10-23 Jianyu Chen , Bodi Yuan , Masayoshi Tomizuka

Rideshare platforms such as Uber and Lyft dynamically dispatch drivers to match riders' requests. We model the dispatching process in rideshare as a Markov chain that takes into account the geographic mobility of both drivers and riders…

Data Structures and Algorithms · Computer Science 2019-12-03 Michael J. Curry , John P. Dickerson , Karthik Abinav Sankararaman , Aravind Srinivasan , Yuhao Wan , Pan Xu

Collaborative vehicle routing occurs when carriers collaborate through sharing their transportation requests and performing transportation requests on behalf of each other. This achieves economies of scale, thus reducing cost, greenhouse…

Machine Learning · Computer Science 2023-10-27 Stephen Mak , Liming Xu , Tim Pearce , Michael Ostroumov , Alexandra Brintrup

Bike-sharing systems play a crucial role in easing traffic congestion and promoting healthier lifestyles. However, ensuring their reliability and user acceptance requires effective strategies for rebalancing bikes. This study introduces a…

Machine Learning · Computer Science 2024-06-04 Jiaqi Liang , Defeng Liu , Sanjay Dominik Jena , Andrea Lodi , Thibaut Vidal

Predictive autoscaling (autoscaling with workload forecasting) is an important mechanism that supports autonomous adjustment of computing resources in accordance with fluctuating workload demands in the Cloud. In recent works, Reinforcement…

This paper applies deep reinforcement learning (DRL) to optimize liquidity provisioning in Uniswap v3, a decentralized finance (DeFi) protocol implementing an automated market maker (AMM) model with concentrated liquidity. We model the…

Computational Finance · Quantitative Finance 2025-01-14 Haonan Xu , Alessio Brini

The digital transformation is pushing the existing network technologies towards new horizons, enabling new applications (e.g., vehicular networks). As a result, the networking community has seen a noticeable increase in the requirements of…

Networking and Internet Architecture · Computer Science 2021-09-01 Paul Almasan , José Suárez-Varela , Bo Wu , Shihan Xiao , Pere Barlet-Ros , Albert Cabellos-Aparicio

Existing automatic 3D image segmentation methods usually fail to meet the clinic use. Many studies have explored an interactive strategy to improve the image segmentation performance by iteratively incorporating user hints. However, the…

Computer Vision and Pattern Recognition · Computer Science 2019-11-26 Xuan Liao , Wenhao Li , Qisen Xu , Xiangfeng Wang , Bo Jin , Xiaoyun Zhang , Ya Zhang , Yanfeng Wang