English
Related papers

Related papers: Approximate Dynamic Programming for a Mean-field G…

200 papers

Avoiding congestion and controlling traffic in urban scenarios is becoming nowadays of paramount importance due to the rapid growth of our cities' population and vehicles. The effective control of urban traffic as a means to mitigate…

Artificial Intelligence · Computer Science 2022-08-08 Matteo Cardellini

We propose two novel numerical schemes for approximate implementation of the dynamic programming~(DP) operation concerned with finite-horizon, optimal control of discrete-time systems with input-affine dynamics. The proposed algorithms…

Optimization and Control · Mathematics 2022-03-18 M. A. S. Kolarijani , P. Mohajerin Esfahani

In this paper we consider a mean field optimal control problem with an aggregation-diffusion constraint, where agents interact through a potential, in the presence of a Gaussian noise term. Our analysis focuses on a PDE system coupling a…

Analysis of PDEs · Mathematics 2019-09-25 Jose A. Carrillo , Edgard A. Pimentel , Vardan K. Voskanyan

When a vehicle drives on the road, its behaviors will be affected by surrounding vehicles. Prediction and decision should not be considered as two separate stages because all vehicles make decisions interactively. This paper constructs the…

Artificial Intelligence · Computer Science 2023-02-09 Xujie Song , Zexi Lin

In this paper we consider a mean field approach to modeling the agents flow over a transportation network. In particular, beside a standard framework of mean field games, with controlled dynamics by the agents and costs mass-distribution…

Optimization and Control · Mathematics 2020-06-18 Fabio Bagagiolo , Rosario Maggistro , Raffaele Pesenti

Control problems of mixed-autonomy traffic systems that consist of both human-driven vehicles (HV) and autonomous vehicles (AV), have gained increasing attention. This paper focuses on suppressing traffic oscillations in the mixed-autonomy…

Systems and Control · Electrical Eng. & Systems 2024-09-17 Yihuai Zhang , Huan Yu

Leveraging the concept of the macroscopic fundamental diagram (MFD), perimeter control can alleviate network-level congestion by identifying critical intersections and regulating them effectively. Considering the time-varying nature of…

Systems and Control · Electrical Eng. & Systems 2025-05-29 Can Chen , Yunping Huang , Hongwei Zhang , Shimin Wang , Martin Guay , Shu-Chien Hsu , Renxin Zhong

We propose GameOpt: a novel hybrid approach to cooperative intersection control for dynamic, multi-lane, unsignalized intersections. Safely navigating these complex and accident prone intersections requires simultaneous trajectory planning…

Robotics · Computer Science 2022-03-21 Nilesh Suriyarachchi , Rohan Chandra , John S. Baras , Dinesh Manocha

Traffic congestion and collisions represent significant economic, environmental, and social challenges worldwide. Traditional traffic management approaches have shown limited success in addressing these complex, dynamic problems. To address…

Machine Learning · Computer Science 2025-06-05 Mira Nuthakki

Approximate dynamic programming (ADP) faces challenges in dealing with constraints in control problems. Model predictive control (MPC) is, in comparison, well-known for its accommodation of constraints and stability guarantees, although its…

Systems and Control · Electrical Eng. & Systems 2023-04-10 Kanghui He , Shengling Shi , Ton van den Boom , Bart De Schutter

The collective behavior of human-driven vehicles (HVs) produces the well-known stop-and-go waves potentially leading to higher fuel consumption and emissions. This paper investigates the stabilization of traffic flow via a minimum number of…

Systems and Control · Electrical Eng. & Systems 2024-11-15 MirSaleh Bahavarnia , Ahmad F. Taha

We develop a new Approximate Dynamic Programming (ADP) method for infinite horizon discounted reward Markov Decision Processes (MDP) based on projection onto a subsemimodule. We approximate the value function in terms of a $(\min,+)$ linear…

Systems and Control · Computer Science 2014-03-18 Chandrashekar Lakshminarayanan , Shalabh Bhatnagar

Transitions between two lanes often have a significant impact on various forms of road traffic. To address this problem, we have developed a two-lane asymmetric simple exclusion process model and two hypothetical traffic control strategies,…

Physics and Society · Physics 2022-12-14 Yuming Dong , Xiaolu Jia , Daichi Yanagisawa , Akihito Nagahama , Katsuhiro Nishinari

A multi-class single-server queueing model with finite buffers, in which scheduling and admission of customers are subject to control, is studied in the moderate deviation heavy traffic regime. A risk-sensitive cost set over a finite time…

Probability · Mathematics 2018-05-02 Rami Atar , Asaf Cohen

Urban traffic congestion remains a pressing challenge in our rapidly expanding cities, despite the abundance of available data and the efforts of policymakers. By leveraging behavioral system theory and data-driven control, this paper…

Systems and Control · Electrical Eng. & Systems 2023-11-17 Alessio Rimoldi , Carlo Cenedese , Alberto Padoan , Florian Dörfler , John Lygeros

For a foreseeable future, autonomous vehicles (AVs) will operate in traffic together with human-driven vehicles. Their planning and control systems need extensive testing, including early-stage testing in simulations where the interactions…

Robotics · Computer Science 2020-07-21 Ran Tian , Nan Li , Ilya Kolmanovsky , Yildiray Yildiz , Anouck Girard

In this paper we propose two numerical algorithms to solve a coupled PDE-ODE system which models a slow vehicle (bottleneck) moving on a road together with other cars. The resulting system is fully coupled because the dynamics of the slow…

Dynamical Systems · Mathematics 2021-03-22 Gabriella Bretti , Emiliano Cristiani , Corrado Lattanzio , Amelio Maurizi , Benedetto Piccoli

Mean field control (MFC) problems have been introduced to study social optima in very large populations of strategic agents. The main idea is to consider an infinite population and to simplify the analysis by using a mean field…

Optimization and Control · Mathematics 2023-03-01 Sebastian Baudelet , Brieuc Frénais , Mathieu Laurière , Amal Machtalay , Yuchen Zhu

This article aims at quantifying the long time behavior of solutions of mean field PDE systems arising in the theory of Mean Field Games and McKean-Vlasov control. Our main contribution is to show well-posedness of the ergodic problem and…

Probability · Mathematics 2024-09-17 Alekos Cecchin , Giovanni Conforti , Alain Durmus , Katharina Eichinger

How to free a road from vehicle traffic as efficiently as possible and in a given time, in order to allow for example the passage of emergency vehicles? We are interested in this question which we reformulate as an optimal control problem.…

Optimization and Control · Mathematics 2023-10-25 Mickael Bestard , Emmanuel Franck , Laurent Navoret , Yannick Privat