English
Related papers

Related papers: Hierarchical Strategic Decision-Making in Layered …

200 papers

This paper presents a novel integrated approach to deal with the decision making and motion planning for lane-change maneuvers of autonomous vehicle (AV) considering social behaviors of surrounding traffic occupants. Reflected by driving…

Systems and Control · Electrical Eng. & Systems 2020-05-25 Peng Hang , Chen Lv , Chao Huang , Jiacheng Cai , Zhongxu Hu , Yang Xing

Closed-loop traffic simulation requires agents that are both scalable and behaviorally realistic. Recent self-play reinforcement learning approaches demonstrate strong scalability, but their equilibrium strategies fail to capture the…

Robotics · Computer Science 2026-05-12 Weifan Zhang , Xiaofeng Zhao , Adel Bazzi , Mingrui Li , Yifan Wei , Dengfeng Sun

The rapid adoption of electric vehicles (EVs) introduces complex spatiotemporal demand management challenges for charging station operators (CSOs), exacerbated by demand imbalances, behavioral heterogeneity, and system uncertainty.…

Computer Science and Game Theory · Computer Science 2026-01-21 Yongqi Zhang , Dong Ngoduy , Li Duan , Mingchang Zhu , Zhuo Chen

We propose a multi-agent based computational framework for modeling decision-making and strategic interaction at micro level for smart vehicles in a smart world. The concepts of Markov game and best response dynamics are heavily leveraged.…

Multiagent Systems · Computer Science 2022-01-05 Qi Dai , Xunnong Xu , Wen Guo , Suzhou Huang , Dimitar Filev

We develop a normative framework for hierarchical model-based policy optimization based on applying second-order methods in the space of all possible state-action paths. The resulting natural path gradient performs policy updates in a…

Machine Learning · Computer Science 2020-01-03 Daniel McNamee

Electric Vehicles' (EVs) growing number has various consequences, from reducing greenhouse gas emissions and local pollution to altering traffic congestion and electricity consumption. More specifically, decisions of operators from both the…

Optimization and Control · Mathematics 2021-12-13 Benoît Sohet , Yezekael Hayel , Olivier Beaude , Alban Jeandin

Behavior planning and decision-making are some of the biggest challenges for highly automated systems. A fully automated vehicle (AV) is confronted with numerous tactical and strategical choices. Most state-of-the-art AV platforms implement…

Robotics · Computer Science 2021-02-08 Piotr Franciszek Orzechowski , Christoph Burger , Martin Lauer

Balancing passenger demand and vehicle availability is crucial for ensuring the sustainability and effectiveness of urban transportation systems. To address this challenge, we propose a novel hierarchical strategy for the efficient…

Systems and Control · Electrical Eng. & Systems 2024-06-17 Pengbo Zhu , Giancarlo Ferrari-Trecate , Nikolas Geroliminis

Stackelberg games are a classic example of bilevel optimization problems, which are often encountered in game theory and economics. These are complex problems with a hierarchical structure, where one optimization task is nested within the…

Computer Science and Game Theory · Computer Science 2013-07-25 Ankur Sinha , Pekka Malo , Anton Frantsev , Kalyanmoy Deb

Network-based systems are inherently interconnected, with the design and performance of subnetworks being interdependent. However, the decisions of self-interested operators may lead to suboptimal outcomes for users and the overall system.…

Systems and Control · Electrical Eng. & Systems 2026-02-11 Mingjia He , Andrea Censi , Runyu Zhang , Emilio Frazzoli , Gioele Zardini

This paper presents a hierarchical decision-making framework for autonomous systems operating under uncertainty, demonstrated through autonomous driving as a representative application. Surrounding agents are modeled using Hybrid Markov…

Systems and Control · Electrical Eng. & Systems 2026-03-19 Siyuan Li , Chengyuan Liu , Wen-Hua Chen

This paper presents an interaction-aware energy management optimization framework for Formula 1 racing. The considered scenario involves two agents and a drag reduction model. Strategic interactions between the agents are captured by a…

Systems and Control · Electrical Eng. & Systems 2025-08-21 Giona Fieni , Marc-Philippe Neumann , Alessandro Zanardi , Alberto Cerofolini , Christopher H. Onder

Motion generation in cluttered, dense, and dynamic environments is a central topic in robotics, rendered as a multi-objective decision-making problem. Current approaches trade-off between safety and performance. On the one hand, reactive…

Robotics · Computer Science 2024-07-30 Kay Hansel , Julen Urain , Jan Peters , Georgia Chalvatzaki

We study transportation networks controlled by dynamical feedback tolls. We consider a multiscale transportation network model whereby the dynamics of the traffic flows are intertwined with those of the drivers' route choices. The latter…

Optimization and Control · Mathematics 2019-01-30 Rosario Maggistro , Giacomo Como

While multimodal mobility systems have the potential to bring many benefits to travelers, drivers, the environment, and traffic congestion, such systems typically involve multiple non-cooperative decision-makers who may selfishly optimize…

Methodology · Statistics 2026-01-08 Md Nafees Fuad Rafi , Zhaomiao Guo

Urban mobility is undergoing rapid transformation with the emergence of new services. Mobility hubs (MHs) have been proposed as physical-digital convergence points, offering a range of public and private mobility options in close proximity.…

Optimization and Control · Mathematics 2026-03-26 Hai Yang , Joseph Y. J. Chow

The actions of an autonomous vehicle on the road affect and are affected by those of other drivers, whether overtaking, negotiating a merge, or avoiding an accident. This mutual dependence, best captured by dynamic game theory, creates a…

Robotics · Computer Science 2018-10-16 Jaime F. Fisac , Eli Bronstein , Elis Stefansson , Dorsa Sadigh , S. Shankar Sastry , Anca D. Dragan

Although multi-tier vehicular Metaverse promises to transform vehicles into essential nodes -- within an interconnected digital ecosystem -- using efficient resource allocation and seamless vehicular twin (VT) migration, this can hardly be…

Networking and Internet Architecture · Computer Science 2025-02-27 Nahom Abishu Hayla , A. Mohammed Seid , Aiman Erbad , Tilahun M. Getu , Ala Al-Fuqaha , Mohsen Guizani

Governments are motivated to subsidize profit-driven firms that manufacture zero-emission vehicles to ensure they become price-competitive. This paper introduces a dynamic Stackelberg game to determine the government's optimal subsidy…

Optimization and Control · Mathematics 2025-10-21 Utsav Sadana , Georges Zaccour

In modern buildings renewable energy generators and storage devices are spreading, and consequently the role of the users in the power grid is shifting from passive to active. We design a demand response scheme that exploits the prosumers'…

Systems and Control · Electrical Eng. & Systems 2022-11-10 Marta Fochesato , Carlo Cenedese , John Lygeros