English
Related papers

Related papers: Hierarchical Control for Head-to-Head Autonomous R…

200 papers

We propose a multi-agent based computational framework for modeling decision-making and strategic interaction at micro level for smart vehicles in a smart world. The concepts of Markov game and best response dynamics are heavily leveraged.…

Multiagent Systems · Computer Science 2022-01-05 Qi Dai , Xunnong Xu , Wen Guo , Suzhou Huang , Dimitar Filev

Goal-conditioned hierarchical reinforcement learning (HRL) decomposes complex reaching tasks into a sequence of simple subgoal-conditioned tasks, showing significant promise for addressing long-horizon planning in large-scale environments.…

Machine Learning · Computer Science 2025-04-15 Haoran Wang , Yaoru Sun , Zeshen Tang , Haibo Shi , Chenyuan Jiao

Highway on-ramp merging areas are common bottlenecks to traffic congestion and accidents. Currently, a cooperative control strategy based on connected and automated vehicles (CAVs) is a fundamental solution to this problem. While CAVs are…

Robotics · Computer Science 2025-07-17 Tianyi Wang , Yangyang Wang , Jie Pan , Junfeng Jiao , Christian Claudel

The challenges presented in an autonomous racing situation are distinct from those faced in regular autonomous driving and require faster end-to-end algorithms and consideration of a longer horizon in determining optimal current actions…

Robotics · Computer Science 2021-12-01 Praveen Venkatesh , Rwik Rana , Harish PM

Autonomous racing presents a complex challenge involving multi-agent interactions between vehicles operating at the limit of performance and dynamics. As such, it provides a valuable research and testing environment for advancing autonomous…

This study introduces a haptic shared control framework designed to teach human drivers advanced driving skills. In this context, shared control refers to a driving mode where the human driver collaborates with an autonomous driving system…

Recent advances in Reinforcement Learning (RL) combined with Deep Learning (DL) have demonstrated impressive performance in complex tasks, including autonomous driving. The use of RL agents in autonomous driving leads to a smooth human-like…

Artificial Intelligence · Computer Science 2021-07-30 Briti Gangopadhyay , Harshit Soora , Pallab Dasgupta

The problem of autonomous racing is to navigate through a race course as quickly as possible while not colliding with any obstacles. We approach the autonomous racing problem with the added constraint of not maintaining an updated obstacle…

Robotics · Computer Science 2024-10-28 Benjamin Evans , Hendrik W. Jordaan , Herman A. Engelbrecht

Two-vehicle racing is natural example of a competitive dynamic game. As with most dynamic games, there are many ways in which the underlying solution concept can be structured, resulting in different equilibrium concepts. The assumed…

Computer Science and Game Theory · Computer Science 2025-03-11 Andrew Cinar , Forrest Laine

It is recognized that the control of mixed-autonomy platoons comprising connected and automated vehicles (CAVs) and human-driven vehicles (HDVs) can enhance traffic flow. Among existing methods, Multi-Agent Reinforcement Learning (MARL)…

Systems and Control · Electrical Eng. & Systems 2024-11-18 Jingyuan Zhou , Longhao Yan , Jinhao Liang , Kaidi Yang

In this paper we present a hierarchical multi-rate control architecture for nonlinear autonomous systems operating in partially observable environments. Control objectives are expressed using syntactically co-safe Linear Temporal Logic…

Systems and Control · Electrical Eng. & Systems 2022-07-04 Ugo Rosolia , Andrew Singletary , Aaron D. Ames

Autonomous ground vehicles (AGVs) are receiving increasing attention, and the motion planning and control problem for these vehicles has become a hot research topic. In real applications such as material handling, an AGV is subject to large…

Robotics · Computer Science 2021-08-24 Juncheng Li , Maopeng Ran , Lihua Xie

This paper presents a novel planning and control strategy for competing with multiple vehicles in a car racing scenario. The proposed racing strategy switches between two modes. When there are no surrounding vehicles, a learning-based model…

Robotics · Computer Science 2022-03-29 Suiyi He , Jun Zeng , Koushil Sreenath

Decision-making for autonomous driving is challenging, considering the complex interactions among multiple traffic agents (e.g., autonomous vehicles (AVs), human drivers, and pedestrians) and the computational load needed to evaluate these…

Systems and Control · Electrical Eng. & Systems 2023-11-13 Mushuang Liu , Ilya Kolmanovsky , H. Eric Tseng , Suzhou Huang , Dimitar Filev , Anouck Girard

Robotic in-hand manipulation has been a long-standing challenge due to the complexity of modelling hand and object in contact and of coordinating finger motion for complex manipulation sequences. To address these challenges, the majority of…

Robotics · Computer Science 2019-10-25 Tingguang Li , Krishnan Srinivasan , Max Qing-Hu Meng , Wenzhen Yuan , Jeannette Bohg

Hierarchical reinforcement learning (RL) can accelerate long-horizon decision-making by temporally abstracting a policy into multiple levels. Promising results in sparse reward environments have been seen with skills, i.e. sequences of…

Machine Learning · Computer Science 2024-07-15 Ce Hao , Catherine Weaver , Chen Tang , Kenta Kawamoto , Masayoshi Tomizuka , Wei Zhan

Deep reinforcement learning (DRL) allows a system to interact with its environment and take actions by training an efficient policy that maximizes self-defined rewards. In autonomous driving, it can be used as a strategy for high-level…

Robotics · Computer Science 2024-07-02 Xibo Li , Shruti Patel , Christof Büskens

Autonomous racing is a research field gaining large popularity, as it pushes autonomous driving algorithms to their limits and serves as a catalyst for general autonomous driving. For scaled autonomous racing platforms, the computational…

While autonomous vehicles still struggle to solve challenging situations during on-road driving, humans have long mastered the essence of driving with efficient, transferable, and adaptable driving capability. By mimicking humans' cognition…

Robotics · Computer Science 2022-02-15 Letian Wang , Yeping Hu , Liting Sun , Wei Zhan , Masayoshi Tomizuka , Changliu Liu

For safe and efficient planning and control in autonomous driving, we need a driving policy which can achieve desirable driving quality in long-term horizon with guaranteed safety and feasibility. Optimization-based approaches, such as…

Artificial Intelligence · Computer Science 2017-07-11 Liting Sun , Cheng Peng , Wei Zhan , Masayoshi Tomizuka