English
Related papers

Related papers: Decision Making for Autonomous Driving in Interact…

200 papers

We consider the problem of interaction-aware motion planning for automated vehicles in general traffic situations. We model the interaction between the controlled vehicle and surrounding road users using a generalized potential game, in…

Optimization and Control · Mathematics 2023-05-09 Brecht Evens , Mathijs Schuurmans , Panagiotis Patrinos

Deep reinforcement learning (DRL) has a great potential for solving complex decision-making problems in autonomous driving, especially in mixed-traffic scenarios where autonomous vehicles and human-driven vehicles (HDVs) drive together.…

Robotics · Computer Science 2022-04-05 Qianqian Liu , Fengying Dang , Xiaofan Wang , Xiaoqiang Ren

Partially observable Markov decision processes (POMDPs) provide an elegant mathematical framework for modeling complex decision and planning problems in stochastic domains in which states of the system are observable only indirectly, via a…

Artificial Intelligence · Computer Science 2011-06-02 M. Hauskrecht

Autonomous driving is a multi-agent setting where the host vehicle must apply sophisticated negotiation skills with other road users when overtaking, giving way, merging, taking left and right turns and while pushing ahead in unstructured…

Artificial Intelligence · Computer Science 2016-10-12 Shai Shalev-Shwartz , Shaked Shammah , Amnon Shashua

Most reinforcement learning (RL) approaches for the decision-making of autonomous driving consider safety as a reward instead of a cost, which makes it hard to balance the tradeoff between safety and other objectives. Human risk preference…

Robotics · Computer Science 2025-03-05 Yang Li , Shijie Yuan , Yuan Chang , Xiaolong Chen , Qisong Yang , Zhiyuan Yang , Hongmao Qin

In order to drive safely and efficiently under merging scenarios, autonomous vehicles should be aware of their surroundings and make decisions by interacting with other road participants. Moreover, different strategies should be made when…

Machine Learning · Computer Science 2020-02-24 Yeping Hu , Alireza Nakhaei , Masayoshi Tomizuka , Kikuo Fujimura

Navigating dense and dynamic environments poses a significant challenge for autonomous driving systems, owing to the intricate nature of multimodal interaction, wherein the actions of various traffic participants and the autonomous vehicle…

Robotics · Computer Science 2024-08-29 Tong Li , Lu Zhang , Sikang Liu , Shaojie Shen

Properly calibrated human trust is essential for successful interaction between humans and automation. However, while human trust calibration can be improved by increased automation transparency, too much transparency can overwhelm human…

Human-Computer Interaction · Computer Science 2023-04-17 Kumar Akash , Neera Jain , Teruhisa Misu

We investigate improving Monte Carlo Tree Search based solvers for Partially Observable Markov Decision Processes (POMDPs), when applied to adaptive sampling problems. We propose improvements in rollout allocation, the action exploration…

Robotics · Computer Science 2021-09-27 Gautam Salhotra , Christopher E. Denniston , David A. Caron , Gaurav S. Sukhatme

Interactive partially observable Markov decision processes (I-POMDP) provide a formal framework for planning for a self-interested agent in multiagent settings. An agent operating in a multiagent environment must deliberate about the…

Multiagent Systems · Computer Science 2015-04-06 Ekhlas Sonu , Yingke Chen , Prashant Doshi

Humans make daily routine decisions based on their internal states in intricate interaction scenarios. This paper presents a probabilistically reconstructive learning approach to identify the internal states of multi-vehicle sequential…

Robotics · Computer Science 2021-08-17 Huanjie Wang , Wenshuo Wang , Shihua Yuan , Xueyuan Li

Merging at highway on-ramps while interacting with other human-driven vehicles is challenging for autonomous vehicles (AVs). An efficient route to this challenge requires exploring and exploiting knowledge of the interaction process from…

Robotics · Computer Science 2021-08-04 Huanjie Wang , Wenshuo Wang , Shihua Yuan , Xueyuan Li , Lijun Sun

Traditionally, prediction and planning in autonomous driving (AD) have been treated as separate, sequential modules. Recently, there has been a growing shift towards tighter integration of these components, known as Integrated Prediction…

Decision-making under uncertainty is a crucial ability for autonomous systems. In its most general form, this problem can be formulated as a Partially Observable Markov Decision Process (POMDP). The solution policy of a POMDP can be…

Robotics · Computer Science 2019-04-09 Sung-Kyun Kim , Rohan Thakker , Ali-akbar Agha-mohammadi

Partially observable Markov decision processes have been widely used to provide models for real-world decision making problems. In this paper, we will provide a method in which a slightly different version of them called Mixed observability…

Artificial Intelligence · Computer Science 2012-06-06 Pouyan Rafiei Fard , Keyvan Yahya

This paper proposes a comprehensive hierarchical control framework for autonomous decision-making arising in robotics and autonomous systems. In a typical hierarchical control architecture, high-level decision making is often characterised…

Systems and Control · Electrical Eng. & Systems 2024-09-21 Xue-Fang Wang , Jingjing Jiang , Wen-Hua Chen

One of the primary challenges in urban autonomous vehicle decision-making and planning lies in effectively managing intricate interactions with diverse traffic participants characterized by unpredictable movement patterns. Additionally,…

Multiagent Systems · Computer Science 2025-05-19 Keqi Shu , Minghao Ning , Ahmad Alghooneh , Shen Li , Mohammad Pirani , Amir Khajepour

Autonomous agents often operate in scenarios where the state is partially observed. In addition to maximizing their cumulative reward, agents must execute complex tasks with rich temporal and logical structures. These tasks can be expressed…

Systems and Control · Electrical Eng. & Systems 2022-03-18 Krishna C. Kalagarla , Dhruva Kartik , Dongming Shen , Rahul Jain , Ashutosh Nayyar , Pierluigi Nuzzo

The design of autonomous agents that can interact effectively with other agents without prior coordination is a core problem in multi-agent systems. Type-based reasoning methods achieve this by maintaining a belief over a set of potential…

Artificial Intelligence · Computer Science 2023-06-12 Jonathon Schwartz , Hanna Kurniawati , Marcus Hutter

As general purpose robots become more capable, pre-programming of all tasks at the factory will become less practical. We would like for non-technical human owners to be able to communicate, through interaction with their robot, the details…

Robotics · Computer Science 2012-04-03 Mark P. Woodward , Robert J. Wood