English
Related papers

Related papers: Separating the World and Ego Models for Self-Drivi…

200 papers

Motion prediction and cost evaluation are vital components in the decision-making system of autonomous vehicles. However, existing methods often ignore the importance of cost learning and treat them as separate modules. In this study, we…

Robotics · Computer Science 2024-02-27 Zhiyu Huang , Peter Karkus , Boris Ivanovic , Yuxiao Chen , Marco Pavone , Chen Lv

To drive safely in complex traffic environments, autonomous vehicles need to make an accurate prediction of the future trajectories of nearby heterogeneous traffic agents (i.e., vehicles, pedestrians, bicyclists, etc). Due to the…

Machine Learning · Computer Science 2023-03-31 Zihao Sheng , Zilin Huang , Sikai Chen

Autonomous driving requires reasoning about how the environment evolves and planning actions accordingly. Existing world-model-based approaches typically predict future scenes first and plan afterwards, resulting in open-loop imagination…

Robotics · Computer Science 2026-03-31 Qiqi Liu , Huan Xu , Jingyu Li , Bin Sun , Zhihui Hao , Dangen She , Xiatian Zhu , Li Zhang

Trajectory planning in autonomous driving is highly dependent on predicting the emergent behavior of other road users. Learning-based methods are currently showing impressive results in simulation-based challenges, with transformer-based…

Machine Learning · Computer Science 2024-08-08 Lars Ullrich , Alex McMaster , Knut Graichen

Predicting the future to anticipate the outcome of events and actions is a critical attribute of autonomous agents; particularly for agents which must rely heavily on real time visual data for decision making. Working towards this…

Computer Vision and Pattern Recognition · Computer Science 2018-11-29 Suhani Vora , Reza Mahjourian , Soeren Pirk , Anelia Angelova

Autonomous driving vehicles with self-learning capabilities are expected to evolve in complex environments to improve their ability to cope with different scenarios. However, most self-learning algorithms suffer from low learning efficiency…

Robotics · Computer Science 2024-08-23 Shuo Yang , Caojun Wang , Zhenyu Ma , Yanjun Huang , Hong Chen

Understanding how people view and interact with autonomous vehicles is important to guide future directions of research. One such way of aiding understanding is through simulations of virtual environments involving people and autonomous…

Robotics · Computer Science 2020-08-27 John Charlton , Luis Rene Montana Gonzalez , Steve Maddock , Paul Richmond

Egocentric videos can bring a lot of information about how humans perceive the world and interact with the environment, which can be beneficial for the analysis of human behaviour. The research in egocentric video analysis is developing…

Computer Vision and Pattern Recognition · Computer Science 2021-07-29 Ivan Rodin , Antonino Furnari , Dimitrios Mavroedis , Giovanni Maria Farinella

It has been for a long time to use big data of autonomous vehicles for perception, prediction, planning, and control of driving. Naturally, it is increasingly questioned why not using this big data for risk management and actuarial…

Risk Management · Quantitative Finance 2021-09-16 Jiamin Yu

This literature review focuses on three important aspects of an autonomous car system: tracking (assessing the identity of the actors such as cars, pedestrians or obstacles in a sequence of observations), prediction (predicting the future…

Machine Learning · Computer Science 2023-08-30 Florin Leon , Marius Gavrilescu

This paper describes a framework for learning Automated Vehicles (AVs) driver models via knowledge sharing between vehicles and personalization. The innate variability in the transportation system makes it exceptionally challenging to…

Robotics · Computer Science 2023-09-01 Wissam Kontar , Xinzhi Zhong , Soyoung Ahn

We present a novel method for testing the safety of self-driving vehicles in simulation. We propose an alternative to sensor simulation, as sensor simulation is expensive and has large domain gaps. Instead, we directly simulate the outputs…

Computer Vision and Pattern Recognition · Computer Science 2020-08-14 Kelvin Wong , Qiang Zhang , Ming Liang , Bin Yang , Renjie Liao , Abbas Sadat , Raquel Urtasun

Recent advancements in world models have revolutionized dynamic environment simulation, allowing systems to foresee future states and assess potential actions. In autonomous driving, these capabilities help vehicles anticipate the behavior…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Anthony Chen , Wenzhao Zheng , Yida Wang , Xueyang Zhang , Kun Zhan , Peng Jia , Kurt Keutzer , Shanghang Zhang

Accurately modeling the behavior of traffic participants is essential for safely and efficiently navigating an autonomous vehicle through heavy traffic. We propose a method, based on the intelligent driver model, that allows us to…

Robotics · Computer Science 2023-01-27 Ahmadreza Moradipari , Sangjae Bae , Mahnoosh Alizadeh , Ehsan Moradi Pari , David Isele

It is critical to predict the motion of surrounding vehicles for self-driving planning, especially in a socially compliant and flexible way. However, future prediction is challenging due to the interaction and uncertainty in driving…

Computer Vision and Pattern Recognition · Computer Science 2021-01-19 Haoran Song , Wenchao Ding , Yuxuan Chen , Shaojie Shen , Michael Yu Wang , Qifeng Chen

One of the primary challenges in urban autonomous vehicle decision-making and planning lies in effectively managing intricate interactions with diverse traffic participants characterized by unpredictable movement patterns. Additionally,…

Multiagent Systems · Computer Science 2025-05-19 Keqi Shu , Minghao Ning , Ahmad Alghooneh , Shen Li , Mohammad Pirani , Amir Khajepour

This study proposes the application of a backcasting approach to a mobility model with the aim of defining an optimal decarbonization roadmap. The selected decision variable is the introduction of a fleet of shared autonomous vehicles. The…

Systems and Control · Electrical Eng. & Systems 2025-09-25 Théotime Héraud , Vinith Lakshmanan , Antonio Sciarretta

Modular automated driving systems commonly handle prediction and planning as sequential, separate tasks, thereby prohibiting cooperative maneuvers. To enable cooperative planning, this work introduces a prediction model that models the…

Robotics · Computer Science 2025-02-06 Fabian Konstantinidis , Moritz Sackmann , Ulrich Hofmann , Christoph Stiller

Safety validation of autonomous driving systems is extremely challenging due to the high risks and costs of real-world testing as well as the rarity and diversity of potential failures. To address these challenges, we train a denoising…

Robotics · Computer Science 2025-06-11 Juanran Wang , Marc R. Schlichting , Harrison Delecki , Mykel J. Kochenderfer

World models are critical for autonomous driving to simulate environmental dynamics and generate synthetic data. Existing methods struggle to disentangle ego-vehicle motion (perspective shifts) from scene evolvement (agent interactions),…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Yining Shi , Kun Jiang , Qiang Meng , Ke Wang , Jiabao Wang , Wenchao Sun , Tuopu Wen , Mengmeng Yang , Diange Yang