English
Related papers

Related papers: Driving Behavior Explanation with Multi-level Fusi…

200 papers

In this paper, we present a framework to control a self-driving car by fusing raw information from RGB images and depth maps. A deep neural network architecture is used for mapping the vision and depth information, respectively, to steering…

Machine Learning · Computer Science 2019-02-13 Qadeer Khan , Torsten Schön , Patrick Wenzel

In commentary driving, drivers verbalise their observations, assessments and intentions. By speaking out their thoughts, both learning and expert drivers are able to create a better understanding and awareness of their surroundings. In the…

Artificial Intelligence · Computer Science 2022-10-24 Daniel Omeiza , Sule Anjomshoae , Helena Webb , Marina Jirotka , Lars Kunze

The development of automated vehicles has the potential to revolutionize transportation, but they are currently unable to ensure a safe and time-efficient driving style. Reliable models predicting human behavior are essential for overcoming…

Machine Learning · Computer Science 2023-10-10 Julian F. Schumann , Aravinda Ramakrishnan Srinivasan , Jens Kober , Gustav Markkula , Arkady Zgonnikov

Large vision-language models (VLMs) have garnered increasing interest in autonomous driving areas, due to their advanced capabilities in complex reasoning tasks essential for highly autonomous vehicle behavior. Despite their potential,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Ming Nie , Renyuan Peng , Chunwei Wang , Xinyue Cai , Jianhua Han , Hang Xu , Li Zhang

Automated driving has the potential to revolutionize personal, public, and freight mobility. Beside accurately perceiving the environment, automated vehicles must plan a safe, comfortable, and efficient motion trajectory. To promote safety…

Robotics · Computer Science 2024-09-12 Steffen Hagedorn , Marcel Hallgarten , Martin Stoll , Alexandru Condurache

Autonomous driving in complex traffic requires reasoning under uncertainty. Common approaches rely on prediction-based planning or risk-aware control, but these are typically treated in isolation, limiting their ability to capture the…

Robotics · Computer Science 2026-03-17 Devodita Chakravarty , John Dolan , Yiwei Lyu

The comprehensiveness of vehicle-to-everything (V2X) recognition enriches and holistically shapes the global Birds-Eye-View (BEV) perception, incorporating rich semantics and integrating driving scene information, thereby serving features…

Robotics · Computer Science 2024-04-23 Fukang Li , Wenlin Ou , Kunpeng Gao , Yuwen Pang , Yifei Li , Henry Fan

Real-world problems are often dependent on multiple data modalities, making multimodal fusion essential for leveraging diverse information sources. In high-stakes domains, such as in healthcare, understanding how each modality contributes…

Neural and Evolutionary Computing · Computer Science 2025-05-19 Mafalda Malafaia , Thalea Schlender , Tanja Alderliesten , Peter A. N. Bosman

Autonomous vehicles often make complex decisions via machine learning-based predictive models applied to collected sensor data. While this combination of methods provides a foundation for real-time actions, self-driving behavior primarily…

Robotics · Computer Science 2024-04-12 Shahin Atakishiyev , Mohammad Salameh , Randy Goebel

Predicting future trajectories of surrounding agents is essential for safety-critical autonomous driving. Most existing work focuses on predicting marginal trajectories for each agent independently. However, it has rarely been explored in…

Robotics · Computer Science 2023-08-22 Yiyao Zhu , Di Luan , Shaojie Shen

Accurate prediction of others' trajectories is essential for autonomous driving. Trajectory prediction is challenging because it requires reasoning about agents' past movements, social interactions among varying numbers and kinds of agents,…

Computer Vision and Pattern Recognition · Computer Science 2019-07-30 Tianyang Zhao , Yifei Xu , Mathew Monfort , Wongun Choi , Chris Baker , Yibiao Zhao , Yizhou Wang , Ying Nian Wu

End-to-end style autonomous driving models have been developed recently. These models lack interpretability of decision-making process from perception to control of the ego vehicle, resulting in anxiety for passengers. To alleviate it, it…

Computer Vision and Pattern Recognition · Computer Science 2024-11-18 Shota Yamazaki , Chenyu Zhang , Takuya Nanri , Akio Shigekane , Siyuan Wang , Jo Nishiyama , Tao Chu , Kohei Yokosawa

Advanced Driver Assistance Systems (ADAS) improve driving safety significantly. They alert drivers from unsafe traffic conditions when a dangerous maneuver appears. Traditional methods to predict driving maneuvers are mostly based on…

Artificial Intelligence · Computer Science 2018-05-09 Dong Zhou , Huimin Ma , Yuhan Dong

Autonomous driving requires accurate scene understanding, including road geometry, traffic agents, and their semantic relationships. In online HD map generation scenarios, raster-based representations are well-suited to vision models but…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Zhigang Sun , Yiru Wang , Anqing Jiang , Shuo Wang , Yu Gao , Yuwen Heng , Shouyi Zhang , An He , Hao Jiang , Jinhao Chai , Zichong Gu , Wang Jijun , Shichen Tang , Lavdim Halilaj , Juergen Luettin , Hao Sun

Predicting the future behavior of road users is one of the most challenging and important problems in autonomous driving. Applying deep learning to this problem requires fusing heterogeneous world state in the form of rich perception…

Autonomous driving technology has seen significant advancements, but existing models often fail to fully capture the complexity of multi-agent environments, where interactions between dynamic agents are critical. To address this, we propose…

Artificial Intelligence · Computer Science 2024-11-05 Liu Yunhao , Ding Hong , Zhang Ziming , Wang Huixin , Liu Jinzhao , Xi Suyang

A fundamental challenge in car-following modeling lies in accurately representing the multi-scale complexity of driving behaviors, particularly the intra-driver heterogeneity where a single driver's actions fluctuate dynamically under…

Machine Learning · Computer Science 2025-06-09 Shirui Zhou , Jiying Yan , Junfang Tian , Tao Wang , Yongfu Li , Shiquan Zhong

In light of growing attention of intelligent vehicle systems, we propose developing a driver model that uses a hybrid system formulation to capture the intent of the driver. This model hopes to capture human driving behavior in a way that…

Systems and Control · Computer Science 2015-05-25 Katherine Driggs-Campbell , Ruzena Bajcsy

Most state-of-the-art works in trajectory forecasting for automotive target predicting the pose and orientation of the agents in the scene. This represents a particularly useful problem, for instance in autonomous driving, but it does not…

Robotics · Computer Science 2024-10-28 Luca Paparusso , Stefano Melzi , Francesco Braghin

Learning-based approaches have achieved remarkable performance in the domain of autonomous driving. Leveraging the impressive ability of neural networks and large amounts of human driving data, complex patterns and rules of driving behavior…

Robotics · Computer Science 2023-08-01 Bikun Wang , Zhipeng Wang , Chenhao Zhu , Zhiqiang Zhang , Zhichen Wang , Penghong Lin , Jingchu Liu , Qian Zhang