English
Related papers

Related papers: GraphAD: Interaction Scene Graph for End-to-end Au…

200 papers

Encoding a driving scene into vector representations has been an essential task for autonomous driving that can benefit downstream tasks e.g. trajectory prediction. The driving scene often involves heterogeneous elements such as the…

Artificial Intelligence · Computer Science 2023-07-21 Xiaosong Jia , Penghao Wu , Li Chen , Yu Liu , Hongyang Li , Junchi Yan

The autonomous driving (AD) industry is exploring the use of knowledge graphs (KGs) to manage the vast amount of heterogeneous data generated from vehicular sensors. The various types of equipped sensors include video, LIDAR and RADAR.…

Artificial Intelligence · Computer Science 2020-03-03 Ruwan Wickramarachchi , Cory Henson , Amit Sheth

Accurately predicting the possible behaviors of traffic participants is an essential capability for autonomous vehicles. Since autonomous vehicles need to navigate in dynamically changing environments, they are expected to make accurate…

Robotics · Computer Science 2022-11-15 Yeping Hu , Wei Zhan , Masayoshi Tomizuka

Assessing drivers' interaction capabilities is crucial for understanding human driving behavior and enhancing the interactive abilities of autonomous vehicles. In scenarios involving strong interaction, existing metrics focused on…

Robotics · Computer Science 2024-05-07 Jiaqi Liu , Peng Hang , Xiangwang Hu , Jian Sun

Understanding the traffic scenes and then generating high-definition (HD) maps present significant challenges in autonomous driving. In this paper, we defined a novel Traffic Topology Scene Graph, a unified scene graph explicitly modeling…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Changsheng Lv , Mengshi Qi , Liang Liu , Huadong Ma

Graph based representation has been widely used in modelling spatio-temporal relationships in video understanding. Although effective, existing graph-based approaches focus on capturing the human-object relationships while ignoring…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Chinthani Sugandhika , Chen Li , Deepu Rajan , Basura Fernando

The future of automated driving (AD) is rooted in the development of robust, fair and explainable artificial intelligence methods. Upon request, automated vehicles must be able to explain their decisions to the driver and the car…

Artificial Intelligence · Computer Science 2023-08-25 Nassim Belmecheri , Arnaud Gotlieb , Nadjib Lazaar , Helge Spieker

Understanding the road genome is essential to realize autonomous driving. This highly intelligent problem contains two aspects - the connection relationship of lanes, and the assignment relationship between lanes and traffic elements, where…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Tianyu Li , Li Chen , Huijie Wang , Yang Li , Jiazhi Yang , Xiangwei Geng , Shengyin Jiang , Yuting Wang , Hang Xu , Chunjing Xu , Junchi Yan , Ping Luo , Hongyang Li

Motion prediction for automated vehicles in complex environments is a difficult task that is to be mastered when automated vehicles are to be used in arbitrary situations. Many factors influence the future motion of traffic participants…

Robotics · Computer Science 2023-06-21 Daniel Grimm , Philip Schörner , Moritz Dreßler , J. -Marius Zöllner

We present an innovative framework for traffic dynamics analysis using High-Order Evolving Graphs, designed to improve spatio-temporal representations in autonomous driving contexts. Our approach constructs temporal bidirectional bipartite…

Computer Vision and Pattern Recognition · Computer Science 2024-09-19 Aditya Humnabadkar , Arindam Sikdar , Benjamin Cave , Huaizhong Zhang , Paul Bakaki , Ardhendu Behera

We present a unified representation for actionable spatial perception: 3D Dynamic Scene Graphs. Scene graphs are directed graphs where nodes represent entities in the scene (e.g. objects, walls, rooms), and edges represent relations (e.g.…

Robotics · Computer Science 2020-06-18 Antoni Rosinol , Arjun Gupta , Marcus Abate , Jingnan Shi , Luca Carlone

In end-to-end autonomous driving,the motion prediction plays a pivotal role in ego-vehicle planning. However, existing methods often rely on globally aggregated motion features, ignoring the fact that planning decisions are primarily…

Artificial Intelligence · Computer Science 2026-05-12 Bin Sun , Boao Zhang , Jiayi Lu , Xinjie Feng , Jiachen Shang , Rui Cao , Mengchao Zheng , Chuanye Wang , Shichun Yang , Yaoguang Cao , Ziying Song

Vision-language models have recently emerged as promising planners for autonomous driving, where success hinges on topology-aware reasoning over spatial structure and dynamic interactions from multimodal input. However, existing models are…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 Fabian Schmidt , Markus Enzweiler , Abhinav Valada

In autonomous driving, navigation through unsignaled intersections with many traffic participants moving around is a challenging task. To provide a solution to this problem, we propose a novel branched network G-CIL for the navigation…

Robotics · Computer Science 2021-02-02 Xiaodong Mei , Yuxiang Sun , Yuying Chen , Congcong Liu , Ming Liu

In the era of Generative AI, Neurosymbolic AI is emerging as a powerful approach for tasks spanning from perception to cognition. The use of Neurosymbolic AI has been shown to achieve enhanced capabilities, including improved grounding,…

Artificial Intelligence · Computer Science 2024-11-08 Ruwan Wickramarachchi , Cory Henson , Amit Sheth

Safety-critical corner cases, difficult to collect in the real world, are crucial for evaluating end-to-end autonomous driving. Adversarial interaction is an effective method to generate such safety-critical corner cases. While existing…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Jiaheng Geng , Jiatong Du , Xinyu Zhang , Ye Li , Panqu Wang , Yanjun Huang

Modern autonomous driving system is characterized as modular tasks in sequential order, i.e., perception, prediction, and planning. In order to perform a wide diversity of tasks and achieve advanced-level intelligence, contemporary…

Computer Vision and Pattern Recognition · Computer Science 2023-03-24 Yihan Hu , Jiazhi Yang , Li Chen , Keyu Li , Chonghao Sima , Xizhou Zhu , Siqi Chai , Senyao Du , Tianwei Lin , Wenhai Wang , Lewei Lu , Xiaosong Jia , Qiang Liu , Jifeng Dai , Yu Qiao , Hongyang Li

The potential to improve road safety, reduce human driving error, and promote environmental sustainability have enabled the field of autonomous driving to progress rapidly over recent decades. The performance of autonomous vehicles has…

Artificial Intelligence · Computer Science 2025-05-14 Sara Montese , Victor Gimenez-Abalos , Atia Cortés , Ulises Cortés , Sergio Alvarez-Napagao

Recently, road scene-graph representations used in conjunction with graph learning techniques have been shown to outperform state-of-the-art deep learning techniques in tasks including action classification, risk assessment, and collision…

Computer Vision and Pattern Recognition · Computer Science 2022-01-03 Arnav Vaibhav Malawade , Shih-Yuan Yu , Brandon Hsu , Harsimrat Kaeley , Anurag Karra , Mohammad Abdullah Al Faruque

Autonomous driving in multi-agent dynamic traffic scenarios is challenging: the behaviors of road users are uncertain and are hard to model explicitly, and the ego-vehicle should apply complicated negotiation skills with them, such as…

Robotics · Computer Science 2022-06-22 Peide Cai , Hengli Wang , Yuxiang Sun , Ming Liu