English
Related papers

Related papers: Explainable Action Prediction through Self-Supervi…

200 papers

To take full advantage of fast-growing unlabeled networked data, this paper introduces a novel self-supervised strategy for graph representation learning by exploiting natural supervision provided by the data itself. Inspired by human…

Machine Learning · Computer Science 2025-11-20 Zhen Peng , Yixiang Dong , Minnan Luo , Xiao-Ming Wu , Qinghua Zheng

Studies have shown that autonomous vehicles (AVs) behave conservatively in a traffic environment composed of human drivers and do not adapt to local conditions and socio-cultural norms. It is known that socially aware AVs can be designed if…

Robotics · Computer Science 2021-11-05 Rohan Chandra , Aniket Bera , Dinesh Manocha

Dashboard cameras capture a tremendous amount of driving scene video each day. These videos are purposefully coupled with vehicle sensing data, such as from the speedometer and inertial sensors, providing an additional sensing modality for…

Computer Vision and Pattern Recognition · Computer Science 2019-09-17 Seokju Lee , Junsik Kim , Tae-Hyun Oh , Yongseop Jeong , Donggeun Yoo , Stephen Lin , In So Kweon

Driving scene understanding is to obtain comprehensive scene information through the sensor data and provide a basis for downstream tasks, which is indispensable for the safety of self-driving vehicles. Specific perception tasks, such as…

Computer Vision and Pattern Recognition · Computer Science 2023-08-03 Yiyang Sun , Xiaonian Wang , Yangyang Zhang , Jiagui Tang , Xiaqiang Tang , Jing Yao

To maximize safety and driving comfort, autonomous driving systems can benefit from implementing foresighted action choices that take different potential scenario developments into account. While artificial scene prediction methods are…

Robotics · Computer Science 2022-04-15 Chao Wang , Thomas H. Weisswange , Matti Krueger , Christiane B. Wiebel-Herboth

Understanding driving scenes and communicating automated vehicle decisions are key requirements for trustworthy automated driving. In this article, we introduce the Qualitative Explainable Graph (QXG), which is a unified symbolic and…

Artificial Intelligence · Computer Science 2024-03-26 Nassim Belmecheri , Arnaud Gotlieb , Nadjib Lazaar , Helge Spieker

In order to plan a safe maneuver an autonomous vehicle must accurately perceive its environment, and understand the interactions among traffic participants. In this paper, we aim to learn scene-consistent motion forecasts of complex urban…

Computer Vision and Pattern Recognition · Computer Science 2020-07-24 Sergio Casas , Cole Gulino , Simon Suo , Katie Luo , Renjie Liao , Raquel Urtasun

We present the Qualitative Explainable Graph (QXG): a unified symbolic and qualitative representation for scene understanding in urban mobility. QXG enables the interpretation of an automated vehicle's environment using sensor data and…

Computer Vision and Pattern Recognition · Computer Science 2024-03-18 Nassim Belmecheri , Arnaud Gotlieb , Nadjib Lazaar , Helge Spieker

The future of automated driving (AD) is rooted in the development of robust, fair and explainable artificial intelligence methods. Upon request, automated vehicles must be able to explain their decisions to the driver and the car…

Artificial Intelligence · Computer Science 2023-08-25 Nassim Belmecheri , Arnaud Gotlieb , Nadjib Lazaar , Helge Spieker

Understanding traffic scenes requires considering heterogeneous information about dynamic agents and the static infrastructure. In this work we propose SCENE, a methodology to encode diverse traffic scenes in heterogeneous graphs and to…

Computer Vision and Pattern Recognition · Computer Science 2023-01-10 Thomas Monninger , Julian Schmidt , Jan Rupprecht , David Raba , Julian Jordan , Daniel Frank , Steffen Staab , Klaus Dietmayer

Due to the complex and changing interactions in dynamic scenarios, motion forecasting is a challenging problem in autonomous driving. Most existing works exploit static road graphs to characterize scenarios and are limited in modeling…

Artificial Intelligence · Computer Science 2023-03-09 Xing Gao , Xiaogang Jia , Yikang Li , Hongkai Xiong

In this paper, we study the problem of parsing structured knowledge graphs from textual descriptions. In particular, we consider the scene graph representation that considers objects together with their attributes and relations: this…

Computation and Language · Computer Science 2018-03-28 Yu-Siang Wang , Chenxi Liu , Xiaohui Zeng , Alan Yuille

Autonomous vehicles (AVs) must be both safe and trustworthy to gain social acceptance and become a viable option for everyday public transportation. Explanations about the system behaviour can increase safety and trust in AVs.…

Logic in Computer Science · Computer Science 2025-11-19 Dominik Grundt , Ishan Saxena , Malte Petersen , Bernd Westphal , Eike Möhlmann

Scene graphs have become an important form of structured knowledge for tasks such as for image generation, visual relation detection, visual question answering, and image retrieval. While visualizing and interpreting word embeddings is well…

Computer Vision and Pattern Recognition · Computer Science 2019-09-23 Brigit Schroeder , Subarna Tripathi , Hanlin Tang

The improvement of traffic efficiency at urban intersections receives strong research interest in the field of automated intersection management. So far, mostly non-learning algorithms like reservation or optimization-based ones were…

Robotics · Computer Science 2022-11-10 Marvin Klimke , Jasper Gerigk , Benjamin Völz , Michael Buchholz

Traffic scene understanding is essential for enabling autonomous vehicles to accurately perceive and interpret their environment, thereby ensuring safe navigation. This paper presents a novel framework that transforms a single frontal-view…

Computer Vision and Pattern Recognition · Computer Science 2026-01-22 Danial Sadrian Zadeh , Otman A. Basir , Behzad Moshiri

In autonomous driving tasks, scene understanding is the first step towards predicting the future behavior of the surrounding traffic participants. Yet, how to represent a given scene and extract its features are still open research…

Computer Vision and Pattern Recognition · Computer Science 2023-09-14 Ali Keysan , Andreas Look , Eitan Kosman , Gonca Gürsun , Jörg Wagner , Yu Yao , Barbara Rakitsch

We propose an efficient and interpretable scene graph generator. We consider three types of features: visual, spatial and semantic, and we use a late fusion strategy such that each feature's contribution can be explicitly investigated. We…

Computer Vision and Pattern Recognition · Computer Science 2018-11-26 Ji Zhang , Kevin Shih , Andrew Tao , Bryan Catanzaro , Ahmed Elgammal

Visual question answering is concerned with answering free-form questions about an image. Since it requires a deep linguistic understanding of the question and the ability to associate it with various objects that are present in the image,…

Machine Learning · Computer Science 2020-07-03 Marcel Hildebrandt , Hang Li , Rajat Koner , Volker Tresp , Stephan Günnemann

Despite their irresistible success, deep learning algorithms still heavily rely on annotated data. On the other hand, unsupervised settings pose many challenges, especially about determining the right inductive bias in diverse scenarios.…

Computer Vision and Pattern Recognition · Computer Science 2021-03-11 Beril Besbinar , Pascal Frossard