English
Related papers

Related papers: Enhancing Vision-Language Models with Scene Graphs…

200 papers

This paper investigates the integration of graph neural networks (GNNs) with Qualitative Explainable Graphs (QXGs) for scene understanding in automated driving. Scene understanding is the basis for any further reactive or proactive…

Robotics · Computer Science 2025-04-18 Nassim Belmecheri , Arnaud Gotlieb , Nadjib Lazaar , Helge Spieker

Scene recognition is currently one of the top-challenging research fields in computer vision. This may be due to the ambiguity between classes: images of several scene classes may share similar objects, which causes confusion among them.…

Computer Vision and Pattern Recognition · Computer Science 2020-02-28 Alejandro López-Cifuentes , Marcos Escudero-Viñolo , Jesús Bescós , Álvaro García-Martín

Traffic scene recognition, which requires various visual classification tasks, is a critical ingredient in autonomous vehicles. However, most existing approaches treat each relevant task independently from one another, never considering the…

Computer Vision and Pattern Recognition · Computer Science 2020-04-06 Younkwan Lee , Jihyo Jeon , Jongmin Yu , Moongu Jeon

The robustness of semantic segmentation on edge cases of traffic scene is a vital factor for the safety of intelligent transportation. However, most of the critical scenes of traffic accidents are extremely dynamic and previously unseen,…

Computer Vision and Pattern Recognition · Computer Science 2021-12-10 Jiaming Zhang , Kailun Yang , Rainer Stiefelhagen

Ensuring validation for highly automated driving poses significant obstacles to the widespread adoption of highly automated vehicles. Scenario-based testing offers a potential solution by reducing the homologation effort required for these…

Machine Learning · Computer Science 2023-09-19 Maximilian Zipfl , Moritz Jarosch , J. Marius Zöllner

Scene understanding is essential for enhancing driver safety, generating human-centric explanations for Automated Vehicle (AV) decisions, and leveraging Artificial Intelligence (AI) for retrospective driving video analysis. This study…

Computer Vision and Pattern Recognition · Computer Science 2025-01-13 Mohammed Elhenawy , Huthaifa I. Ashqar , Andry Rakotonirainy , Taqwa I. Alhadidi , Ahmed Jaber , Mohammad Abu Tami

Connected automated driving has the potential to significantly improve urban traffic efficiency, e.g., by alleviating issues due to occlusion. Cooperative behavior planning can be employed to jointly optimize the motion of multiple…

Robotics · Computer Science 2023-07-31 Marvin Klimke , Benjamin Völz , Michael Buchholz

This paper presents a driver-specific risk recognition framework for autonomous vehicles that can extract inter-vehicle interactions. This extraction is carried out for urban driving scenarios in a driver-cognitive manner to improve the…

Robotics · Computer Science 2021-11-12 Jinghang Li , Chao Lu , Penghui Li , Zheyu Zhang , Cheng Gong , Jianwei Gong

Understanding the context of crash occurrence in complex driving environments is essential for improving traffic safety and advancing automated driving. Previous studies have used statistical models and deep learning to predict crashes…

Computer Vision and Pattern Recognition · Computer Science 2024-12-18 Meng Wang , Zach Noonan , Pnina Gershon , Bruce Mehler , Bryan Reimer , Shannon C. Roberts

Advances in vision-based sensors and computer vision algorithms have significantly improved the analysis and understanding of traffic scenarios. To facilitate the use of these improvements for road safety, this survey systematically…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Yaoqi Huang , Julie Stephany Berrio , Mao Shan , Stewart Worrall

A major challenge in the safety assessment of automated vehicles is to ensure that risk for all traffic participants is as low as possible. A concept that is becoming increasingly popular for testing in automated driving is scenario-based…

Robotics · Computer Science 2022-11-28 Maximilian Zipfl , Barbara Schütt , J. Marius Zöllner , Eric Sax

With the explosive growth of video data in real-world applications, a comprehensive representation of videos becomes increasingly important. In this paper, we address the problem of video scene recognition, whose goal is to learn a…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Xuzheng Yu , Chen Jiang , Wei Zhang , Tian Gan , Linlin Chao , Jianan Zhao , Yuan Cheng , Qingpei Guo , Wei Chu

Understanding a visual scene incorporates objects, relationships, and context. Traditional methods working on an image mostly focus on object detection and fail to capture the relationship between the objects. Relationships can give rich…

Computer Vision and Pattern Recognition · Computer Science 2019-12-03 Himangi Mittal , Ajith Abraham , Anuja Arora

Object detection, scene graph generation and region captioning, which are three scene understanding tasks at different semantic levels, are tied together: scene graphs are generated on top of objects detected in an image with their pairwise…

Computer Vision and Pattern Recognition · Computer Science 2017-09-18 Yikang Li , Wanli Ouyang , Bolei Zhou , Kun Wang , Xiaogang Wang

This work explores scene graphs as a distilled representation of high-level information for autonomous driving, applied to future driver-action prediction. Given the scarcity and strong imbalance of data samples, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2023-02-08 Pawit Kochakarn , Daniele De Martini , Daniel Omeiza , Lars Kunze

Identifying objects in an image and their mutual relationships as a scene graph leads to a deep understanding of image content. Despite the recent advancement in deep learning, the detection and labeling of visual object relationships…

Computer Vision and Pattern Recognition · Computer Science 2021-07-13 Rajat Koner , Poulami Sinhamahapatra , Volker Tresp

This research showcases the innovative integration of Large Language Models into machine learning workflows for traffic incident management, focusing on the classification of incident severity using accident reports. By leveraging features…

Machine Learning · Computer Science 2024-05-01 Artur Grigorev , Khaled Saleh , Yuming Ou , Adriana-Simona Mihaita

Trajectory prediction in traffic scenes involves accurately forecasting the behaviour of surrounding vehicles. To achieve this objective it is crucial to consider contextual information, including the driving path of vehicles, road…

Computer Vision and Pattern Recognition · Computer Science 2024-01-09 Leon Mlodzian , Zhigang Sun , Hendrik Berkemeyer , Sebastian Monka , Zixu Wang , Stefan Dietze , Lavdim Halilaj , Juergen Luettin

Traffic accident prediction in driving videos aims to provide an early warning of the accident occurrence, and supports the decision making of safe driving systems. Previous works usually concentrate on the spatial-temporal correlation of…

Computer Vision and Pattern Recognition · Computer Science 2023-06-19 Jianwu Fang , Lei-Lei Li , Kuan Yang , Zhedong Zheng , Jianru Xue , Tat-Seng Chua

Understanding a visual scene goes beyond recognizing individual objects in isolation. Relationships between objects also constitute rich semantic information about the scene. In this work, we explicitly model the objects and their…

Computer Vision and Pattern Recognition · Computer Science 2017-04-13 Danfei Xu , Yuke Zhu , Christopher B. Choy , Li Fei-Fei