English
Related papers

Related papers: PreGSU-A Generalized Traffic Scene Understanding M…

200 papers

Representing relevant information of a traffic scene and understanding its environment is crucial for the success of autonomous driving. Modeling the surrounding of an autonomous car using semantic relations, i.e., how different traffic…

Artificial Intelligence · Computer Science 2022-12-07 Maximilian Zipfl , Felix Hertlein , Achim Rettinger , Steffen Thoma , Lavdim Halilaj , Juergen Luettin , Stefan Schmid , Cory Henson

Scene graph generation models understand the scene through object and predicate recognition, but are prone to mistakes due to the challenges of perception in the wild. Perception errors often lead to nonsensical compositions in the output…

Computer Vision and Pattern Recognition · Computer Science 2020-07-21 Alireza Zareian , Zhecan Wang , Haoxuan You , Shih-Fu Chang

This work explores scene graphs as a distilled representation of high-level information for autonomous driving, applied to future driver-action prediction. Given the scarcity and strong imbalance of data samples, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2023-02-08 Pawit Kochakarn , Daniele De Martini , Daniel Omeiza , Lars Kunze

Accurately modelling human attention is essential for numerous computer vision applications, particularly in the domain of automotive safety. Existing methods typically collapse gaze into saliency maps or scanpaths, treating gaze dynamics…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Luke Palmer , Petar Palasek , Hazem Abdelkawy

Advances in vision-based sensors and computer vision algorithms have significantly improved the analysis and understanding of traffic scenarios. To facilitate the use of these improvements for road safety, this survey systematically…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Yaoqi Huang , Julie Stephany Berrio , Mao Shan , Stewart Worrall

Studies have shown that autonomous vehicles (AVs) behave conservatively in a traffic environment composed of human drivers and do not adapt to local conditions and socio-cultural norms. It is known that socially aware AVs can be designed if…

Robotics · Computer Science 2021-11-05 Rohan Chandra , Aniket Bera , Dinesh Manocha

The ability to recognize and reason about text embedded in visual inputs is often lacking in vision-and-language (V&L) models, perhaps because V&L pre-training methods have often failed to include such an ability in their training…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Jihyung Kil , Soravit Changpinyo , Xi Chen , Hexiang Hu , Sebastian Goodman , Wei-Lun Chao , Radu Soricut

A major challenge in scene graph classification is that the appearance of objects and relations can be significantly different from one image to another. Previous works have addressed this by relational reasoning over all objects in an…

Computer Vision and Pattern Recognition · Computer Science 2020-12-18 Sahand Sharifzadeh , Sina Moayed Baharlou , Volker Tresp

Understanding the traffic dynamics in networks is a core capability for automated systems to monitor and analyze networking behaviors, reducing expensive human efforts and economic risks through tasks such as traffic classification,…

Machine Learning · Computer Science 2024-12-31 Jiawei Zhou , Woojeong Kim , Zhiying Xu , Alexander M. Rush , Minlan Yu

Deep neural networks can be powerful tools, but require careful application-specific design to ensure that the most informative relationships in the data are learnable. In this paper, we apply deep neural networks to the nonlinear…

Machine Learning · Computer Science 2019-12-04 Matthew A. Wright , Simon F. G. Ehlers , Roberto Horowitz

A key aspect of driving a road vehicle is to interact with other road users, assess their intentions and make risk-aware tactical decisions. An intuitive approach to enabling an intelligent automated driving system would be incorporating…

Computer Vision and Pattern Recognition · Computer Science 2023-08-08 Videsh Suman , Phu Pham , Aniket Bera

Urban intersections are prone to delays and inefficiencies due to static precedence rules and occlusions limiting the view on prioritized traffic. Existing approaches to improve traffic flow, widely known as automatic intersection…

Robotics · Computer Science 2022-07-27 Marvin Klimke , Benjamin Völz , Michael Buchholz

Recent development in autonomous driving involves high-level computer vision and detailed road scene understanding. Today, most autonomous vehicles are using mediated perception approach for path planning and control, which highly rely on…

Computer Vision and Pattern Recognition · Computer Science 2019-03-22 Chen Sun , Jean M. Uwabeza Vianney , Dongpu Cao

In this work, we aim to predict the future motion of vehicles in a traffic scene by explicitly modeling their pairwise interactions. Specifically, we propose a graph neural network that jointly predicts the discrete interaction modes and…

Machine Learning · Statistics 2019-12-18 Donsuk Lee , Yiming Gu , Jerrick Hoang , Micol Marchetti-Bowick

Large-scale "pre-train and prompt learning" paradigms have demonstrated remarkable adaptability, enabling broad applications across diverse domains such as question answering, image recognition, and multimodal retrieval. This approach fully…

In this study, we propose GITSR, an effective framework for Graph Interaction Transformer-based Scene Representation for multi-vehicle collaborative decision-making in intelligent transportation system. In the context of mixed traffic where…

Machine Learning · Computer Science 2024-11-05 Xingyu Hu , Lijun Zhang , Dejian Meng , Ye Han , Lisha Yuan

Automated driving functions increasingly rely on machine learning for tasks like perception and trajectory planning, requiring large, relevant datasets. The performance of these algorithms depends on how closely the training data matches…

Robotics · Computer Science 2025-10-02 Michiel Braat , Maren Buermann , Marijke van Weperen , Jan-Pieter Paardekooper

Global and local relational reasoning enable scene understanding models to perform human-like scene analysis and understanding. Scene understanding enables better semantic segmentation and object-to-object interaction detection. In the…

Image and Video Processing · Electrical Eng. & Systems 2022-01-31 Lalithkumar Seenivasan , Sai Mitheran , Mobarakol Islam , Hongliang Ren

Modelling long-range dependencies is critical for scene understanding tasks in computer vision. Although convolution neural networks (CNNs) have excelled in many vision tasks, they are still limited in capturing long-range structured…

Computer Vision and Pattern Recognition · Computer Science 2022-09-21 Li Zhang , Mohan Chen , Anurag Arnab , Xiangyang Xue , Philip H. S. Torr

A scenario-based testing approach can reduce the time required to obtain statistically significant evidence of the safety of Automated Driving Systems (ADS). Identifying these scenarios in an automated manner is a challenging task. Most…

Computer Vision and Pattern Recognition · Computer Science 2023-10-30 Tobias Hoek , Holger Caesar , Andreas Falkovén , Tommy Johansson