English
Related papers

Related papers: SCENE: Reasoning about Traffic Scenes using Hetero…

200 papers

Graph Neural Networks (GNNs) have emerged as the de facto standard for modeling graph data, with attention mechanisms and transformers significantly enhancing their performance on graph-based tasks. Despite these advancements, the…

Machine Learning · Computer Science 2025-04-07 Nikhil Shivakumar Nayak

Graph-based convolutional model such as non-local block has shown to be effective for strengthening the context modeling ability in convolutional neural networks (CNNs). However, its pixel-wise computational overhead is prohibitive which…

Computer Vision and Pattern Recognition · Computer Science 2021-09-01 Xiangtai Li , Xia Li , Ansheng You , Li Zhang , Guangliang Cheng , Kuiyuan Yang , Yunhai Tong , Zhouchen Lin

Predicting future trajectories of surrounding vehicles heavily relies on what contextual information is given to a motion prediction model. The context itself can be static (lanes, regulatory elements, etc) or dynamic (traffic…

Computer Vision and Pattern Recognition · Computer Science 2025-07-09 Mahir Gulzar , Yar Muhammad , Naveed Muhammad

In autonomous driving tasks, scene understanding is the first step towards predicting the future behavior of the surrounding traffic participants. Yet, how to represent a given scene and extract its features are still open research…

Computer Vision and Pattern Recognition · Computer Science 2023-09-14 Ali Keysan , Andreas Look , Eitan Kosman , Gonca Gürsun , Jörg Wagner , Yu Yao , Barbara Rakitsch

Despite recent advancements in single-domain or single-object image generation, it is still challenging to generate complex scenes containing diverse, multiple objects and their interactions. Scene graphs, composed of nodes as objects and…

Computer Vision and Pattern Recognition · Computer Science 2021-08-13 Sarthak Garg , Helisa Dhamo , Azade Farshad , Sabrina Musatian , Nassir Navab , Federico Tombari

Recently, road scene-graph representations used in conjunction with graph learning techniques have been shown to outperform state-of-the-art deep learning techniques in tasks including action classification, risk assessment, and collision…

Computer Vision and Pattern Recognition · Computer Science 2022-01-03 Arnav Vaibhav Malawade , Shih-Yuan Yu , Brandon Hsu , Harsimrat Kaeley , Anurag Karra , Mohammad Abdullah Al Faruque

The construction of spatiotemporal networks using graph convolution networks (GCNs) has become one of the most popular methods for predicting traffic signals. However, when using a GCN for traffic speed prediction, the conventional approach…

Machine Learning · Computer Science 2022-09-07 JunKyu Jang , Sung-Hyuk Park

Scene recognition is currently one of the top-challenging research fields in computer vision. This may be due to the ambiguity between classes: images of several scene classes may share similar objects, which causes confusion among them.…

Computer Vision and Pattern Recognition · Computer Science 2020-02-28 Alejandro López-Cifuentes , Marcos Escudero-Viñolo , Jesús Bescós , Álvaro García-Martín

This work explores scene graphs as a distilled representation of high-level information for autonomous driving, applied to future driver-action prediction. Given the scarcity and strong imbalance of data samples, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2023-02-08 Pawit Kochakarn , Daniele De Martini , Daniel Omeiza , Lars Kunze

Advances in vision-based sensors and computer vision algorithms have significantly improved the analysis and understanding of traffic scenarios. To facilitate the use of these improvements for road safety, this survey systematically…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Yaoqi Huang , Julie Stephany Berrio , Mao Shan , Stewart Worrall

Graph Neural Networks (GNNs) are effective for node classification in graph-structured data, but they lack explainability, especially at the global level. Current research mainly utilizes subgraphs of the input as local explanations or…

Artificial Intelligence · Computer Science 2024-05-22 Dominik Köhler , Stefan Heindorf

Ensuring validation for highly automated driving poses significant obstacles to the widespread adoption of highly automated vehicles. Scenario-based testing offers a potential solution by reducing the homologation effort required for these…

Machine Learning · Computer Science 2023-09-19 Maximilian Zipfl , Moritz Jarosch , J. Marius Zöllner

Graph convolutional network (GCN) based approaches have achieved significant progress for solving complex, graph-structured problems. GCNs incorporate the graph structure information and the node (or edge) features through message passing…

Machine Learning · Computer Science 2021-05-04 Saurav Manchanda , Da Zheng , George Karypis

Scene understanding plays an important role in several high-level computer vision applications, such as autonomous vehicles, intelligent video surveillance, or robotics. However, too few solutions have been proposed for indoor/outdoor scene…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Ayman Beghdadi , Azeddine Beghdadi , Mohib Ullah , Faouzi Alaya Cheikh , Malik Mallem

The graph identification problem consists of discovering the interactions among nodes in a network given their state/feature trajectories. This problem is challenging because the behavior of a node is coupled to all the other nodes by the…

Systems and Control · Electrical Eng. & Systems 2023-10-24 Eduardo Sebastian , Thai Duong , Nikolay Atanasov , Eduardo Montijano , Carlos Sagues

Motion prediction systems aim to capture the future behavior of traffic scenarios enabling autonomous vehicles to perform safe and efficient planning. The evolution of these scenarios is highly uncertain and depends on the interactions of…

Artificial Intelligence · Computer Science 2022-12-08 Sandra Carrasco Limeros , Sylwia Majchrowska , Joakim Johnander , Christoffer Petersson , David Fernández Llorca

Scene graph generation aims to produce structured representations for images, which requires to understand the relations between objects. Due to the continuous nature of deep neural networks, the prediction of scene graphs is divided into…

Computer Vision and Pattern Recognition · Computer Science 2020-08-13 Meng Wei , Chun Yuan , Xiaoyu Yue , Kuo Zhong

Heterogeneous graphs generally refers to graphs with different types of nodes and edges. A common approach for extracting useful information from heterogeneous graphs is to use meta-graphs, which can be seen as a special kind of directed…

Machine Learning · Computer Science 2023-09-04 Hansi Yang , Peiyu Zhang , Quanming Yao

This work proposes a neural network architecture that learns policies for multiple agent classes in a heterogeneous multi-agent reinforcement setting. The proposed network uses directed labeled graph representations for states, encodes…

Artificial Intelligence · Computer Science 2020-10-22 Douglas De Rizzo Meneghetti , Reinaldo Augusto da Costa Bianchi

The (variational) graph auto-encoder and its variants have been popularly used for representation learning on graph-structured data. While the encoder is often a powerful graph convolutional network, the decoder reconstructs the graph…

Machine Learning · Computer Science 2019-11-27 Han Shi , Haozheng Fan , James T. Kwok