English
Related papers

Related papers: SemanticFormer: Holistic and Semantic Traffic Scen…

200 papers

In mixed autonomous driving environments, accurately predicting the future trajectories of surrounding vehicles is crucial for the safe operation of autonomous vehicles (AVs). In driving scenarios, a vehicle's trajectory is determined by…

Robotics · Computer Science 2025-02-28 Haicheng Liao , Chengyue Wang , Kaiqun Zhu , Yilong Ren , Bolin Gao , Shengbo Eben Li , Chengzhong Xu , Zhenning Li

Autonomous vehicles hold great promise in improving the future of transportation. The driving models used in these vehicles are based on neural networks, which can be difficult to validate. However, ensuring the safety of these models is…

Robotics · Computer Science 2023-09-14 Maximilian Zipfl , Sven Spickermann , J. Marius Zöllner

In this paper, we demonstrate that the concept of Semantic Consistency and the ensuing method of Knowledge-Aware Re-Optimization can be adapted for the problem of object detection in intricate traffic scenes. Furthermore, we introduce a…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Jean-Francois Nies

Motion prediction is a challenging task for autonomous vehicles due to uncertainty in the sensor data, the non-deterministic nature of future, and complex behavior of agents. In this paper, we tackle this problem by representing the scene…

Computer Vision and Pattern Recognition · Computer Science 2023-08-09 Rabbia Asghar , Manuel Diaz-Zapata , Lukas Rummelhard , Anne Spalanzani , Christian Laugier

Predicting the future behavior of agents is a fundamental task in autonomous vehicle domains. Accurate prediction relies on comprehending the surrounding map, which significantly regularizes agent behaviors. However, existing methods have…

Computer Vision and Pattern Recognition · Computer Science 2024-01-19 Chen Feng , Hangning Zhou , Huadong Lin , Zhigang Zhang , Ziyao Xu , Chi Zhang , Boyu Zhou , Shaojie Shen

Robust multi-agent trajectory prediction is essential for the safe control of robotic systems. A major challenge is to efficiently learn a representation that approximates the true joint distribution of contextual, social, and temporal…

Predicting the movement trajectories of multiple classes of road users in real-world scenarios is a challenging task due to the diverse trajectory patterns. While recent works of pedestrian trajectory prediction successfully modelled the…

Computer Vision and Pattern Recognition · Computer Science 2021-08-11 Ben A. Rainbow , Qianhui Men , Hubert P. H. Shum

Network traffic classification using pre-training models has shown promising results, but existing methods struggle to capture packet structural characteristics, flow-level behaviors, hierarchical protocol semantics, and inter-packet…

Machine Learning · Computer Science 2025-08-28 Liming Liu , Ruoyu Li , Qing Li , Meijia Hou , Yong Jiang , Mingwei Xu

Holistic understanding and reasoning in 3D scenes are crucial for the success of autonomous driving systems. The evolution of 3D semantic occupancy prediction as a pretraining task for autonomous driving and robotic applications captures…

Computer Vision and Pattern Recognition · Computer Science 2025-02-18 Sathira Silva , Savindu Bhashitha Wannigama , Gihan Jayatilaka , Muhammad Haris Khan , Roshan Ragel

Visual navigation for autonomous agents is a core task in the fields of computer vision and robotics. Learning-based methods, such as deep reinforcement learning, have the potential to outperform the classical solutions developed for this…

Computer Vision and Pattern Recognition · Computer Science 2021-03-23 Zachary Seymour , Kowshik Thopalli , Niluthpol Mithun , Han-Pang Chiu , Supun Samarasekera , Rakesh Kumar

A scenario-based testing approach can reduce the time required to obtain statistically significant evidence of the safety of Automated Driving Systems (ADS). Identifying these scenarios in an automated manner is a challenging task. Most…

Computer Vision and Pattern Recognition · Computer Science 2023-10-30 Tobias Hoek , Holger Caesar , Andreas Falkovén , Tommy Johansson

Forecasting the future states of surrounding traffic participants is a crucial capability for autonomous vehicles. The recently proposed occupancy flow field prediction introduces a scalable and effective representation to jointly predict…

Computer Vision and Pattern Recognition · Computer Science 2023-07-07 Haochen Liu , Zhiyu Huang , Chen Lv

Accurate trajectory prediction has long been a major challenge for autonomous driving (AD). Traditional data-driven models predominantly rely on statistical correlations, often overlooking the causal relationships that govern traffic…

Artificial Intelligence · Computer Science 2025-05-13 Bonan Wang , Haicheng Liao , Chengyue Wang , Bin Rao , Yanchen Guan , Guyang Yu , Jiaxun Zhang , Songning Lai , Chengzhong Xu , Zhenning Li

Traffic forecasting has emerged as a crucial research area in the development of smart cities. Although various neural networks with intricate architectures have been developed to address this problem, they still face two key challenges: i)…

Machine Learning · Computer Science 2024-08-27 Jianxiang Zhou , Erdong Liu , Wei Chen , Siru Zhong , Yuxuan Liang

In this study, we introduce a novel framework called Toast for learning general-purpose representations of road networks, along with its advanced counterpart DyToast, designed to enhance the integration of temporal dynamics to boost the…

Machine Learning · Computer Science 2024-03-19 Yile Chen , Xiucheng Li , Gao Cong , Zhifeng Bao , Cheng Long

The computer vision community has witnessed an extensive exploration of vision transformers in the past two years. Drawing inspiration from traditional schemes, numerous works focus on introducing vision-specific inductive biases. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-04-10 Hao Wang , Shuo Zhang , Biao Leng

Predicting pedestrian behavior is a crucial task for intelligent driving systems. Accurate predictions require a deep understanding of various contextual elements that potentially impact the way pedestrians behave. To address this…

Computer Vision and Pattern Recognition · Computer Science 2022-10-17 Amir Rasouli , Iuliia Kotseruba

In order to plan a safe maneuver an autonomous vehicle must accurately perceive its environment, and understand the interactions among traffic participants. In this paper, we aim to learn scene-consistent motion forecasts of complex urban…

Computer Vision and Pattern Recognition · Computer Science 2020-07-24 Sergio Casas , Cole Gulino , Simon Suo , Katie Luo , Renjie Liao , Raquel Urtasun

Dynamic scene understanding is the ability of a computer system to interpret and make sense of the visual information present in a video of a real-world scene. In this thesis, we present a series of frameworks for dynamic scene…

Computer Vision and Pattern Recognition · Computer Science 2023-12-14 Salman Khan

3D occupancy prediction is crucial for robust autonomous driving systems as it enables comprehensive perception of environmental structures and semantics. Most existing methods employ dense voxel-based scene representations, ignoring the…

Computer Vision and Pattern Recognition · Computer Science 2025-06-13 Sicheng Zuo , Wenzhao Zheng , Xiaoyong Han , Longchao Yang , Yong Pan , Jiwen Lu