English
Related papers

Related papers: VectorNet: Encoding HD Maps and Agent Dynamics fro…

200 papers

Predicting future locations of agents in the scene is an important problem in self-driving. In recent years, there has been a significant progress in representing the scene and the agents in it. The interactions of agents with the scene and…

Computer Vision and Pattern Recognition · Computer Science 2022-07-04 Görkay Aydemir , Adil Kaan Akan , Fatma Güney

We present Hybrid Voxel Network (HVNet), a novel one-stage unified network for point cloud based 3D object detection for autonomous driving. Recent studies show that 2D voxelization with per voxel PointNet style feature extractor leads to…

Computer Vision and Pattern Recognition · Computer Science 2020-03-18 Maosheng Ye , Shuangjie Xu , Tongyi Cao

In autonomous driving, there is growing interest in end-to-end online vectorized map perception in bird's-eye-view (BEV) space, with an expectation that it could replace traditional high-cost offline high-definition (HD) maps. However, the…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Xiaoyu Zhang , Guangwei Liu , Zihao Liu , Ningyi Xu , Yunhui Liu , Ji Zhao

Predicting the trajectories of road agents is essential for autonomous driving systems. The recent mainstream methods follow a static paradigm, which predicts the future trajectory by using a fixed duration of historical frames. These…

Computer Vision and Pattern Recognition · Computer Science 2024-04-12 Xiaolong Tang , Meina Kan , Shiguang Shan , Zhilong Ji , Jinfeng Bai , Xilin Chen

Forecasting the future behaviors of dynamic actors is an important task in many robotics applications such as self-driving. It is extremely challenging as actors have latent intentions and their trajectories are governed by complex…

Computer Vision and Pattern Recognition · Computer Science 2021-01-19 Wenyuan Zeng , Ming Liang , Renjie Liao , Raquel Urtasun

Robust multi-agent trajectory prediction is essential for the safe control of robotic systems. A major challenge is to efficiently learn a representation that approximates the true joint distribution of contextual, social, and temporal…

Action recognition is an important problem that requires identifying actions in video by learning complex interactions across scene actors and objects. However, modern deep-learning based networks often require significant computation, and…

Computer Vision and Pattern Recognition · Computer Science 2023-05-17 Yi Huang , Asim Kadav , Farley Lai , Deep Patel , Hans Peter Graf

This paper aims to tackle the interactive behavior prediction task, and proposes a novel Conditional Goal-oriented Trajectory Prediction (CGTP) framework to jointly generate scene-compliant trajectories of two interacting agents. Our CGTP…

Robotics · Computer Science 2022-10-28 Ding Li , Qichao Zhang , Shuai Lu , Yifeng Pan , Dongbin Zhao

Multi-agent trajectory prediction is a fundamental problem in autonomous driving. The key challenges in prediction are accurately anticipating the behavior of surrounding agents and understanding the scene context. To address these…

Computer Vision and Pattern Recognition · Computer Science 2022-03-04 Elmira Amirloo , Amir Rasouli , Peter Lakner , Mohsen Rohani , Jun Luo

Vectorized high-definition (HD) maps are essential for an autonomous driving system. Recently, state-of-the-art map vectorization methods are mainly based on DETR-like framework to generate HD maps in an end-to-end manner. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2025-03-28 Kuang Wu , Chuan Yang , Zhanbin Li

Comprehensive visual understanding requires detection frameworks that can effectively learn and utilize object interactions while analyzing objects individually. This is the main objective in Human-Object Interaction (HOI) detection task.…

Computer Vision and Pattern Recognition · Computer Science 2020-03-13 Oytun Ulutan , A S M Iftekhar , B. S. Manjunath

Three-dimensional feature extraction is a critical component of autonomous driving systems, where perception tasks such as 3D object detection, bird's-eye-view (BEV) semantic segmentation, and occupancy prediction serve as important…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Zhongyu Xia , Zhiwei Lin , Yongtao Wang , Ming-Hsuan Yang

Although Vehicle Routing Problems (VRP) are essential to many real-world systems, they remain computationally intractable at scale due to their combinatorial complexity. Traditional heuristics rely on handcrafted rules for local…

Artificial Intelligence · Computer Science 2026-05-21 Oleksandr Yakovenko , Mahdi Mostajabdaveh , Cheikh Ahmed , Abdullah Ali Sivas , Xiaorui Li , Zirui Zhou , Mao Kun

To accurately predict future positions of different agents in traffic scenarios is crucial for safely deploying intelligent autonomous systems in the real-world environment. However, it remains a challenge due to the behavior of a target…

Computer Vision and Pattern Recognition · Computer Science 2021-03-25 Hao Cheng , Wentong Liao , Xuejiao Tang , Michael Ying Yang , Monika Sester , Bodo Rosenhahn

In this paper, we propose a novel approach for agent motion prediction in cluttered environments. One of the main challenges in predicting agent motion is accounting for location and context-specific information. Our main contribution is…

Robotics · Computer Science 2020-07-08 Igor Gilitschenski , Guy Rosman , Arjun Gupta , Sertac Karaman , Daniela Rus

Heterogeneous trajectory forecasting is critical for intelligent transportation systems, but it is challenging because of the difficulty of modeling the complex interaction relations among the heterogeneous road agents as well as their…

Computer Vision and Pattern Recognition · Computer Science 2023-06-27 Jianwu Fang , Chen Zhu , Pu Zhang , Hongkai Yu , Jianru Xue

Detectors with high coverage have direct and far-reaching benefits for road users in route planning and avoiding traffic congestion, but utilizing these data presents unique challenges including: the dynamic temporal correlation, and the…

Computer Vision and Pattern Recognition · Computer Science 2021-11-02 He Li , Shiyu Zhang , Xuejiao Li , Liangcai Su , Hongjie Huang , Duo Jin , Linghao Chen , Jianbing Huang , Jaesoo Yoo

In autonomous driving, deep learning enabled motion prediction is a popular topic. A critical gap in traditional motion prediction methodologies lies in ensuring equivariance under Euclidean geometric transformations and maintaining…

Robotics · Computer Science 2025-08-05 Yuping Wang , Jier Chen

Rich phenomena from complex systems have long intrigued researchers, and yet modeling system micro-dynamics and inferring the forms of interaction remain challenging for conventional data-driven approaches, being generally established by…

Statistical Mechanics · Physics 2020-11-13 Seungwoong Ha , Hawoong Jeong

Ensuring the safety of autonomous vehicles (AVs) in long-tail scenarios remains a critical challenge, particularly under high uncertainty and complex multi-agent interactions. To address this, we propose RiskNet, an interaction-aware risk…

Robotics · Computer Science 2025-04-23 Qichao Liu , Heye Huang , Shiyue Zhao , Lei Shi , Soyoung Ahn , Xiaopeng Li