English
Related papers

Related papers: FipTR: A Simple yet Effective Transformer Framewor…

200 papers

Autonomous driving requires accurate and detailed Bird's Eye View (BEV) semantic segmentation for decision making, which is one of the most challenging tasks for high-level scene perception. Feature transformation from frontal view to BEV…

Computer Vision and Pattern Recognition · Computer Science 2022-04-12 Jiayu Zou , Junrui Xiao , Zheng Zhu , Junjie Huang , Guan Huang , Dalong Du , Xingang Wang

With the attention gained by camera-only 3D object detection in autonomous driving, methods based on Bird-Eye-View (BEV) representation especially derived from the forward view transformation paradigm, i.e., lift-splat-shoot (LSS), have…

Computer Vision and Pattern Recognition · Computer Science 2024-11-20 Weijie Ma , Jingwei Jiang , Yang Yang , Zehui Chen , Hao Chen

The choice of representation plays a key role in self-driving. Bird's eye view (BEV) representations have shown remarkable performance in recent years. In this paper, we propose to learn object-centric representations in BEV to distill a…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Shadi Hamdan , Fatma Güney

In this paper, we present BEVerse, a unified framework for 3D perception and prediction based on multi-camera systems. Unlike existing studies focusing on the improvement of single-task approaches, BEVerse features in producing…

Computer Vision and Pattern Recognition · Computer Science 2022-05-20 Yunpeng Zhang , Zheng Zhu , Wenzhao Zheng , Junjie Huang , Guan Huang , Jie Zhou , Jiwen Lu

Driving requires interacting with road agents and predicting their future behaviour in order to navigate safely. We present FIERY: a probabilistic future prediction model in bird's-eye view from monocular cameras. Our model predicts future…

Computer Vision and Pattern Recognition · Computer Science 2021-10-19 Anthony Hu , Zak Murez , Nikhil Mohan , Sofía Dudas , Jeffrey Hawke , Vijay Badrinarayanan , Roberto Cipolla , Alex Kendall

3D object detection based on LiDAR point clouds is a crucial module in autonomous driving particularly for long range sensing. Most of the research is focused on achieving higher accuracy and these models are not optimized for deployment on…

Computer Vision and Pattern Recognition · Computer Science 2021-07-13 Sambit Mohapatra , Senthil Yogamani , Heinrich Gotzig , Stefan Milz , Patrick Mader

Motion prediction is an important aspect for Autonomous Driving (AD) and Advance Driver Assistance Systems (ADAS). Current state-of-the-art motion prediction methods rely on High Definition (HD) maps for capturing the surrounding context of…

Machine Learning · Computer Science 2025-04-15 Harsh Yadav , Maximilian Schaefer , Kun Zhao , Tobias Meisen

Prediction, decision-making, and motion planning are essential for autonomous driving. In most contemporary works, they are considered as individual modules or combined into a multi-task learning paradigm with a shared backbone but separate…

Robotics · Computer Science 2023-10-17 Pengqin Wang , Meixin Zhu , Hongliang Lu , Hui Zhong , Xianda Chen , Shaojie Shen , Xuesong Wang , Yinhai Wang

World models have attracted increasing attention in autonomous driving for their ability to forecast potential future scenarios. In this paper, we propose BEVWorld, a novel framework that transforms multimodal sensor inputs into a unified…

Computer Vision and Pattern Recognition · Computer Science 2025-05-01 Yumeng Zhang , Shi Gong , Kaixin Xiong , Xiaoqing Ye , Xiaofan Li , Xiao Tan , Fan Wang , Jizhou Huang , Hua Wu , Haifeng Wang

Multi-instance point cloud registration estimates the poses of multiple instances of a model point cloud in a scene point cloud. Extracting accurate point correspondence is to the center of the problem. Existing approaches usually treat the…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Zhiyuan Yu , Zheng Qin , Lintao Zheng , Kai Xu

The comprehensive understanding capabilities of world models for driving scenarios have significantly improved the planning accuracy of end-to-end autonomous driving frameworks. However, the redundant modeling of static regions and the lack…

Computer Vision and Pattern Recognition · Computer Science 2026-02-12 Jinqing Zhang , Zehua Fu , Zelin Xu , Wenying Dai , Qingjie Liu , Yunhong Wang

Trajectory prediction is, naturally, a key task for vehicle autonomy. While the number of traffic rules is limited, the combinations and uncertainties associated with each agent's behaviour in real-world scenarios are nearly impossible to…

Computer Vision and Pattern Recognition · Computer Science 2023-12-21 Sushil Sharma , Arindam Das , Ganesh Sistu , Mark Halton , Ciarán Eising

An accurate understanding of a self-driving vehicle's surrounding environment is crucial for its navigation system. To enhance the effectiveness of existing algorithms and facilitate further research, it is essential to provide…

Computer Vision and Pattern Recognition · Computer Science 2023-11-14 Abtin Mahyar , Hossein Motamednia , Dara Rahmati

Motion prediction is crucial for autonomous driving systems to understand complex driving scenarios and make informed decisions. However, this task is challenging due to the diverse behaviors of traffic participants and complex…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Shaoshuai Shi , Li Jiang , Dengxin Dai , Bernt Schiele

Nowadays, our mobility systems are evolving into the era of intelligent vehicles that aim to improve road safety. Due to their vulnerability, pedestrians are the users who will benefit the most from these developments. However, predicting…

Computer Vision and Pattern Recognition · Computer Science 2022-03-18 Lina Achaji , Thierno Barry , Thibault Fouqueray , Julien Moreau , Francois Aioun , Francois Charpillet

BEV perception is of great importance in the field of autonomous driving, serving as the cornerstone of planning, controlling, and motion prediction. The quality of the BEV feature highly affects the performance of BEV perception. However,…

Computer Vision and Pattern Recognition · Computer Science 2023-03-16 Jiayu Zou , Zheng Zhu , Yun Ye , Xingang Wang

In self-driving, predicting future in terms of location and motion of all the agents around the vehicle is a crucial requirement for planning. Recently, a new joint formulation of perception and prediction has emerged by fusing rich sensory…

Computer Vision and Pattern Recognition · Computer Science 2022-08-12 Adil Kaan Akan , Fatma Güney

Determining accurate bird's eye view (BEV) positions of objects and tracks in a scene is vital for various perception tasks including object interactions mapping, scenario extraction etc., however, the level of supervision required to…

Computer Vision and Pattern Recognition · Computer Science 2022-12-08 Paridhi Singh , Gaurav Singh , Arun Kumar

The ability to accurately predict feasible multimodal future trajectories of surrounding traffic participants is crucial for behavior planning in autonomous vehicles. The Motion Transformer (MTR), a state-of-the-art motion prediction…

We present an end-to-end method for object detection and trajectory prediction utilizing multi-view representations of LiDAR returns and camera images. In this work, we recognize the strengths and weaknesses of different view…

Computer Vision and Pattern Recognition · Computer Science 2021-10-20 Sudeep Fadadu , Shreyash Pandey , Darshan Hegde , Yi Shi , Fang-Chieh Chou , Nemanja Djuric , Carlos Vallespi-Gonzalez