English
Related papers

Related papers: BePo: Dual Representation for 3D Occupancy Predict…

200 papers

In this paper, we present BEVerse, a unified framework for 3D perception and prediction based on multi-camera systems. Unlike existing studies focusing on the improvement of single-task approaches, BEVerse features in producing…

Computer Vision and Pattern Recognition · Computer Science 2022-05-20 Yunpeng Zhang , Zheng Zhu , Wenzhao Zheng , Junjie Huang , Guan Huang , Jie Zhou , Jiwen Lu

Recently, perception task based on Bird's-Eye View (BEV) representation has drawn more and more attention, and BEV representation is promising as the foundation for next-generation Autonomous Vehicle (AV) perception. However, most existing…

Computer Vision and Pattern Recognition · Computer Science 2024-07-10 Yangguang Li , Bin Huang , Zeren Chen , Yufeng Cui , Feng Liang , Mingzhu Shen , Fenggang Liu , Enze Xie , Lu Sheng , Wanli Ouyang , Jing Shao

Recently, LSS-based multi-view 3D object detection provides an economical and deployment-friendly solution for autonomous driving. However, all the existing LSS-based methods transform multi-view image features into a Cartesian…

Computer Vision and Pattern Recognition · Computer Science 2024-12-05 Zichen Yu , Quanli Liu , Wei Wang , Liyong Zhang , Xiaoguang Zhao

Bird's-Eye-View (BEV) representation has emerged as a mainstream paradigm for multi-view 3D object detection, demonstrating impressive perceptual capabilities. However, existing methods overlook the geometric quality of BEV representation,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-24 Jinqing Zhang , Yanan Zhang , Yunlong Qi , Zehua Fu , Qingjie Liu , Yunhong Wang

Multi-sensor fusion is essential for an accurate and reliable autonomous driving system. Recent approaches are based on point-level fusion: augmenting the LiDAR point cloud with camera features. However, the camera-to-LiDAR projection…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Zhijian Liu , Haotian Tang , Alexander Amini , Xinyu Yang , Huizi Mao , Daniela Rus , Song Han

Occupancy prediction plays a pivotal role in autonomous driving (AD) due to the fine-grained geometric perception and general object recognition capabilities. However, existing methods often incur high computational costs, which contradicts…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Yulin He , Wei Chen , Tianci Xun , Yusong Tan

Recently, the pure camera-based Bird's-Eye-View (BEV) perception provides a feasible solution for economical autonomous driving. However, the existing BEV-based multi-view 3D detectors generally transform all image features into BEV…

Computer Vision and Pattern Recognition · Computer Science 2023-07-24 Jinqing Zhang , Yanan Zhang , Qingjie Liu , Yunhong Wang

Bird's-Eye-View (BEV) representation offers a metric-scaled planar workspace, facilitating the simplification of 6-DoF ego-motion to a more robust 3-DoF model for monocular visual odometry (MVO) in intelligent transportation systems.…

Robotics · Computer Science 2025-09-19 Yufei Wei , Wangtao Lu , Sha Lu , Chenxiao Hu , Fuzhang Han , Rong Xiong , Yue Wang

While 3D object bounding box (bbox) representation has been widely used in autonomous driving perception, it lacks the ability to capture the precise details of an object's intrinsic geometry. Recently, occupancy has emerged as a promising…

Computer Vision and Pattern Recognition · Computer Science 2024-12-09 Chaoda Zheng , Feng Wang , Naiyan Wang , Shuguang Cui , Zhen Li

Occupancy prediction, aiming at predicting the occupancy status within voxelized 3D environment, is quickly gaining momentum within the autonomous driving community. Mainstream occupancy prediction works first discretize the 3D environment…

Computer Vision and Pattern Recognition · Computer Science 2024-11-01 Jiabao Wang , Zhaojiang Liu , Qiang Meng , Liujiang Yan , Ke Wang , Jie Yang , Wei Liu , Qibin Hou , Ming-Ming Cheng

Integrating LiDAR and camera information in the bird's eye view (BEV) representation has demonstrated its effectiveness in 3D object detection. However, because of the fundamental disparity in geometric accuracy between these sensors,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-03 Guowen Zhang , Chenhang He , Liyi Chen , Lei Zhang

Pairwise point cloud registration is a critical task for many applications, which heavily depends on finding correct correspondences from the two point clouds. However, the low overlap between input point clouds causes the registration to…

Computer Vision and Pattern Recognition · Computer Science 2023-03-15 Lin Li , Wendong Ding , Yongkun Wen , Yufei Liang , Yong Liu , Guowei Wan

The task of estimating 3D occupancy from surrounding-view images is an exciting development in the field of autonomous driving, following the success of Bird's Eye View (BEV) perception. This task provides crucial 3D attributes of the…

Computer Vision and Pattern Recognition · Computer Science 2023-11-20 Wanshui Gan , Ningkai Mo , Hongbin Xu , Naoto Yokoya

Single camera 3D perception for traffic monitoring faces significant challenges due to occlusion and limited field of view. Moreover, fusing information from multiple cameras at the image feature level is difficult because of different view…

Computer Vision and Pattern Recognition · Computer Science 2025-02-18 Arpitsinh Vaghela , Duo Lu , Aayush Atul Verma , Bharatesh Chakravarthi , Hua Wei , Yezhou Yang

Tracking vehicles in LIDAR point clouds is a challenging task due to the sparsity of the data and the dense search space. The lack of structure in point clouds impedes the use of convolution filters usually employed in 2D object tracking.…

Computer Vision and Pattern Recognition · Computer Science 2020-05-07 Jesus Zarzar , Silvio Giancola , Bernard Ghanem

Semantic occupancy prediction aims to infer dense geometry and semantics of surroundings for an autonomous agent to operate safely in the 3D environment. Existing occupancy prediction methods are almost entirely trained on human-annotated…

Computer Vision and Pattern Recognition · Computer Science 2023-06-16 Zhiyu Tan , Zichao Dong , Cheng Zhang , Weikun Zhang , Hang Ji , Hao Li

Given the capability of mitigating the long-tail deficiencies and intricate-shaped absence prevalent in 3D object detection, occupancy prediction has become a pivotal component in autonomous driving systems. However, the procession of…

Computer Vision and Pattern Recognition · Computer Science 2023-11-22 Zichen Yu , Changyong Shu , Jiajun Deng , Kangjie Lu , Zongdai Liu , Jiangyong Yu , Dawei Yang , Hui Li , Yan Chen

Autonomous driving requires accurate reasoning of the location of objects from raw sensor data. Recent end-to-end learning methods go from raw sensor data to a trajectory output via Bird's Eye View(BEV) segmentation as an interpretable…

With the attention gained by camera-only 3D object detection in autonomous driving, methods based on Bird-Eye-View (BEV) representation especially derived from the forward view transformation paradigm, i.e., lift-splat-shoot (LSS), have…

Computer Vision and Pattern Recognition · Computer Science 2024-11-20 Weijie Ma , Jingwei Jiang , Yang Yang , Zehui Chen , Hao Chen

Bird's-eye-view (BEV) semantic segmentation is becoming crucial in autonomous driving systems. It realizes ego-vehicle surrounding environment perception by projecting 2D multi-view images into 3D world space. Recently, BEV segmentation has…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Jian Sun , Yuqi Dai , Chi-Man Vong , Qing Xu , Shengbo Eben Li , Jianqiang Wang , Lei He , Keqiang Li