English
Related papers

Related papers: Bridging Perspectives: Foundation Model Guided BEV…

200 papers

Bird's-Eye-View (BEV) representation offers a metric-scaled planar workspace, facilitating the simplification of 6-DoF ego-motion to a more robust 3-DoF model for monocular visual odometry (MVO) in intelligent transportation systems.…

Robotics · Computer Science 2025-09-19 Yufei Wei , Wangtao Lu , Sha Lu , Chenxiao Hu , Fuzhang Han , Rong Xiong , Yue Wang

We propose DistillNeRF, a self-supervised learning framework addressing the challenge of understanding 3D environments from limited 2D observations in outdoor autonomous driving scenes. Our method is a generalizable feedforward model that…

Computer Vision and Pattern Recognition · Computer Science 2024-11-01 Letian Wang , Seung Wook Kim , Jiawei Yang , Cunjun Yu , Boris Ivanovic , Steven L. Waslander , Yue Wang , Sanja Fidler , Marco Pavone , Peter Karkus

A robust awareness of how dynamic scenes evolve is essential for Autonomous Driving systems, as they must accurately detect, track, and predict the behaviour of surrounding obstacles. Traditional perception pipelines that rely on modular…

Computer Vision and Pattern Recognition · Computer Science 2026-04-06 Miguel Antunes-García , Santiago Montiel-Marín , Fabio Sánchez-García , Rodrigo Gutiérrez-Moreno , Rafael Barea , Luis M. Bergasa

As a critical task in autonomous driving perception systems, 3D object detection is used to identify and track key objects, such as vehicles and pedestrians. However, detecting distant, small, or occluded objects (hard instances) remains a…

Computer Vision and Pattern Recognition · Computer Science 2025-11-14 Feiyang Jia , Caiyan Jia , Ailin Liu , Shaoqing Xu , Qiming Xia , Lin Liu , Lei Yang , Yan Gong , Ziying Song

The integration of Large Language Models (LLMs) into autonomous driving has attracted growing interest for their strong reasoning and semantic understanding abilities, which are essential for handling complex decision-making and long-tail…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Thomas Monninger , Shaoyuan Xie , Qi Alfred Chen , Sihao Ding

The Bird's-Eye-View (BEV) representation is a critical factor that directly impacts the 3D object detection performance, but the traditional BEV grid representation induces quadratic computational cost as the spatial resolution grows. To…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Zhili Chen , Shuangjie Xu , Maosheng Ye , Zian Qian , Xiaoyi Zou , Dit-Yan Yeung , Qifeng Chen

Leveraging multi-modal fusion, especially between camera and LiDAR, has become essential for building accurate and robust 3D object detection systems for autonomous vehicles. Until recently, point decorating approaches, in which point…

Computer Vision and Pattern Recognition · Computer Science 2023-04-28 Philip Jacobson , Yiyang Zhou , Wei Zhan , Masayoshi Tomizuka , Ming C. Wu

Depth estimation is a cornerstone of perception in autonomous driving and robotic systems. The considerable cost and relatively sparse data acquisition of LiDAR systems have led to the exploration of cost-effective alternatives, notably,…

Computer Vision and Pattern Recognition · Computer Science 2023-06-21 Yucheng Mao , Ruowen Zhao , Tianbao Zhang , Hang Zhao

Recent vision-only perception models for autonomous driving achieved promising results by encoding multi-view image features into Bird's-Eye-View (BEV) space. A critical step and the main bottleneck of these methods is transforming image…

Computer Vision and Pattern Recognition · Computer Science 2023-07-13 Jiayu Yang , Enze Xie , Miaomiao Liu , Jose M. Alvarez

Realizing unified 3D object detection, including both indoor and outdoor scenes, holds great importance in applications like robot navigation. However, involving various scenarios of data to train models poses challenges due to their…

Computer Vision and Pattern Recognition · Computer Science 2024-09-24 Zhuoling Li , Xiaogang Xu , SerNam Lim , Hengshuang Zhao

Bird's-Eye-View (BEV) maps have emerged as one of the most powerful representations for scene understanding due to their ability to provide rich spatial context while being easy to interpret and process. Such maps have found use in many…

Computer Vision and Pattern Recognition · Computer Science 2022-03-01 Nikhil Gosala , Abhinav Valada

Accurate 3D object detection in autonomous driving is critical yet challenging due to occlusions, varying object sizes, and complex urban environments. This paper introduces the KAN-RCBEVDepth method, an innovative approach aimed at…

Computer Vision and Pattern Recognition · Computer Science 2024-08-28 Zhihao Lai , Chuanhao Liu , Shihui Sheng , Zhiqiang Zhang

Bird's-Eye-View (BEV) 3D Object Detection is a crucial multi-view technique for autonomous driving systems. Recently, plenty of works are proposed, following a similar paradigm consisting of three essential components, i.e., camera feature…

Computer Vision and Pattern Recognition · Computer Science 2022-12-05 Xiaowei Chi , Jiaming Liu , Ming Lu , Rongyu Zhang , Zhaoqing Wang , Yandong Guo , Shanghang Zhang

Determining accurate bird's eye view (BEV) positions of objects and tracks in a scene is vital for various perception tasks including object interactions mapping, scenario extraction etc., however, the level of supervision required to…

Computer Vision and Pattern Recognition · Computer Science 2022-12-08 Paridhi Singh , Gaurav Singh , Arun Kumar

In this paper, we propose the LiDAR Distillation to bridge the domain gap induced by different LiDAR beams for 3D object detection. In many real-world applications, the LiDAR points used by mass-produced robots and vehicles usually have…

Computer Vision and Pattern Recognition · Computer Science 2022-08-16 Yi Wei , Zibu Wei , Yongming Rao , Jiaxin Li , Jie Zhou , Jiwen Lu

Recent advancements in camera-based 3D object detection have introduced cross-modal knowledge distillation to bridge the performance gap with LiDAR 3D detectors, leveraging the precise geometric information in LiDAR point clouds. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Sanmin Kim , Youngseok Kim , Sihwan Hwang , Hyeonjun Jeong , Dongsuk Kum

Semantic scene segmentation from a bird's-eye-view (BEV) perspective plays a crucial role in facilitating planning and decision-making for mobile robots. Although recent vision-only methods have demonstrated notable advancements in…

Generating a detailed near-field perceptual model of the environment is an important and challenging problem in both self-driving vehicles and autonomous mobile robotics. A Bird Eye View (BEV) map, providing a panoptic representation, is a…

Computer Vision and Pattern Recognition · Computer Science 2022-06-01 Pramit Dutta , Ganesh Sistu , Senthil Yogamani , Edgar Galván , John McDonald

A recent sensor fusion in a Bird's Eye View (BEV) space has shown its utility in various tasks such as 3D detection, map segmentation, etc. However, the approach struggles with inaccurate camera BEV estimation, and a perception of distant…

Computer Vision and Pattern Recognition · Computer Science 2023-11-09 Minsu Kim , Giseop Kim , Kyong Hwan Jin , Sunwook Choi

Detecting diverse objects within complex indoor 3D point clouds presents significant challenges for robotic perception, particularly with varied object shapes, clutter, and the co-existence of static and dynamic elements where traditional…

Robotics · Computer Science 2025-07-24 Haichuan Li , Changda Tian , Panos Trahanias , Tomi Westerlund