English
Related papers

Related papers: Vision-Driven 2D Supervised Fine-Tuning Framework …

200 papers

While most recent autonomous driving system focuses on developing perception methods on ego-vehicle sensors, people tend to overlook an alternative approach to leverage intelligent roadside cameras to extend the perception ability beyond…

Computer Vision and Pattern Recognition · Computer Science 2023-04-12 Lei Yang , Kaicheng Yu , Tao Tang , Jun Li , Kun Yuan , Li Wang , Xinyu Zhang , Peng Chen

In the field of autonomous driving and mobile robotics, there has been a significant shift in the methods used to create Bird's Eye View (BEV) representations. This shift is characterised by using transformers and learning to fuse…

Robotics · Computer Science 2024-10-29 Mehdi Hosseinzadeh , Ian Reid

Bird's-Eye-View (BEV) perception has become a vital component of autonomous driving systems due to its ability to integrate multiple sensor inputs into a unified representation, enhancing performance in various downstream tasks. However,…

Robotics · Computer Science 2024-10-10 Yuxin Li , Yiheng Li , Xulei Yang , Mengying Yu , Zihang Huang , Xiaojun Wu , Chai Kiat Yeo

Autonomous vehicles (AV) require that neural networks used for perception be robust to different viewpoints if they are to be deployed across many types of vehicles without the repeated cost of data collection and labeling for each. AV…

Computer Vision and Pattern Recognition · Computer Science 2023-09-12 Tzofi Klinghoffer , Jonah Philion , Wenzheng Chen , Or Litany , Zan Gojcic , Jungseock Joo , Ramesh Raskar , Sanja Fidler , Jose M. Alvarez

Multi-sensor fusion is essential for an accurate and reliable autonomous driving system. Recent approaches are based on point-level fusion: augmenting the LiDAR point cloud with camera features. However, the camera-to-LiDAR projection…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Zhijian Liu , Haotian Tang , Alexander Amini , Xinyu Yang , Huizi Mao , Daniela Rus , Song Han

LiDAR and camera are two essential sensors for 3D object detection in autonomous driving. LiDAR provides accurate and reliable 3D geometry information while the camera provides rich texture with color. Despite the increasing popularity of…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Qi Jiang , Hao Sun , Xi Zhang

3D object detection in Bird's-Eye-View (BEV) space has recently emerged as a prevalent approach in the field of autonomous driving. Despite the demonstrated improvements in accuracy and velocity estimation compared to perspective view…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Yuxin Li , Qiang Han , Mengying Yu , Yuxin Jiang , Chaikiat Yeo , Yiheng Li , Zihang Huang , Nini Liu , Hsuanhan Chen , Xiaojun Wu

LiDAR is crucial for robust 3D scene perception in autonomous driving. LiDAR perception has the largest body of literature after camera perception. However, multi-task learning across tasks like detection, segmentation, and motion…

Computer Vision and Pattern Recognition · Computer Science 2024-11-20 Sambit Mohapatra , Senthil Yogamani , Varun Ravi Kumar , Stefan Milz , Heinrich Gotzig , Patrick Mäder

Recent advancements in bird's eye view (BEV) representations have shown remarkable promise for in-vehicle 3D perception. However, while these methods have achieved impressive results on standard benchmarks, their robustness in varied…

Computer Vision and Pattern Recognition · Computer Science 2025-02-04 Shaoyuan Xie , Lingdong Kong , Wenwei Zhang , Jiawei Ren , Liang Pan , Kai Chen , Ziwei Liu

3D perception is a critical problem in autonomous driving. Recently, the Bird-Eye-View (BEV) approach has attracted extensive attention, due to low-cost deployment and desirable vision detection capacity. However, the existing models ignore…

Computer Vision and Pattern Recognition · Computer Science 2023-12-20 Siran Chen , Yue Ma , Yu Qiao , Yali Wang

The Bird-Eye-View (BEV) is one of the most widely-used scene representations for visual perception in Autonomous Vehicles (AVs) due to its well suited compatibility to downstream tasks. For the enhanced safety of AVs, modeling perception…

Computer Vision and Pattern Recognition · Computer Science 2023-12-20 Asen Nachkov , Martin Danelljan , Danda Pani Paudel , Luc Van Gool

Despite tremendous advancements in bird's-eye view (BEV) perception, existing models fall short in generating realistic and coherent semantic map layouts, and they fail to account for uncertainties arising from partial sensor information…

Computer Vision and Pattern Recognition · Computer Science 2023-08-25 Xiyue Zhu , Vlas Zyrianov , Zhijian Liu , Shenlong Wang

Camera-based bird-eye-view (BEV) perception paradigm has made significant progress in the autonomous driving field. Under such a paradigm, accurate BEV representation construction relies on reliable depth estimation for multi-camera images.…

Computer Vision and Pattern Recognition · Computer Science 2023-12-14 Yang Jiao , Zequn Jie , Shaoxiang Chen , Lechao Cheng , Jingjing Chen , Lin Ma , Yu-Gang Jiang

The advancement of vision-only Bird's-Eye-View (BEV) perception, a core paradigm for cost-effective autonomous driving, is hindered by the long-standing fundamental trade-off between perception accuracy and on-device deployment efficiency.…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Yuanpeng Chen , Hui Song , Sheng Yang , Wei Tao , Shanhui Mo , Shuang Zhang , Xiao Hua , Tiankun Zhao

With the attention gained by camera-only 3D object detection in autonomous driving, methods based on Bird-Eye-View (BEV) representation especially derived from the forward view transformation paradigm, i.e., lift-splat-shoot (LSS), have…

Computer Vision and Pattern Recognition · Computer Science 2024-11-20 Weijie Ma , Jingwei Jiang , Yang Yang , Zehui Chen , Hao Chen

Point cloud data from 3D LiDAR sensors are one of the most crucial sensor modalities for versatile safety-critical applications such as self-driving vehicles. Since the annotations of point cloud data is an expensive and time-consuming…

Computer Vision and Pattern Recognition · Computer Science 2019-05-23 Khaled Saleh , Ahmed Abobakr , Mohammed Attia , Julie Iskander , Darius Nahavandi , Mohammed Hossny

Perception is essential for autonomous driving system. Recent approaches based on Bird's-eye-view (BEV) and deep learning have made significant progress. However, there exists challenging issues including lengthy development cycles, poor…

Computer Vision and Pattern Recognition · Computer Science 2024-07-29 Yuqi Dai , Jian Sun , Shengbo Eben Li , Qing Xu , Jianqiang Wang , Lei He , Keqiang Li

Achieving robust and real-time 3D perception is fundamental for autonomous vehicles. While most existing 3D perception methods prioritize detection accuracy, they often overlook critical aspects such as computational efficiency, onboard…

Computer Vision and Pattern Recognition · Computer Science 2023-11-29 Trung Pham , Mehran Maghoumi , Wanli Jiang , Bala Siva Sashank Jujjavarapu , Mehdi Sajjadi , Xin Liu , Hsuan-Chu Lin , Bor-Jeng Chen , Giang Truong , Chao Fang , Junghyun Kwon , Minwoo Park

3D object detection based on LiDAR point clouds is a crucial module in autonomous driving particularly for long range sensing. Most of the research is focused on achieving higher accuracy and these models are not optimized for deployment on…

Computer Vision and Pattern Recognition · Computer Science 2021-07-13 Sambit Mohapatra , Senthil Yogamani , Heinrich Gotzig , Stefan Milz , Patrick Mader

In the landscape of autonomous driving, Bird's-Eye-View (BEV) representation has recently garnered substantial academic attention, serving as a transformative framework for the fusion of multi-modal sensor inputs. This BEV paradigm…

Computer Vision and Pattern Recognition · Computer Science 2024-10-11 Yuxin Li , Yiheng Li , Xulei Yang , Mengying Yu , Zihang Huang , Xiaojun Wu , Chai Kiat Yeo