English
Related papers

Related papers: BEVControl: Accurately Controlling Street-view Ele…

200 papers

Recently, perception task based on Bird's-Eye View (BEV) representation has drawn more and more attention, and BEV representation is promising as the foundation for next-generation Autonomous Vehicle (AV) perception. However, most existing…

Computer Vision and Pattern Recognition · Computer Science 2024-07-10 Yangguang Li , Bin Huang , Zeren Chen , Yufeng Cui , Feng Liang , Mingzhu Shen , Fenggang Liu , Enze Xie , Lu Sheng , Wanli Ouyang , Jing Shao

Simulation is crucial for developing and evaluating autonomous vehicle (AV) systems. Recent literature builds on a new generation of generative models to synthesize highly realistic images for full-stack simulation. However, purely…

Computer Vision and Pattern Recognition · Computer Science 2025-06-25 Zehao Zhu , Yuliang Zou , Chiyu Max Jiang , Bo Sun , Vincent Casser , Xiukun Huang , Jiahao Wang , Zhenpei Yang , Ruiqi Gao , Leonidas Guibas , Mingxing Tan , Dragomir Anguelov

While bird's-eye-view (BEV) perception models can be useful for building high-definition maps (HD-Maps) with less human labor, their results are often unreliable and demonstrate noticeable inconsistencies in the predicted HD-Maps from…

Computer Vision and Pattern Recognition · Computer Science 2023-10-10 Ziyang Xie , Ziqi Pang , Yu-Xiong Wang

Camera-based 3D object detection and tracking are essential for perception in autonomous driving. Current state-of-the-art approaches often rely exclusively on either perspective-view (PV) or bird's-eye-view (BEV) features, limiting their…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Markus Käppeler , Özgün Çiçek , Daniele Cattaneo , Claudius Gläser , Yakov Miron , Abhinav Valada

Semantic segmentation in bird's eye view (BEV) is an important task for autonomous driving. Though this task has attracted a large amount of research efforts, it is still challenging to flexibly cope with arbitrary (single or multiple)…

Computer Vision and Pattern Recognition · Computer Science 2022-08-19 Lang Peng , Zhirong Chen , Zhangjie Fu , Pengpeng Liang , Erkang Cheng

Bird's-eye-view (BEV) map layout estimation requires an accurate and full understanding of the semantics for the environmental elements around the ego car to make the results coherent and realistic. Due to the challenges posed by occlusion,…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Yiwei Zhang , Jin Gao , Fudong Ge , Guan Luo , Bing Li , Zhaoxiang Zhang , Haibin Ling , Weiming Hu

Trajectory prediction is, naturally, a key task for vehicle autonomy. While the number of traffic rules is limited, the combinations and uncertainties associated with each agent's behaviour in real-world scenarios are nearly impossible to…

Computer Vision and Pattern Recognition · Computer Science 2023-12-21 Sushil Sharma , Arindam Das , Ganesh Sistu , Mark Halton , Ciarán Eising

Roadside perception can greatly increase the safety of autonomous vehicles by extending their perception ability beyond the visual range and addressing blind spots. However, current state-of-the-art vision-based roadside detection methods…

Computer Vision and Pattern Recognition · Computer Science 2024-04-10 Lei Yang , Xinyu Zhang , Jun Li , Li Wang , Chuang Zhang , Li Ju , Zhiwei Li , Yang Shen

Multi-sensor fusion is essential for an accurate and reliable autonomous driving system. Recent approaches are based on point-level fusion: augmenting the LiDAR point cloud with camera features. However, the camera-to-LiDAR projection…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Zhijian Liu , Haotian Tang , Alexander Amini , Xinyu Yang , Huizi Mao , Daniela Rus , Song Han

Road intersection monitoring and control research often utilize bird's eye view (BEV) simulators. In real traffic settings, achieving a BEV akin to that in a simulator necessitates the deployment of drones or specific sensor mounting, which…

Computer Vision and Pattern Recognition · Computer Science 2024-08-15 Rukesh Prajapati , Amr S. El-Wakeel

The rapid development of the autonomous driving industry has led to a significant accumulation of autonomous driving data. Consequently, there comes a growing demand for retrieving data to provide specialized optimization. However, directly…

Computer Vision and Pattern Recognition · Computer Science 2024-06-19 Tao Tang , Dafeng Wei , Zhengyu Jia , Tian Gao , Changwei Cai , Chengkai Hou , Peng Jia , Kun Zhan , Haiyang Sun , Jingchen Fan , Yixing Zhao , Fu Liu , Xiaodan Liang , Xianpeng Lang , Yang Wang

In the field of autonomous driving and mobile robotics, there has been a significant shift in the methods used to create Bird's Eye View (BEV) representations. This shift is characterised by using transformers and learning to fuse…

Robotics · Computer Science 2024-10-29 Mehdi Hosseinzadeh , Ian Reid

Existing reconstruction-based novel view synthesis methods for driving scenes focus on synthesizing camera views along the recorded trajectory of the ego vehicle. Their image rendering performance will severely degrade on viewpoints falling…

Computer Vision and Pattern Recognition · Computer Science 2024-10-24 Qitai Wang , Lue Fan , Yuqi Wang , Yuntao Chen , Zhaoxiang Zhang

Recent advances in image generation have achieved remarkable visual quality, while a fundamental challenge remains: Can image generation be controlled at the element level, enabling intuitive modifications such as adjusting shapes, altering…

Computer Vision and Pattern Recognition · Computer Science 2026-02-17 Lanqing Guo , Xi Liu , Yufei Wang , Zhihao Li , Siyu Huang

Detection of moving objects is a very important task in autonomous driving systems. After the perception phase, motion planning is typically performed in Bird's Eye View (BEV) space. This would require projection of objects detected on the…

Computer Vision and Pattern Recognition · Computer Science 2021-07-13 Hazem Rashed , Mariam Essam , Maha Mohamed , Ahmad El Sallab , Senthil Yogamani

Prediction, decision-making, and motion planning are essential for autonomous driving. In most contemporary works, they are considered as individual modules or combined into a multi-task learning paradigm with a shared backbone but separate…

Robotics · Computer Science 2023-10-17 Pengqin Wang , Meixin Zhu , Hongliang Lu , Hui Zhong , Xianda Chen , Shaojie Shen , Xuesong Wang , Yinhai Wang

Autonomous driving requires an accurate representation of the environment. A strategy toward high accuracy is to fuse data from several sensors. Learned Bird's-Eye View (BEV) encoders can achieve this by mapping data from individual sensors…

Computer Vision and Pattern Recognition · Computer Science 2024-09-20 Thomas Monninger , Vandana Dokkadi , Md Zafar Anwar , Steffen Staab

Image generation today can produce somewhat realistic images from text prompts. However, if one asks the generator to synthesize a specific camera setting such as creating different fields of view using a 24mm lens versus a 70mm lens, the…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Yu Yuan , Xijun Wang , Yichen Sheng , Prateek Chennuri , Xingguang Zhang , Stanley Chan

This paper introduces BEV-VLM, a novel approach for trajectory planning in autonomous driving that leverages Vision-Language Models (VLMs) with Bird's-Eye View (BEV) feature maps as visual input. Unlike conventional trajectory planning…

Robotics · Computer Science 2026-03-02 Guancheng Chen , Sheng Yang , Tong Zhan , Jian Wang

Bird's-eye-view (BEV) perception has emerged as a cornerstone of autonomous driving systems, providing a structured, ego-centric representation critical for downstream planning and control. However, real-world deployment faces challenges…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Lifeng Zhuo , Kefan Jin , Zhe Liu , Hesheng Wang