English
Related papers

Related papers: OE-BevSeg: An Object Informed and Environment Awar…

200 papers

In this paper, we propose M$^2$BEV, a unified framework that jointly performs 3D object detection and map segmentation in the Birds Eye View~(BEV) space with multi-camera image inputs. Unlike the majority of previous works which separately…

Computer Vision and Pattern Recognition · Computer Science 2022-04-20 Enze Xie , Zhiding Yu , Daquan Zhou , Jonah Philion , Anima Anandkumar , Sanja Fidler , Ping Luo , Jose M. Alvarez

Bird's-Eye-View (BEV) semantic segmentation provides comprehensive environmental perception for autonomous driving but suffers multi-modal misalignment and sensor noise. We propose RESAR-BEV, a progressive refinement framework that advances…

Computer Vision and Pattern Recognition · Computer Science 2026-03-06 Zhiwen Zeng , Yunfei Yin , Zheng Yuan , Argho Dey , Xianjian Bao

3D object detection plays a pivotal role in autonomous driving and robotics, demanding precise interpretation of Bird's Eye View (BEV) images. The dynamic nature of real-world environments necessitates the use of dynamic query mechanisms in…

Computer Vision and Pattern Recognition · Computer Science 2024-07-26 Jiawei Yao , Yingxin Lai , Hongrui Kou , Tong Wu , Ruixi Liu

Expressing images with Multi-Resolution (MR) features has been widely adopted in many computer vision tasks. In this paper, we introduce the MR concept into Bird's-Eye-View (BEV) semantic segmentation for autonomous driving. This…

Computer Vision and Pattern Recognition · Computer Science 2024-07-25 Dooseop Choi , Jungyu Kang , Taeghyun An , Kyounghwan Ahn , KyoungWook Min

Bird's-eye-view (BEV) grid is a common representation for the perception of road components, e.g., drivable area, in autonomous driving. Most existing approaches rely on cameras only to perform segmentation in BEV space, which is…

Computer Vision and Pattern Recognition · Computer Science 2022-11-01 Shubhankar Borse , Marvin Klingner , Varun Ravi Kumar , Hong Cai , Abdulaziz Almuzairee , Senthil Yogamani , Fatih Porikli

In the landscape of autonomous driving, Bird's-Eye-View (BEV) representation has recently garnered substantial academic attention, serving as a transformative framework for the fusion of multi-modal sensor inputs. This BEV paradigm…

Computer Vision and Pattern Recognition · Computer Science 2024-10-11 Yuxin Li , Yiheng Li , Xulei Yang , Mengying Yu , Zihang Huang , Xiaojun Wu , Chai Kiat Yeo

Bird's-eye-view (BEV) grid is a typical representation of the perception of road components, e.g., drivable area, in autonomous driving. Most existing approaches rely on cameras only to perform segmentation in BEV space, which is…

Computer Vision and Pattern Recognition · Computer Science 2023-06-07 Shubhankar Borse , Senthil Yogamani , Marvin Klingner , Varun Ravi , Hong Cai , Abdulaziz Almuzairee , Fatih Porikli

World models have attracted increasing attention in autonomous driving for their ability to forecast potential future scenarios. In this paper, we propose BEVWorld, a novel framework that transforms multimodal sensor inputs into a unified…

Computer Vision and Pattern Recognition · Computer Science 2025-05-01 Yumeng Zhang , Shi Gong , Kaixin Xiong , Xiaoqing Ye , Xiaofan Li , Xiao Tan , Fan Wang , Jizhou Huang , Hua Wu , Haifeng Wang

Bird's-Eye-View (BEV) perception has become a vital component of autonomous driving systems due to its ability to integrate multiple sensor inputs into a unified representation, enhancing performance in various downstream tasks. However,…

Robotics · Computer Science 2024-10-10 Yuxin Li , Yiheng Li , Xulei Yang , Mengying Yu , Zihang Huang , Xiaojun Wu , Chai Kiat Yeo

Accurate and robust multimodal multi-task perception is crucial for modern autonomous driving systems. However, current multimodal perception research follows independent paradigms designed for specific perception tasks, leading to a lack…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Xiao Zhao , Xukun Zhang , Dingkang Yang , Mingyang Sun , Mingcheng Li , Shunli Wang , Lihua Zhang

Semantic scene segmentation from a bird's-eye-view (BEV) perspective plays a crucial role in facilitating planning and decision-making for mobile robots. Although recent vision-only methods have demonstrated notable advancements in…

The integration of Large Language Models (LLMs) into autonomous driving has attracted growing interest for their strong reasoning and semantic understanding abilities, which are essential for handling complex decision-making and long-tail…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Thomas Monninger , Shaoyuan Xie , Qi Alfred Chen , Sihao Ding

3D object detection in Bird's-Eye-View (BEV) space has recently emerged as a prevalent approach in the field of autonomous driving. Despite the demonstrated improvements in accuracy and velocity estimation compared to perspective view…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Yuxin Li , Qiang Han , Mengying Yu , Yuxin Jiang , Chaikiat Yeo , Yiheng Li , Zihang Huang , Nini Liu , Hsuanhan Chen , Xiaojun Wu

Spatial understanding of the semantics of the surroundings is a key capability needed by autonomous cars to enable safe driving decisions. Recently, purely vision-based solutions have gained increasing research interest. In particular,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-03 Christian Witte , Jens Behley , Cyrill Stachniss , Marvin Raaijmakers

As a cornerstone technique for autonomous driving, Bird's Eye View (BEV) segmentation has recently achieved remarkable progress with pinhole cameras. However, it is non-trivial to extend the existing methods to fisheye cameras with severe…

Computer Vision and Pattern Recognition · Computer Science 2025-09-18 Hang Li , Dianmo Sheng , Qiankun Dong , Zichun Wang , Zhiwei Xu , Tao Li

Bird's-eye-view (BEV) representation is crucial for the perception function in autonomous driving tasks. It is difficult to balance the accuracy, efficiency and range of BEV representation. The existing works are restricted to a limited…

Computer Vision and Pattern Recognition · Computer Science 2024-07-12 Hang Wu , Zhenghao Zhang , Siyuan Lin , Tong Qin , Jin Pan , Qiang Zhao , Chunjing Xu , Ming Yang

Accurate environment perception is essential for automated driving. When using monocular cameras, the distance estimation of elements in the environment poses a major challenge. Distances can be more easily estimated when the camera…

Computer Vision and Pattern Recognition · Computer Science 2020-05-11 Lennart Reiher , Bastian Lampe , Lutz Eckstein

Detection of moving objects is a very important task in autonomous driving systems. After the perception phase, motion planning is typically performed in Bird's Eye View (BEV) space. This would require projection of objects detected on the…

Computer Vision and Pattern Recognition · Computer Science 2021-07-13 Hazem Rashed , Mariam Essam , Maha Mohamed , Ahmad El Sallab , Senthil Yogamani

Integrating LiDAR and Camera information into Bird's-Eye-View (BEV) has become an essential topic for 3D object detection in autonomous driving. Existing methods mostly adopt an independent dual-branch framework to generate LiDAR and camera…

Computer Vision and Pattern Recognition · Computer Science 2023-03-31 Hongxiang Cai , Zeyuan Zhang , Zhenyu Zhou , Ziyin Li , Wenbo Ding , Jiuhua Zhao

Existing LiDAR-based 3D object detection methods for autonomous driving scenarios mainly adopt the training-from-scratch paradigm. Unfortunately, this paradigm heavily relies on large-scale labeled data, whose collection can be expensive…

Computer Vision and Pattern Recognition · Computer Science 2024-01-23 Zhiwei Lin , Yongtao Wang , Shengxiang Qi , Nan Dong , Ming-Hsuan Yang