English
Related papers

Related papers: CoBEVT: Cooperative Bird's Eye View Semantic Segme…

200 papers

Perception is crucial for autonomous driving, but single-agent perception is often constrained by sensors' physical limitations, leading to degraded performance under severe occlusion, adverse weather conditions, and when detecting distant…

Computer Vision and Pattern Recognition · Computer Science 2025-02-03 Xiangbo Gao , Runsheng Xu , Jiachen Li , Ziran Wang , Zhiwen Fan , Zhengzhong Tu

We explore Bird's-Eye View (BEV) generation, converting a BEV map into its corresponding multi-view street images. Valued for its unified spatial representation aiding multi-sensor fusion, BEV is pivotal for various autonomous driving…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Xiaojie Xu , Tianshuo Xu , Fulong Ma , Yingcong Chen

Three-dimensional object detection is one of the key tasks in autonomous driving. To reduce costs in practice, low-cost multi-view cameras for 3D object detection are proposed to replace the expansive LiDAR sensors. However, relying solely…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Zhiwei Lin , Zhe Liu , Zhongyu Xia , Xinhao Wang , Yongtao Wang , Shengxiang Qi , Yang Dong , Nan Dong , Le Zhang , Ce Zhu

Recent works in autonomous driving have widely adopted the bird's-eye-view (BEV) semantic map as an intermediate representation of the world. Online prediction of these BEV maps involves non-trivial operations such as multi-camera data…

Computer Vision and Pattern Recognition · Computer Science 2023-03-01 Florent Bartoccioni , Éloi Zablocki , Andrei Bursuc , Patrick Pérez , Matthieu Cord , Karteek Alahari

Multi-view 3D object detection is becoming popular in autonomous driving due to its high effectiveness and low cost. Most of the current state-of-the-art detectors follow the query-based bird's-eye-view (BEV) paradigm, which benefits from…

Computer Vision and Pattern Recognition · Computer Science 2023-06-05 Zhangyang Qi , Jiaqi Wang , Xiaoyang Wu , Hengshuang Zhao

We present BEVCon, a simple yet effective contrastive learning framework designed to improve Bird's Eye View (BEV) perception in autonomous driving. BEV perception offers a top-down-view representation of the surrounding environment, making…

Computer Vision and Pattern Recognition · Computer Science 2025-08-07 Ziyang Leng , Jiawei Yang , Zhicheng Ren , Bolei Zhou

Recent advancements in bird's eye view (BEV) representations have shown remarkable promise for in-vehicle 3D perception. However, while these methods have achieved impressive results on standard benchmarks, their robustness in varied…

Computer Vision and Pattern Recognition · Computer Science 2025-02-04 Shaoyuan Xie , Lingdong Kong , Wenwei Zhang , Jiawei Ren , Liang Pan , Kai Chen , Ziwei Liu

This paper proposes an efficient multi-camera to Bird's-Eye-View (BEV) view transformation method for 3D perception, dubbed MatrixVT. Existing view transformers either suffer from poor transformation efficiency or rely on device-specific…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Hongyu Zhou , Zheng Ge , Zeming Li , Xiangyu Zhang

Vision-based bird's-eye-view (BEV) 3D object detection has advanced significantly in autonomous driving by offering cost-effectiveness and rich contextual information. However, existing methods often construct BEV representations by…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Jicheng Yuan , Manh Nguyen Duc , Qian Liu , Manfred Hauswirth , Danh Le Phuoc

Semantic scene segmentation from a bird's-eye-view (BEV) perspective plays a crucial role in facilitating planning and decision-making for mobile robots. Although recent vision-only methods have demonstrated notable advancements in…

3D object detection based on LiDAR point clouds is a crucial module in autonomous driving particularly for long range sensing. Most of the research is focused on achieving higher accuracy and these models are not optimized for deployment on…

Computer Vision and Pattern Recognition · Computer Science 2021-07-13 Sambit Mohapatra , Senthil Yogamani , Heinrich Gotzig , Stefan Milz , Patrick Mader

In the field of autonomous driving and mobile robotics, there has been a significant shift in the methods used to create Bird's Eye View (BEV) representations. This shift is characterised by using transformers and learning to fuse…

Robotics · Computer Science 2024-10-29 Mehdi Hosseinzadeh , Ian Reid

Collaborative perception has recently gained significant attention in autonomous driving, improving perception quality by enabling the exchange of additional information among vehicles. However, deploying collaborative perception systems…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Senkang Hu , Zhengru Fang , Yiqin Deng , Xianhao Chen , Yuguang Fang , Sam Kwong

Multi-agent collaborative perception enhances each agent perceptual capabilities by sharing sensing information to cooperatively perform robot perception tasks. This approach has proven effective in addressing challenges such as sensor…

Machine Learning · Computer Science 2025-07-02 Rujia Wang , Xiangbo Gao , Hao Xiang , Runsheng Xu , Zhengzhong Tu

We present an end-to-end method for object detection and trajectory prediction utilizing multi-view representations of LiDAR returns and camera images. In this work, we recognize the strengths and weaknesses of different view…

Computer Vision and Pattern Recognition · Computer Science 2021-10-20 Sudeep Fadadu , Shreyash Pandey , Darshan Hegde , Yi Shi , Fang-Chieh Chou , Nemanja Djuric , Carlos Vallespi-Gonzalez

We present a novel bird's-eye-view (BEV) detector with perspective supervision, which converges faster and better suits modern image backbones. Existing state-of-the-art BEV detectors are often tied to certain depth pre-trained backbones…

Computer Vision and Pattern Recognition · Computer Science 2022-11-21 Chenyu Yang , Yuntao Chen , Hao Tian , Chenxin Tao , Xizhou Zhu , Zhaoxiang Zhang , Gao Huang , Hongyang Li , Yu Qiao , Lewei Lu , Jie Zhou , Jifeng Dai

World models have attracted increasing attention in autonomous driving for their ability to forecast potential future scenarios. In this paper, we propose BEVWorld, a novel framework that transforms multimodal sensor inputs into a unified…

Computer Vision and Pattern Recognition · Computer Science 2025-05-01 Yumeng Zhang , Shi Gong , Kaixin Xiong , Xiaoqing Ye , Xiaofan Li , Xiao Tan , Fan Wang , Jizhou Huang , Hua Wu , Haifeng Wang

Currently, detecting 3D objects in Bird's-Eye-View (BEV) is superior to other 3D detectors for autonomous driving and robotics. However, transforming image features into BEV necessitates special operators to conduct feature sampling. These…

Computer Vision and Pattern Recognition · Computer Science 2022-08-22 Hongyu Zhou , Zheng Ge , Weixin Mao , Zeming Li

Bird's-eye-view (BEV) grid is a common representation for the perception of road components, e.g., drivable area, in autonomous driving. Most existing approaches rely on cameras only to perform segmentation in BEV space, which is…

Computer Vision and Pattern Recognition · Computer Science 2022-11-01 Shubhankar Borse , Marvin Klingner , Varun Ravi Kumar , Hong Cai , Abdulaziz Almuzairee , Senthil Yogamani , Fatih Porikli

Cooperative perception, which has a broader perception field than single-vehicle perception, has played an increasingly important role in autonomous driving to conduct 3D object detection. Through vehicle-to-vehicle (V2V) communication…

Information Theory · Computer Science 2023-11-14 Yucheng Sheng , Hao Ye , Le Liang , Shi Jin , Geoffrey Ye Li