English
Related papers

Related papers: BEVMOSNet: Multimodal Fusion for BEV Moving Object…

200 papers

Bird's eye view (BEV) representation has emerged as a dominant solution for describing 3D space in autonomous driving scenarios. However, objects in the BEV representation typically exhibit small sizes, and the associated point cloud…

Computer Vision and Pattern Recognition · Computer Science 2024-03-25 Junbo Yin , Jianbing Shen , Runnan Chen , Wei Li , Ruigang Yang , Pascal Frossard , Wenguan Wang

In autonomous driving, LiDAR and radar are crucial for environmental perception. LiDAR offers precise 3D spatial sensing information but struggles in adverse weather like fog. Conversely, radar signals can penetrate rain or mist due to…

Computer Vision and Pattern Recognition · Computer Science 2024-02-07 Yanlong Yang , Jianan Liu , Tao Huang , Qing-Long Han , Gang Ma , Bing Zhu

Fusing the camera and LiDAR information has become a de-facto standard for 3D object detection tasks. Current methods rely on point clouds from the LiDAR sensor as queries to leverage the feature from the image space. However, people…

Computer Vision and Pattern Recognition · Computer Science 2022-11-14 Tingting Liang , Hongwei Xie , Kaicheng Yu , Zhongyu Xia , Zhiwei Lin , Yongtao Wang , Tao Tang , Bing Wang , Zhi Tang

Multi-sensor object detection is an active research topic in automated driving, but the robustness of such detection models against missing sensor input (modality missing), e.g., due to a sudden sensor failure, is a critical problem which…

Computer Vision and Pattern Recognition · Computer Science 2024-05-09 Shiming Wang , Holger Caesar , Liangliang Nan , Julian F. P. Kooij

Automotive traffic scenes are complex due to the variety of possible scenarios, objects, and weather conditions that need to be handled. In contrast to more constrained environments, such as automated underground trains, automotive…

Computer Vision and Pattern Recognition · Computer Science 2021-06-29 Felix Nobis , Ehsan Shafiei , Phillip Karle , Johannes Betz , Markus Lienkamp

Autonomous driving perceives its surroundings for decision making, which is one of the most complex scenarios in visual perception. The success of paradigm innovation in solving the 2D object detection task inspires us to seek an elegant,…

Computer Vision and Pattern Recognition · Computer Science 2022-06-17 Junjie Huang , Guan Huang , Zheng Zhu , Yun Ye , Dalong Du

In the landscape of autonomous driving, Bird's-Eye-View (BEV) representation has recently garnered substantial academic attention, serving as a transformative framework for the fusion of multi-modal sensor inputs. This BEV paradigm…

Computer Vision and Pattern Recognition · Computer Science 2024-10-11 Yuxin Li , Yiheng Li , Xulei Yang , Mengying Yu , Zihang Huang , Xiaojun Wu , Chai Kiat Yeo

The Bird-Eye-View (BEV) is one of the most widely-used scene representations for visual perception in Autonomous Vehicles (AVs) due to its well suited compatibility to downstream tasks. For the enhanced safety of AVs, modeling perception…

Computer Vision and Pattern Recognition · Computer Science 2023-12-20 Asen Nachkov , Martin Danelljan , Danda Pani Paudel , Luc Van Gool

Bird's-eye-view (BEV) grid is a common representation for the perception of road components, e.g., drivable area, in autonomous driving. Most existing approaches rely on cameras only to perform segmentation in BEV space, which is…

Computer Vision and Pattern Recognition · Computer Science 2022-11-01 Shubhankar Borse , Marvin Klingner , Varun Ravi Kumar , Hong Cai , Abdulaziz Almuzairee , Senthil Yogamani , Fatih Porikli

Accurate and robust 3D object detection is a critical component in autonomous vehicles and robotics. While recent radar-camera fusion methods have made significant progress by fusing information in the bird's-eye view (BEV) representation,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-12 Jisong Kim , Minjae Seong , Jun Won Choi

Visual bird's eye view (BEV) semantic segmentation helps autonomous vehicles understand the surrounding environment only from images, including static elements (e.g., roads) and dynamic elements (e.g., vehicles, pedestrians). However, the…

Computer Vision and Pattern Recognition · Computer Science 2024-02-27 Junyu Zhu , Lina Liu , Yu Tang , Feng Wen , Wanlong Li , Yong Liu

Recently, 3D object detection has attracted significant attention and achieved continuous improvement in real road scenarios. The environmental information is collected from a single sensor or multi-sensor fusion to detect interested…

Computer Vision and Pattern Recognition · Computer Science 2023-06-30 Hongwei Liu , Jian Yang , Jianfeng Zhang , Dongheng Shao , Jielong Guo , Shaobo Li , Xuan Tang , Xian Wei

Efficient relocalization is essential for intelligent vehicles when GPS reception is insufficient or sensor-based localization fails. Recent advances in Bird's-Eye-View (BEV) segmentation allow for accurate estimation of local scene…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Andrea Boscolo Camiletto , Alfredo Bochicchio , Alexander Liniger , Dengxin Dai , Abel Gawel

Recent advancements in perception for autonomous driving are driven by deep learning. In order to achieve robust and accurate scene understanding, autonomous vehicles are usually equipped with different sensors (e.g. cameras, LiDARs,…

3D visual perception tasks, including 3D detection and map segmentation based on multi-camera images, are essential for autonomous driving systems. In this work, we present a new framework termed BEVFormer, which learns unified BEV…

Computer Vision and Pattern Recognition · Computer Science 2022-07-14 Zhiqi Li , Wenhai Wang , Hongyang Li , Enze Xie , Chonghao Sima , Tong Lu , Qiao Yu , Jifeng Dai

With the attention gained by camera-only 3D object detection in autonomous driving, methods based on Bird-Eye-View (BEV) representation especially derived from the forward view transformation paradigm, i.e., lift-splat-shoot (LSS), have…

Computer Vision and Pattern Recognition · Computer Science 2024-11-20 Weijie Ma , Jingwei Jiang , Yang Yang , Zehui Chen , Hao Chen

Bird's-eye-view (BEV) grid is a typical representation of the perception of road components, e.g., drivable area, in autonomous driving. Most existing approaches rely on cameras only to perform segmentation in BEV space, which is…

Computer Vision and Pattern Recognition · Computer Science 2023-06-07 Shubhankar Borse , Senthil Yogamani , Marvin Klingner , Varun Ravi , Hong Cai , Abdulaziz Almuzairee , Fatih Porikli

Bird's eye view (BEV) semantic segmentation plays a crucial role in spatial sensing for autonomous driving. Although recent literature has made significant progress on BEV map understanding, they are all based on single-agent camera-based…

Computer Vision and Pattern Recognition · Computer Science 2022-09-27 Runsheng Xu , Zhengzhong Tu , Hao Xiang , Wei Shao , Bolei Zhou , Jiaqi Ma

Accurate 3D object detection in autonomous driving is critical yet challenging due to occlusions, varying object sizes, and complex urban environments. This paper introduces the KAN-RCBEVDepth method, an innovative approach aimed at…

Computer Vision and Pattern Recognition · Computer Science 2024-08-28 Zhihao Lai , Chuanhao Liu , Shihui Sheng , Zhiqiang Zhang

The fusion of multimodal sensor streams, such as camera, lidar, and radar measurements, plays a critical role in object detection for autonomous vehicles, which base their decision making on these inputs. While existing methods exploit…

Computer Vision and Pattern Recognition · Computer Science 2020-07-01 Mario Bijelic , Tobias Gruber , Fahim Mannan , Florian Kraus , Werner Ritter , Klaus Dietmayer , Felix Heide