English
Related papers

Related papers: BEVDilation: LiDAR-Centric Multi-Modal Fusion for …

200 papers

Safe autonomous agents and mobile robots need fast real time 3D perception, especially for vulnerable road users (VRUs) such as pedestrians. We introduce a new bird's eye view (BEV) encoding, which maps the full 3D LiDAR point cloud into a…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Mohammad Khoshkdahan , Alexey Vinel

Information inside visual and LiDAR data is well complementary derived from the fine-grained texture of images and massive geometric information in point clouds. However, it remains challenging to explore effective visual-LiDAR fusion,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Jiuming Liu , Dong Zhuo , Zhiheng Feng , Siting Zhu , Chensheng Peng , Zhe Liu , Hesheng Wang

Modern autonomous vehicles rely heavily on mechanical LiDARs for perception. Current perception methods generally require 360{\deg} point clouds, collected sequentially as the LiDAR scans the azimuth and acquires consecutive wedge-shaped…

Computer Vision and Pattern Recognition · Computer Science 2022-09-13 Mazen Abdelfattah , Kaiwen Yuan , Z. Jane Wang , Rabab Ward

State-of-the-art methods for driving-scene LiDAR-based perception (including point cloud semantic segmentation, panoptic segmentation and 3D detection, \etc) often project the point clouds to 2D space and then process them via 2D…

Computer Vision and Pattern Recognition · Computer Science 2021-09-14 Xinge Zhu , Hui Zhou , Tai Wang , Fangzhou Hong , Wei Li , Yuexin Ma , Hongsheng Li , Ruigang Yang , Dahua Lin

Bird's-eye-view (BEV) semantic segmentation is becoming crucial in autonomous driving systems. It realizes ego-vehicle surrounding environment perception by projecting 2D multi-view images into 3D world space. Recently, BEV segmentation has…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Jian Sun , Yuqi Dai , Chi-Man Vong , Qing Xu , Shengbo Eben Li , Jianqiang Wang , Lei He , Keqiang Li

Multi-view 3D object detection is becoming popular in autonomous driving due to its high effectiveness and low cost. Most of the current state-of-the-art detectors follow the query-based bird's-eye-view (BEV) paradigm, which benefits from…

Computer Vision and Pattern Recognition · Computer Science 2023-06-05 Zhangyang Qi , Jiaqi Wang , Xiaoyang Wu , Hengshuang Zhao

3D object tracking in point clouds is still a challenging problem due to the sparsity of LiDAR points in dynamic environments. In this work, we propose a Siamese voxel-to-BEV tracker, which can significantly improve the tracking performance…

Computer Vision and Pattern Recognition · Computer Science 2021-11-18 Le Hui , Lingpeng Wang , Mingmei Cheng , Jin Xie , Jian Yang

Multi-sensor fusion-based road segmentation plays an important role in the intelligent driving system since it provides a drivable area. The existing mainstream fusion method is mainly to feature fusion in the image space domain which…

Computer Vision and Pattern Recognition · Computer Science 2020-04-21 Haoran Li , Yaran Chen , Qichao Zhang , Dongbin Zhao

3D object detection from LiDAR data for autonomous driving has been making remarkable strides in recent years. Among the state-of-the-art methodologies, encoding point clouds into a bird's eye view (BEV) has been demonstrated to be both…

Computer Vision and Pattern Recognition · Computer Science 2022-08-09 Yantao Lu , Xuetao Hao , Yilan Li , Weiheng Chai , Shiqi Sun , Senem Velipasalar

Recent advancements in camera-based 3D object detection have introduced cross-modal knowledge distillation to bridge the performance gap with LiDAR 3D detectors, leveraging the precise geometric information in LiDAR point clouds. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Sanmin Kim , Youngseok Kim , Sihwan Hwang , Hyeonjun Jeong , Dongsuk Kum

The Bird's-Eye-View (BEV) representation is a critical factor that directly impacts the 3D object detection performance, but the traditional BEV grid representation induces quadratic computational cost as the spatial resolution grows. To…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Zhili Chen , Shuangjie Xu , Maosheng Ye , Zian Qian , Xiaoyi Zou , Dit-Yan Yeung , Qifeng Chen

Multi-sensor fusion using LiDAR and RGB cameras significantly enhances 3D object detection task. However, conventional LiDAR sensors perform dense, stateless scans, ignoring the strong temporal continuity in real-world scenes. This leads to…

Computer Vision and Pattern Recognition · Computer Science 2025-11-17 Sara Shoouri , Morteza Tavakoli Taba , Hun-Seok Kim

Vision-centric Bird's Eye View (BEV) perception holds considerable promise for autonomous driving. Recent studies have prioritized efficiency or accuracy enhancements, yet the issue of domain shift has been overlooked, leading to…

Computer Vision and Pattern Recognition · Computer Science 2025-09-18 Rongyu Zhang , Jiaming Liu , Xiaoqi Li , Xiaowei Chi , Dan Wang , Li Du , Yuan Du , Shanghang Zhang

Bird's eye view (BEV) representation has emerged as a dominant solution for describing 3D space in autonomous driving scenarios. However, objects in the BEV representation typically exhibit small sizes, and the associated point cloud…

Computer Vision and Pattern Recognition · Computer Science 2024-03-25 Junbo Yin , Jianbing Shen , Runnan Chen , Wei Li , Ruigang Yang , Pascal Frossard , Wenguan Wang

Detecting objects in 3D space using multiple cameras, known as Multi-Camera 3D Object Detection (MC3D-Det), has gained prominence with the advent of bird's-eye view (BEV) approaches. However, these methods often struggle when faced with…

Computer Vision and Pattern Recognition · Computer Science 2023-12-27 Hao Lu , Yunpeng Zhang , Qing Lian , Dalong Du , Yingcong Chen

There are two critical sensors for 3D perception in autonomous driving, the camera and the LiDAR. The camera provides rich semantic information such as color, texture, and the LiDAR reflects the 3D shape and locations of surrounding…

Computer Vision and Pattern Recognition · Computer Science 2022-05-31 Kaicheng Yu , Tang Tao , Hongwei Xie , Zhiwei Lin , Zhongwei Wu , Zhongyu Xia , Tingting Liang , Haiyang Sun , Jiong Deng , Dayang Hao , Yongtao Wang , Xiaodan Liang , Bing Wang

The ability to accurately detect and localize objects is recognized as being the most important for the perception of self-driving cars. From 2D to 3D object detection, the most difficult is to determine the distance from the ego-vehicle to…

Computer Vision and Pattern Recognition · Computer Science 2021-05-31 Nguyen Anh Minh Mai , Pierre Duthon , Louahdi Khoudour , Alain Crouzil , Sergio A. Velastin

LiDAR has become one of the primary 3D object detection sensors in autonomous driving. However, LiDAR's diverging point pattern with increasing distance results in a non-uniform sampled point cloud ill-suited to discretized volumetric…

Computer Vision and Pattern Recognition · Computer Science 2022-03-23 Jordan S. K. Hu , Tianshu Kuai , Steven L. Waslander

Single frame data contains finite information which limits the performance of the existing vision-based multi-camera 3D object detection paradigms. For fundamentally pushing the performance boundary in this area, a novel paradigm dubbed…

Computer Vision and Pattern Recognition · Computer Science 2022-06-17 Junjie Huang , Guan Huang

Accurate 3D lane estimation is crucial for ensuring safety in autonomous driving. However, prevailing monocular techniques suffer from depth loss and lighting variations, hampering accurate 3D lane detection. In contrast, LiDAR points offer…

Computer Vision and Pattern Recognition · Computer Science 2024-06-25 Yueru Luo , Shuguang Cui , Zhen Li