English
Related papers

Related papers: Collaboration Helps Camera Overtake LiDAR in 3D De…

200 papers

Robust 3D object detection is critical for safe autonomous driving. Camera and radar sensors are synergistic as they capture complementary information and work well under different environmental conditions. Fusing camera and radar data is…

Computer Vision and Pattern Recognition · Computer Science 2022-10-19 Jyh-Jing Hwang , Henrik Kretzschmar , Joshua Manela , Sean Rafferty , Nicholas Armstrong-Crews , Tiffany Chen , Dragomir Anguelov

Light detection and ranging (LiDAR) have emerged as a crucial tool for high-resolution 3D imaging, particularly in autonomous vehicles, remote sensing, and augmented reality. However, the increasing demand for faster acquisition speed and…

Optics · Physics 2025-07-28 Yixiu Shen , Zi Heng Lim , Guangya Zhou

In autonomous driving, cooperative perception makes use of multi-view cameras from both vehicles and infrastructure, providing a global vantage point with rich semantic context of road conditions beyond a single vehicle viewpoint.…

Computer Vision and Pattern Recognition · Computer Science 2024-02-26 Zhe Wang , Siqi Fan , Xiaoliang Huo , Tongda Xu , Yan Wang , Jingjing Liu , Yilun Chen , Ya-Qin Zhang

3D object detection is a fundamental and challenging task for 3D scene understanding, and the monocular-based methods can serve as an economical alternative to the stereo-based or LiDAR-based methods. However, accurately detecting objects…

Computer Vision and Pattern Recognition · Computer Science 2022-01-27 Zhiyu Chong , Xinzhu Ma , Hong Zhang , Yuxin Yue , Haojie Li , Zhihui Wang , Wanli Ouyang

LiDAR and cameras are two complementary sensors for 3D perception in autonomous driving. LiDAR point clouds have accurate spatial and geometry information, while RGB images provide textural and color data for context reasoning. To exploit…

Computer Vision and Pattern Recognition · Computer Science 2022-09-27 Rui Wan , Shuangjie Xu , Wei Wu , Xiaoyi Zou , Tongyi Cao

Detecting objects such as cars and pedestrians in 3D plays an indispensable role in autonomous driving. Existing approaches largely rely on expensive LiDAR sensors for accurate depth information. While recently pseudo-LiDAR has been…

Computer Vision and Pattern Recognition · Computer Science 2020-02-18 Yurong You , Yan Wang , Wei-Lun Chao , Divyansh Garg , Geoff Pleiss , Bharath Hariharan , Mark Campbell , Kilian Q. Weinberger

Monocular 3D object detection has become a mainstream approach in automatic driving for its easy application. A prominent advantage is that it does not need LiDAR point clouds during the inference. However, most current methods still rely…

Computer Vision and Pattern Recognition · Computer Science 2023-03-16 Runzhou Tao , Wencheng Han , Zhongying Qiu , Cheng-zhong Xu , Jianbing Shen

Fusing data from LiDAR and camera is conceptually attractive because of their complementary properties. For instance, camera images are higher resolution and have colors, while LiDAR data provide more accurate range measurements and have a…

Robotics · Computer Science 2019-07-02 Weikun Zhen , Yaoyu Hu , Jingfeng Liu , Sebastian Scherer

Collaborative perception has been proven to improve individual perception in autonomous driving through multi-agent interaction. Nevertheless, most methods often assume identical encoders for all agents, which does not hold true when these…

Computer Vision and Pattern Recognition · Computer Science 2025-10-20 Yushan Han , Hui Zhang , Honglei Zhang , Chuntao Ding , Yuanzhouhan Cao , Yidong Li

Our study assesses the adversarial robustness of LiDAR-camera fusion models in 3D object detection. We introduce an attack technique that, by simply adding a limited number of physically constrained adversarial points above a car, can make…

Robotics · Computer Science 2024-01-10 Bo Yang , Xiaoyu Ji , Zizhi Jin , Yushi Cheng , Wenyuan Xu

Real-time monocular 3D object detection remains challenging due to severe depth ambiguity, viewpoint shifts, and the high computational cost of 3D reasoning. Existing approaches either rely on LiDAR or geometric priors to compensate for…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Johannes Meier , Jonathan Michel , Oussema Dhaouadi , Yung-Hsu Yang , Christoph Reich , Zuria Bauer , Stefan Roth , Marc Pollefeys , Jacques Kaiser , Daniel Cremers

Light detection and ranging (Lidar) data can be used to capture the depth and intensity profile of a 3D scene. This modality relies on constructing, for each pixel, a histogram of time delays between emitted light pulses and detected photon…

Image and Video Processing · Electrical Eng. & Systems 2019-09-13 Julián Tachella , Yoann Altmann , Ximing Ren , Aongus McCarthy , Gerald S. Buller , Jean-Yves Tourneret , Steve McLaughlin

Pseudo-LiDAR 3D detectors have made remarkable progress in monocular 3D detection by enhancing the capability of perceiving depth with depth estimation networks, and using LiDAR-based 3D detection architectures. The advanced stereo 3D…

Computer Vision and Pattern Recognition · Computer Science 2022-03-07 Yi-Nan Chen , Hang Dai , Yong Ding

Camera and 3D LiDAR sensors have become indispensable devices in modern autonomous driving vehicles, where the camera provides the fine-grained texture, color information in 2D space and LiDAR captures more precise and farther-away distance…

Computer Vision and Pattern Recognition · Computer Science 2021-08-18 Lin Zhao , Hui Zhou , Xinge Zhu , Xiao Song , Hongsheng Li , Wenbing Tao

Estimating the 3D position and orientation of objects in the environment with a single RGB camera is a critical and challenging task for low-cost urban autonomous driving and mobile robots. Most of the existing algorithms are based on the…

Computer Vision and Pattern Recognition · Computer Science 2021-02-02 Yuxuan Liu , Yuan Yixuan , Ming Liu

Collaborative perception allows each agent to enhance its perceptual abilities by exchanging messages with others. It inherently results in a trade-off between perception ability and communication costs. Previous works transmit complete…

Computer Vision and Pattern Recognition · Computer Science 2024-01-24 Yue Hu , Xianghe Pang , Xiaoqi Qin , Yonina C. Eldar , Siheng Chen , Ping Zhang , Wenjun Zhang

3D object detection from a single image without LiDAR is a challenging task due to the lack of accurate depth information. Conventional 2D convolutions are unsuitable for this task because they fail to capture local object and its scale…

Computer Vision and Pattern Recognition · Computer Science 2019-12-16 Mingyu Ding , Yuqi Huo , Hongwei Yi , Zhe Wang , Jianping Shi , Zhiwu Lu , Ping Luo

3D perception based on the representations learned from multi-camera bird's-eye-view (BEV) is trending as cameras are cost-effective for mass production in autonomous driving industry. However, there exists a distinct performance gap…

Computer Vision and Pattern Recognition · Computer Science 2023-09-27 Zeyu Wang , Dingwen Li , Chenxu Luo , Cihang Xie , Xiaodong Yang

3D object detection aims to predict object centers, dimensions, and rotations from LiDAR point clouds. Despite its simplicity, LiDAR captures only the near side of objects, making center-based detectors prone to poor localization accuracy…

Computer Vision and Pattern Recognition · Computer Science 2025-04-04 Ruixiao Zhang , Runwei Guan , Xiangyu Chen , Adam Prugel-Bennett , Xiaohao Cai

Monocular 3D object detection (Mono3D) in mobile settings (e.g., on a vehicle, a drone, or a robot) is an important yet challenging task. Due to the near-far disparity phenomenon of monocular vision and the ever-changing camera pose, it is…

Computer Vision and Pattern Recognition · Computer Science 2023-03-27 Yunsong Zhou , Quan Liu , Hongzi Zhu , Yunzhe Li , Shan Chang , Minyi Guo