English
Related papers

Related papers: RayFormer: Improving Query-Based Multi-Camera 3D O…

200 papers

Integrating LiDAR and camera information in the bird's eye view (BEV) representation has demonstrated its effectiveness in 3D object detection. However, because of the fundamental disparity in geometric accuracy between these sensors,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-03 Guowen Zhang , Chenhang He , Liyi Chen , Lei Zhang

We address the problem of real-time 3D object detection from point clouds in the context of autonomous driving. Computation speed is critical as detection is a necessary component for safety. Existing approaches are, however, expensive in…

Computer Vision and Pattern Recognition · Computer Science 2019-03-05 Bin Yang , Wenjie Luo , Raquel Urtasun

Single frame data contains finite information which limits the performance of the existing vision-based multi-camera 3D object detection paradigms. For fundamentally pushing the performance boundary in this area, a novel paradigm dubbed…

Computer Vision and Pattern Recognition · Computer Science 2022-06-17 Junjie Huang , Guan Huang

When localizing and detecting 3D objects for autonomous driving scenes, obtaining information from multiple sensor (e.g. camera, LIDAR) typically increases the robustness of 3D detectors. However, the efficient and effective fusion of…

Computer Vision and Pattern Recognition · Computer Science 2020-09-11 Can Chen , Luca Zanotti Fragonara , Antonios Tsourdos

Novel view synthesis is a long-standing problem. In this work, we consider a variant of the problem where we are given only a few context views sparsely covering a scene or an object. The goal is to predict novel viewpoints in the scene,…

Computer Vision and Pattern Recognition · Computer Science 2022-07-22 Jonáš Kulhánek , Erik Derner , Torsten Sattler , Robert Babuška

We propose an approach for 3D reconstruction and segmentation of a single object placed on a flat surface from an input video. Our approach is to perform dense depth map estimation for multiple views using a proposed objective function that…

Computer Vision and Pattern Recognition · Computer Science 2016-07-29 Tanmay Gupta , Daeyun Shin , Naren Sivagnanadasan , Derek Hoiem

Simultaneous perception of 2D objects in perspective view and 3D objects in Bird's Eye View (BEV) is challenging for multi-camera autonomous driving. Existing two-stage pipelines use 2D results only as a one-time cue for 3D detection. We…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Yingqi Tang , Zhaotie Meng , Erkang Cheng , Haibin Ling

Accurate multi-view 3D object detection is essential for applications such as autonomous driving. Researchers have consistently aimed to leverage LiDAR's precise spatial information to enhance camera-based detectors through methods like…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Shaoqing Xu , Fang Li , Peixiang Huang , Ziying Song , Zhi-Xin Yang

Multi-sensor fusion is essential for an accurate and reliable autonomous driving system. Recent approaches are based on point-level fusion: augmenting the LiDAR point cloud with camera features. However, the camera-to-LiDAR projection…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Zhijian Liu , Haotian Tang , Alexander Amini , Xinyu Yang , Huizi Mao , Daniela Rus , Song Han

Visual bird's eye view (BEV) perception, due to its excellent perceptual capabilities, is progressively replacing costly LiDAR-based perception systems, especially in the realm of urban intelligent driving. However, this type of perception…

Computer Vision and Pattern Recognition · Computer Science 2024-09-10 Lei He , Qiaoyi Wang , Honglin Sun , Qing Xu , Bolin Gao , Shengbo Eben Li , Jianqiang Wang , Keqiang Li

In this work, we present a conceptually simple yet effective framework for cross-modality 3D object detection, named voxel field fusion. The proposed approach aims to maintain cross-modality consistency by representing and fusing augmented…

Computer Vision and Pattern Recognition · Computer Science 2022-06-01 Yanwei Li , Xiaojuan Qi , Yukang Chen , Liwei Wang , Zeming Li , Jian Sun , Jiaya Jia

Modern autonomous vehicles rely heavily on mechanical LiDARs for perception. Current perception methods generally require 360{\deg} point clouds, collected sequentially as the LiDAR scans the azimuth and acquires consecutive wedge-shaped…

Computer Vision and Pattern Recognition · Computer Science 2022-09-13 Mazen Abdelfattah , Kaiwen Yuan , Z. Jane Wang , Rabab Ward

Video object detection has been an important yet challenging topic in computer vision. Traditional methods mainly focus on designing the image-level or box-level feature propagation strategies to exploit temporal information. This paper…

Computer Vision and Pattern Recognition · Computer Science 2022-07-25 Fei He , Naiyu Gao , Jian Jia , Xin Zhao , Kaiqi Huang

This paper presents a new approach to 3D object detection that leverages the properties of the data obtained by a LiDAR sensor. State-of-the-art detectors use neural network architectures based on assumptions valid for camera images.…

Computer Vision and Pattern Recognition · Computer Science 2021-04-09 Guus Engels , Nerea Aranjuelo , Ignacio Arganda-Carreras , Marcos Nieto , Oihana Otaegui

3D object detection based on LiDAR point clouds is a crucial module in autonomous driving particularly for long range sensing. Most of the research is focused on achieving higher accuracy and these models are not optimized for deployment on…

Computer Vision and Pattern Recognition · Computer Science 2021-07-13 Sambit Mohapatra , Senthil Yogamani , Heinrich Gotzig , Stefan Milz , Patrick Mader

3D object detection from visual sensors is a cornerstone capability of robotic systems. State-of-the-art methods focus on reasoning and decoding object bounding boxes from multi-view camera input. In this work we gain intuition from the…

Computer Vision and Pattern Recognition · Computer Science 2023-04-10 Dian Chen , Jie Li , Vitor Guizilini , Rares Ambrus , Adrien Gaidon

3D multi-object tracking (MOT) is vital for many applications including autonomous driving vehicles and service robots. With the commonly used tracking-by-detection paradigm, 3D MOT has made important progress in recent years. However,…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Xuesong Chen , Shaoshuai Shi , Chao Zhang , Benjin Zhu , Qiang Wang , Ka Chun Cheung , Simon See , Hongsheng Li

Radars and cameras belong to the most frequently used sensors for advanced driver assistance systems and automated driving research. However, there has been surprisingly little research on radar-camera fusion with neural networks. One of…

Computer Vision and Pattern Recognition · Computer Science 2023-09-29 Lukas Stäcker , Shashank Mishra , Philipp Heidenreich , Jason Rambach , Didier Stricker

Remote sensing change detection aims to compare two or more images recorded for the same area but taken at different time stamps to quantitatively and qualitatively assess changes in geographical entities and environmental factors.…

Computer Vision and Pattern Recognition · Computer Science 2024-06-24 Xiaowen Ma , Zhenkai Wu , Rongrong Lian , Wei Zhang , Siyang Song

This paper presents Multi-view Labelling Object Detector (MLOD). The detector takes an RGB image and a LIDAR point cloud as input and follows the two-stage object detection framework. A Region Proposal Network (RPN) generates 3D proposals…

Computer Vision and Pattern Recognition · Computer Science 2019-09-11 Jian Deng , Krzysztof Czarnecki