English
Related papers

Related papers: Li3DeTr: A LiDAR based 3D Detection Transformer

200 papers

We present a robust real-time LiDAR 3D object detector that leverages heteroscedastic aleatoric uncertainties to significantly improve its detection performance. A multi-loss function is designed to incorporate uncertainty estimations…

Robotics · Computer Science 2019-05-07 Di Feng , Lars Rosenbaum , Fabian Timm , Klaus Dietmayer

3D object detectors are fundamental components of perception systems in autonomous vehicles. While these detectors achieve remarkable performance on standard autonomous driving benchmarks, they often struggle to generalize across different…

Computer Vision and Pattern Recognition · Computer Science 2026-01-01 Bartłomiej Olber , Jakub Winter , Paweł Wawrzyński , Andrii Gamalii , Daniel Górniak , Marcin Łojek , Robert Nowak , Krystian Radlak

Estimating and understanding the surroundings of the vehicle precisely forms the basic and crucial step for the autonomous vehicle. The perception system plays a significant role in providing an accurate interpretation of a vehicle's…

Computer Vision and Pattern Recognition · Computer Science 2022-03-16 Sreenivasa Hikkal Venugopala

In a point cloud sequence, 3D object tracking aims to predict the location and orientation of an object in the current search point cloud given a template point cloud. Motivated by the success of transformers, we propose Point Tracking…

Computer Vision and Pattern Recognition · Computer Science 2022-03-31 Changqing Zhou , Zhipeng Luo , Yueru Luo , Tianrui Liu , Liang Pan , Zhongang Cai , Haiyu Zhao , Shijian Lu

Detection Transformer (DETR) has redefined object detection by casting it as a set prediction task within an end-to-end framework. Despite its elegance, DETR and its variants still rely on fixed learnable queries and suffer from severe…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Zhengjian Kang , Jun Zhuang , Kangtong Mo , Qi Chen , Rui Liu , Ye Zhang

The purpose of this work is to review the state-of-the-art LiDAR-based 3D object detection methods, datasets, and challenges. We describe novel data augmentation methods, sampling strategies, activation functions, attention mechanisms, and…

Computer Vision and Pattern Recognition · Computer Science 2022-04-04 Walter Zimmer , Emec Ercelik , Xingcheng Zhou , Xavier Jair Diaz Ortiz , Alois Knoll

Recent advances in autonomous driving have underscored the importance of accurate 3D object detection, with LiDAR playing a central role due to its robustness under diverse visibility conditions. However, different vehicle platforms often…

Computer Vision and Pattern Recognition · Computer Science 2025-09-08 Satoshi Tanaka , Kok Seang Tan , Isamu Yamashita

The Detection Transformer (DETR) has revolutionized the design of CNN-based object detection systems, showcasing impressive performance. However, its potential in the domain of multi-frame 3D object detection remains largely unexplored. In…

Computer Vision and Pattern Recognition · Computer Science 2025-08-21 Yifan Zhang , Zhiyu Zhu , Junhui Hou , Dapeng Wu

As the perception range of LiDAR increases, LiDAR-based 3D object detection becomes a dominant task in the long-range perception task of autonomous driving. The mainstream 3D object detectors usually build dense feature maps in the network…

Computer Vision and Pattern Recognition · Computer Science 2022-10-04 Lue Fan , Feng Wang , Naiyan Wang , Zhaoxiang Zhang

We propose ST-DETR, a Spatio-Temporal Transformer-based architecture for object detection from a sequence of temporal frames. We treat the temporal frames as sequences in both space and time and employ the full attention mechanisms to take…

Computer Vision and Pattern Recognition · Computer Science 2021-07-27 Eslam Mohamed , Ahmad El-Sallab

Detecting objects in 3D LiDAR data is a core technology for autonomous driving and other robotics applications. Although LiDAR data is acquired over time, most of the 3D object detection algorithms propose object bounding boxes…

Computer Vision and Pattern Recognition · Computer Science 2020-07-27 Rui Huang , Wanyue Zhang , Abhijit Kundu , Caroline Pantofaru , David A Ross , Thomas Funkhouser , Alireza Fathi

Advanced Driver-Assistance Systems (ADAS) have successfully integrated learning-based techniques into vehicle perception and decision-making. However, their application in 3D lane detection for effective driving environment perception is…

Computer Vision and Pattern Recognition · Computer Science 2024-03-18 Runkai Zhao , Yuwen Heng , Heng Wang , Yuanda Gao , Shilei Liu , Changhao Yao , Jiawen Chen , Weidong Cai

In autonomous driving, LiDAR point-clouds and RGB images are two major data modalities with complementary cues for 3D object detection. However, it is quite difficult to sufficiently use them, due to large inter-modal discrepancies. To…

Computer Vision and Pattern Recognition · Computer Science 2022-04-05 Yanan Zhang , Jiaxin Chen , Di Huang

Vision Transformers (ViTs) have achieved state-of-the-art results on various computer vision tasks, including 3D object detection. However, their end-to-end implementation also makes ViTs less explainable, which can be a challenge for…

Computer Vision and Pattern Recognition · Computer Science 2023-12-25 Till Beemelmanns , Wassim Zahr , Lutz Eckstein

End-to-end perception and trajectory prediction from raw sensor data is one of the key capabilities for autonomous driving. Modular pipelines restrict information flow and can amplify upstream errors. Recent query-based, fully…

Computer Vision and Pattern Recognition · Computer Science 2026-01-29 Matej Halinkovic , Nina Masarykova , Alexey Vinel , Marek Galinski

Recent progress in 3D object detection from single images leverages monocular depth estimation as a way to produce 3D pointclouds, turning cameras into pseudo-lidar sensors. These two-stage detectors improve with the accuracy of the…

Computer Vision and Pattern Recognition · Computer Science 2021-08-17 Dennis Park , Rares Ambrus , Vitor Guizilini , Jie Li , Adrien Gaidon

Following the tracking-by-attention paradigm, this paper introduces an object-centric, transformer-based framework for tracking in 3D. Traditional model-based tracking approaches incorporate the geometric effect of object- and ego motion…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Simon Doll , Niklas Hanselmann , Lukas Schneider , Richard Schulz , Markus Enzweiler , Hendrik P. A. Lensch

We present Voxel Transformer (VoTr), a novel and effective voxel-based Transformer backbone for 3D object detection from point clouds. Conventional 3D convolutional backbones in voxel-based 3D detectors cannot efficiently capture large…

Computer Vision and Pattern Recognition · Computer Science 2021-09-14 Jiageng Mao , Yujing Xue , Minzhe Niu , Haoyue Bai , Jiashi Feng , Xiaodan Liang , Hang Xu , Chunjing Xu

The ability to detect and segment moving objects in a scene is essential for building consistent maps, making future state predictions, avoiding collisions, and planning. In this paper, we address the problem of moving object segmentation…

End-to-end Object Detection with Transformer (DETR)proposes to perform object detection with Transformer and achieve comparable performance with two-stage object detection like Faster-RCNN. However, DETR needs huge computational resources…

Computer Vision and Pattern Recognition · Computer Science 2021-10-19 Minghang Zheng , Peng Gao , Renrui Zhang , Kunchang Li , Xiaogang Wang , Hongsheng Li , Hao Dong