English

A Lightweight and Detector-free 3D Single Object Tracker on Point Clouds

Computer Vision and Pattern Recognition 2023-02-14 v2

Abstract

Recent works on 3D single object tracking treat the task as a target-specific 3D detection task, where an off-the-shelf 3D detector is commonly employed for the tracking. However, it is non-trivial to perform accurate target-specific detection since the point cloud of objects in raw LiDAR scans is usually sparse and incomplete. In this paper, we address this issue by explicitly leveraging temporal motion cues and propose DMT, a Detector-free Motion-prediction-based 3D Tracking network that completely removes the usage of complicated 3D detectors and is lighter, faster, and more accurate than previous trackers. Specifically, the motion prediction module is first introduced to estimate a potential target center of the current frame in a point-cloud-free manner. Then, an explicit voting module is proposed to directly regress the 3D box from the estimated target center. Extensive experiments on KITTI and NuScenes datasets demonstrate that our DMT can still achieve better performance (~10% improvement over the NuScenes dataset) and a faster tracking speed (i.e., 72 FPS) than state-of-the-art approaches without applying any complicated 3D detectors. Our code is released at \url{https://github.com/jimmy-dq/DMT}

Keywords

Cite

@article{arxiv.2203.04232,
  title  = {A Lightweight and Detector-free 3D Single Object Tracker on Point Clouds},
  author = {Yan Xia and Qiangqiang Wu and Wei Li and Antoni B. Chan and Uwe Stilla},
  journal= {arXiv preprint arXiv:2203.04232},
  year   = {2023}
}

Comments

Accepted by IEEE Transactions on Intelligent Transportation Systems 2023

R2 v1 2026-06-24T10:06:18.859Z