English

MixCycle: Mixup Assisted Semi-Supervised 3D Single Object Tracking with Cycle Consistency

Computer Vision and Pattern Recognition 2023-08-17 v2

Abstract

3D single object tracking (SOT) is an indispensable part of automated driving. Existing approaches rely heavily on large, densely labeled datasets. However, annotating point clouds is both costly and time-consuming. Inspired by the great success of cycle tracking in unsupervised 2D SOT, we introduce the first semi-supervised approach to 3D SOT. Specifically, we introduce two cycle-consistency strategies for supervision: 1) Self tracking cycles, which leverage labels to help the model converge better in the early stages of training; 2) forward-backward cycles, which strengthen the tracker's robustness to motion variations and the template noise caused by the template update strategy. Furthermore, we propose a data augmentation strategy named SOTMixup to improve the tracker's robustness to point cloud diversity. SOTMixup generates training samples by sampling points in two point clouds with a mixing rate and assigns a reasonable loss weight for training according to the mixing rate. The resulting MixCycle approach generalizes to appearance matching-based trackers. On the KITTI benchmark, based on the P2B tracker, MixCycle trained with 10%\textbf{10\%} labels outperforms P2B trained with 100%\textbf{100\%} labels, and achieves a 28.4%\textbf{28.4\%} precision improvement when using 1%\textbf{1\%} labels. Our code will be released at \url{https://github.com/Mumuqiao/MixCycle}.

Keywords

Cite

@article{arxiv.2303.09219,
  title  = {MixCycle: Mixup Assisted Semi-Supervised 3D Single Object Tracking with Cycle Consistency},
  author = {Qiao Wu and Jiaqi Yang and Kun Sun and Chu'ai Zhang and Yanning Zhang and Mathieu Salzmann},
  journal= {arXiv preprint arXiv:2303.09219},
  year   = {2023}
}

Comments

Accepted by ICCV23

R2 v1 2026-06-28T09:20:00.422Z