English

Deep-LK for Efficient Adaptive Object Tracking

Computer Vision and Pattern Recognition 2017-05-31 v2

Abstract

In this paper we present a new approach for efficient regression based object tracking which we refer to as Deep- LK. Our approach is closely related to the Generic Object Tracking Using Regression Networks (GOTURN) framework of Held et al. We make the following contributions. First, we demonstrate that there is a theoretical relationship between siamese regression networks like GOTURN and the classical Inverse-Compositional Lucas & Kanade (IC-LK) algorithm. Further, we demonstrate that unlike GOTURN IC-LK adapts its regressor to the appearance of the currently tracked frame. We argue that this missing property in GOTURN can be attributed to its poor performance on unseen objects and/or viewpoints. Second, we propose a novel framework for object tracking - which we refer to as Deep-LK - that is inspired by the IC-LK framework. Finally, we show impressive results demonstrating that Deep-LK substantially outperforms GOTURN. Additionally, we demonstrate comparable tracking performance to current state of the art deep-trackers whilst being an order of magnitude (i.e. 100 FPS) computationally efficient.

Keywords

Cite

@article{arxiv.1705.06839,
  title  = {Deep-LK for Efficient Adaptive Object Tracking},
  author = {Chaoyang Wang and Hamed Kiani Galoogahi and Chen-Hsuan Lin and Simon Lucey},
  journal= {arXiv preprint arXiv:1705.06839},
  year   = {2017}
}
R2 v1 2026-06-22T19:52:05.588Z