English
Related papers

Related papers: Learning to Track Objects from Unlabeled Videos

200 papers

Single object tracking aims to localize target object with specific reference modalities (bounding box, natural language or both) in a sequence of specific video modalities (RGB, RGB+Depth, RGB+Thermal or RGB+Event.). Different reference…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Yinchao Ma , Yuyang Tang , Wenfei Yang , Tianzhu Zhang , Xu Zhou , Feng Wu

In this work, we study self-supervised multiple object tracking without using any video-level association labels. We propose to cast the problem of multiple object tracking as learning the frame-wise associations between detections in…

Computer Vision and Pattern Recognition · Computer Science 2023-05-18 Fatemeh Azimi , Fahim Mannan , Felix Heide

As an important area in computer vision, object tracking has formed two separate communities that respectively study Single Object Tracking (SOT) and Multiple Object Tracking (MOT). However, current methods in one tracking scenario are not…

Computer Vision and Pattern Recognition · Computer Science 2022-06-09 Fan Ma , Mike Zheng Shou , Linchao Zhu , Haoqi Fan , Yilei Xu , Yi Yang , Zhicheng Yan

Learning an object detector or retrieval requires a large data set with manual annotations. Such data sets are expensive and time consuming to create and therefore difficult to obtain on a large scale. In this work, we propose to exploit…

Computer Vision and Pattern Recognition · Computer Science 2019-10-22 Elad Amrani , Rami Ben-Ari , Tal Hakim , Alex Bronstein

Monocular 3D object tracking aims to estimate temporally consistent 3D object poses across video frames, enabling autonomous agents to reason about scene dynamics. However, existing state-of-the-art approaches are fully supervised and rely…

Robotics · Computer Science 2026-03-20 Nikhil Gosala , B. Ravi Kiran , Senthil Yogamani , Abhinav Valada

The objective of this paper is self-supervised representation learning, with the goal of solving semi-supervised video object segmentation (a.k.a. dense tracking). We make the following contributions: (i) we propose to improve the existing…

Computer Vision and Pattern Recognition · Computer Science 2020-06-23 Fangrui Zhu , Li Zhang , Yanwei Fu , Guodong Guo , Weidi Xie

Offline Siamese networks have achieved very promising tracking performance, especially in accuracy and efficiency. However, they often fail to track an object in complex scenes due to the incapacity in online update. Traditional updaters…

Computer Vision and Pattern Recognition · Computer Science 2021-05-03 Xinglong Sun , Guangliang Han , Lihong Guo , Tingfa Xu , Jianan Li , Peixun Liu

Unsupervised object-centric learning methods allow the partitioning of scenes into entities without additional localization information and are excellent candidates for reducing the annotation burden of multiple-object tracking (MOT)…

An unsupervised, lightweight and high-performance single object tracker, called UHP-SOT, was proposed by Zhou et al. recently. As an extension, we present an enhanced version and name it UHP-SOT++ in this work. Built upon the foundation of…

Computer Vision and Pattern Recognition · Computer Science 2022-04-08 Zhiruo Zhou , Hongyu Fu , Suya You , C. -C. Jay Kuo

Supervised trackers trained on labeled data dominate the single object tracking field for superior tracking accuracy. The labeling cost and the huge computational complexity hinder their applications on edge devices. Unsupervised learning…

Computer Vision and Pattern Recognition · Computer Science 2023-09-19 Zhiruo Zhou , Suya You , C. -C. Jay Kuo

Object detection has long been a topic of high interest in computer vision literature. Motivated by the fact that annotating data for the multi-object tracking (MOT) problem is immensely expensive, recent studies have turned their attention…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Son Tran , Cong Tran , Anh Tran , Cuong Pham

Supervised (pre-)training currently yields state-of-the-art performance for representation learning for visual recognition, yet it comes at the cost of (1) intensive manual annotations and (2) an inherent restriction in the scope of data…

Computer Vision and Pattern Recognition · Computer Science 2016-12-05 Ruohan Gao , Dinesh Jayaraman , Kristen Grauman

We address Unsupervised Video Object Segmentation (UVOS), the task of automatically generating accurate pixel masks for salient objects in a video sequence and of tracking these objects consistently through time, without any input about…

Computer Vision and Pattern Recognition · Computer Science 2020-01-16 Jonathon Luiten , Idil Esen Zulfikar , Bastian Leibe

Unsupervised localization and segmentation are long-standing robot vision challenges that describe the critical ability for an autonomous robot to learn to decompose images into individual objects without labeled data. These tasks are…

Computer Vision and Pattern Recognition · Computer Science 2023-07-26 Xinyu Zhang , Abdeslam Boularias

In this paper we illustrate how to perform both visual object tracking and semi-supervised video object segmentation, in real-time, with a single simple approach. Our method, dubbed SiamMask, improves the offline training procedure of…

Computer Vision and Pattern Recognition · Computer Science 2019-05-07 Qiang Wang , Li Zhang , Luca Bertinetto , Weiming Hu , Philip H. S. Torr

The ability to localize and segment objects from unseen classes would open the door to new applications, such as autonomous object learning in active vision. Nonetheless, improving the performance on unseen classes requires additional…

Computer Vision and Pattern Recognition · Computer Science 2021-08-24 Yuming Du , Yang Xiao , Vincent Lepetit

3D single object tracking (SOT) is an indispensable part of automated driving. Existing approaches rely heavily on large, densely labeled datasets. However, annotating point clouds is both costly and time-consuming. Inspired by the great…

Computer Vision and Pattern Recognition · Computer Science 2023-08-17 Qiao Wu , Jiaqi Yang , Kun Sun , Chu'ai Zhang , Yanning Zhang , Mathieu Salzmann

Distinguishing visually similar objects by their motion remains a critical challenge in computer vision. Although supervised trackers show promise, contemporary self-supervised trackers struggle when visual cues become ambiguous, limiting…

Computer Vision and Pattern Recognition · Computer Science 2025-12-03 Chenshuang Zhang , Kang Zhang , Joon Son Chung , In So Kweon , Junmo Kim , Chengzhi Mao

Training image-based object detectors presents formidable challenges, as it entails not only the complexities of object detection but also the added intricacies of precisely localizing objects within potentially diverse and noisy…

Computer Vision and Pattern Recognition · Computer Science 2024-02-22 Chandan Kumar , Jansel Herrera-Gerena , John Just , Matthew Darr , Ali Jannesari

We tackle the problem of learning object detectors without supervision. Differently from weakly-supervised object detection, we do not assume image-level class labels. Instead, we extract a supervisory signal from audio-visual data, using…

Computer Vision and Pattern Recognition · Computer Science 2022-07-12 Triantafyllos Afouras , Yuki M. Asano , Francois Fagan , Andrea Vedaldi , Florian Metze