English
Related papers

Related papers: ReMOTS: Self-Supervised Refining Multi-Object Trac…

200 papers

Multi-object tracking (MOT) aims to maintain consistent identities of objects across video frames. Associating objects in low-frame-rate videos captured by moving unmanned aerial vehicles (UAVs) in actual combat scenarios is complex due to…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Markiyan Kostiv , Anatolii Adamovskyi , Yevhen Cherniavskyi , Mykyta Varenyk , Ostap Viniavskyi , Igor Krashenyi , Oles Dobosevych

Self-supervised multi-object trackers have tremendous potential as they enable learning from raw domain-specific data. However, their re-identification accuracy still falls short compared to their supervised counterparts. We hypothesize…

Computer Vision and Pattern Recognition · Computer Science 2023-09-22 Christopher Lang , Alexander Braun , Lars Schillingmann , Abhinav Valada

Multi-Object Tracking (MOT) remains a vital component of intelligent video analysis, which aims to locate targets and maintain a consistent identity for each target throughout a video sequence. Existing works usually learn a discriminative…

Computer Vision and Pattern Recognition · Computer Science 2023-11-20 Yizhe Li , Sanping Zhou , Zheng Qin , Le Wang , Jinjun Wang , Nanning Zheng

The referring video object segmentation task (RVOS) aims to segment object instances in a given video referred by a language expression in all video frames. Due to the requirement of understanding cross-modal semantics within individual…

Computer Vision and Pattern Recognition · Computer Science 2022-06-27 Leilei Cao , Zhuang Li , Bo Yan , Feng Zhang , Fengliang Qi , Yuchen Hu , Hongbin Wang

Current multi-object tracking and segmentation (MOTS) methods follow the tracking-by-detection paradigm and adopt convolutions for feature extraction. However, as affected by the inherent receptive field, convolution based feature…

Computer Vision and Pattern Recognition · Computer Science 2020-07-06 Zhenbo Xu , Wei Zhang , Xiao Tan , Wei Yang , Huan Huang , Shilei Wen , Errui Ding , Liusheng Huang

Multi-Object Tracking (MOT) aims to associate multiple objects across video frames and is a challenging vision task due to inherent complexities in the tracking environment. Most existing approaches train and track within a single domain,…

Computer Vision and Pattern Recognition · Computer Science 2024-11-01 Run Luo , Zikai Song , Longze Chen , Yunshui Li , Min Yang , Wei Yang

Referring multi-object tracking (RMOT) is an emerging cross-modal task that aims to localize an arbitrary number of targets based on a language expression and continuously track them in a video. This intricate task involves reasoning on…

Computer Vision and Pattern Recognition · Computer Science 2025-07-28 Wenjun Huang , Yang Ni , Hanning Chen , Yirui He , Ian Bryant , Yezi Liu , Mohsen Imani

Multiple Object Tracking (MOT) has rapidly progressed in recent years. Existing works tend to design a single tracking algorithm to perform both detection and association. Though ensemble learning has been exploited in many tasks, i.e,…

Computer Vision and Pattern Recognition · Computer Science 2023-02-20 Yunhao Du , Zihang Liu , Fei Su

Referring video object segmentation (RVOS) aims to identify, track and segment the objects in a video based on language descriptions, which has received great attention in recent years. However, existing datasets remain focus on short video…

Computer Vision and Pattern Recognition · Computer Science 2025-10-29 Tianming Liang , Haichao Jiang , Yuting Yang , Chaolei Tan , Shuai Li , Wei-Shi Zheng , Jian-Fang Hu

Referring video object segmentation (RVOS) aims to segment video objects with the guidance of natural language reference. Previous methods typically tackle RVOS through directly grounding linguistic reference over the image lattice. Such…

Computer Vision and Pattern Recognition · Computer Science 2024-01-22 Chen Liang , Yu Wu , Tianfei Zhou , Wenguan Wang , Zongxin Yang , Yunchao Wei , Yi Yang

Motion-based association for Multi-Object Tracking (MOT) has recently re-achieved prominence with the rise of powerful object detectors. Despite this, little work has been done to incorporate appearance cues beyond simple heuristic models…

Computer Vision and Pattern Recognition · Computer Science 2023-02-24 Gerard Maggiolino , Adnan Ahmad , Jinkun Cao , Kris Kitani

Referring video object segmentation (RVOS), as a supervised learning task, relies on sufficient annotated data for a given scene. However, in more realistic scenarios, only minimal annotations are available for a new scene, which poses…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Guanghui Li , Mingqi Gao , Heng Liu , Xiantong Zhen , Feng Zheng

We introduce the problem of weakly supervised Multi-Object Tracking and Segmentation, i.e. joint weakly supervised instance segmentation and multi-object tracking, in which we do not provide any kind of mask annotation. To address it, we…

Computer Vision and Pattern Recognition · Computer Science 2021-01-05 Idoia Ruiz , Lorenzo Porzi , Samuel Rota Bulò , Peter Kontschieder , Joan Serrat

In this paper, we propose a highly practical fully online multi-object tracking and segmentation (MOTS) method that uses instance segmentation results as an input. The proposed method is based on the Gaussian mixture probability hypothesis…

Computer Vision and Pattern Recognition · Computer Science 2021-06-14 Young-min Song , Young-chul Yoon , Kwangjin Yoon , Moongu Jeon , Seong-Whan Lee , Witold Pedrycz

In recent years, dominant Multi-object tracking (MOT) and segmentation (MOTS) methods mainly follow the tracking-by-detection paradigm. Transformer-based end-to-end (E2E) solutions bring some ideas to MOT and MOTS, but they cannot achieve a…

Computer Vision and Pattern Recognition · Computer Science 2023-08-04 Kaer Huang , Bingchuan Sun , Feng Chen , Tao Zhang , Jun Xie , Jian Li , Christopher Walter Twombly , Zhepeng Wang

Identity Switching remains one of the main difficulties Multiple Object Tracking (MOT) algorithms have to deal with. Many state-of-the-art approaches now use sequence models to solve this problem but their training can be affected by biases…

Computer Vision and Pattern Recognition · Computer Science 2018-11-28 Andrii Maksai , Pascal Fua

The advancement of computer vision has pushed visual analysis tasks from still images to the video domain. In recent years, video instance segmentation, which aims to track and segment multiple objects in video frames, has drawn much…

Computer Vision and Pattern Recognition · Computer Science 2023-11-03 Yiming Cui , Cheng Han , Dongfang Liu

Storing intermediate frame segmentations as memory for long-range context modeling, spatial-temporal memory-based methods have recently showcased impressive results in semi-supervised video object segmentation (SVOS). However, these methods…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Hantao Zhou , Runze Hu , Xiu Li

In this paper, we propose a self-supervised learning procedure for training a robust multi-object tracking (MOT) model given only unlabeled video. While several self-supervisory learning signals have been proposed in prior work on…

Computer Vision and Pattern Recognition · Computer Science 2021-11-12 Favyen Bastani , Songtao He , Sam Madden

Motion Expression guided Video Segmentation is a challenging task that aims at segmenting objects in the video based on natural language expressions with motion descriptions. Unlike the previous referring video object segmentation (RVOS),…

Computer Vision and Pattern Recognition · Computer Science 2024-06-21 Bin Cao , Yisi Zhang , Xuanxu Lin , Xingjian He , Bo Zhao , Jing Liu