English
Related papers

Related papers: MOTS: Multi-Object Tracking and Segmentation

200 papers

Multi-Object Tracking (MOT) has been a long-standing challenge in video understanding. A natural and intuitive approach is to split this task into two parts: object detection and association. Most mainstream methods employ meticulously…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Ruopeng Gao , Ji Qi , Limin Wang

Existing referring understanding tasks tend to involve the detection of a single text-referred object. In this paper, we propose a new and general referring understanding task, termed referring multi-object tracking (RMOT). Its core idea is…

Computer Vision and Pattern Recognition · Computer Science 2023-03-14 Dongming Wu , Wencheng Han , Tiancai Wang , Xingping Dong , Xiangyu Zhang , Jianbing Shen

Most online multi-object trackers perform object detection stand-alone in a neural net without any input from tracking. In this paper, we present a new online joint detection and tracking model, TraDeS (TRAck to DEtect and Segment),…

Computer Vision and Pattern Recognition · Computer Science 2021-03-17 Jialian Wu , Jiale Cao , Liangchen Song , Yu Wang , Ming Yang , Junsong Yuan

Multi-object tracking (MOT) is a critical technology in computer vision, designed to detect multiple targets in video sequences and assign each target a unique ID per frame. Existed MOT methods excel at accurately tracking multiple objects…

Computer Vision and Pattern Recognition · Computer Science 2024-08-29 Lifan Jiang , Zhihui Wang , Siqi Yin , Guangxiao Ma , Peng Zhang , Boxi Wu

Multi-Object Tracking (MOT) aims to associate multiple objects across video frames and is a challenging vision task due to inherent complexities in the tracking environment. Most existing approaches train and track within a single domain,…

Computer Vision and Pattern Recognition · Computer Science 2024-11-01 Run Luo , Zikai Song , Longze Chen , Yunshui Li , Min Yang , Wei Yang

In this work, we present a new computer vision task named video object of interest segmentation (VOIS). Given a video and a target image of interest, our objective is to simultaneously segment and track all objects in the video that are…

Computer Vision and Pattern Recognition · Computer Science 2022-12-07 Siyuan Zhou , Chunru Zhan , Biao Wang , Tiezheng Ge , Yuning Jiang , Li Niu

We propose a semi-automatic bounding box annotation method for visual object tracking by utilizing temporal information with a tracking-by-detection approach. For detection, we use an off-the-shelf object detector which is trained…

Computer Vision and Pattern Recognition · Computer Science 2022-03-01 Kutalmis Gokalp Ince , Aybora Koksal , Arda Fazla , A. Aydin Alatan

Traditional multiple object tracking methods divide the task into two parts: affinity learning and data association. The separation of the task requires to define a hand-crafted training goal in affinity learning stage and a hand-crafted…

Computer Vision and Pattern Recognition · Computer Science 2018-08-07 Han Shen , Lichao Huang , Chang Huang , Wei Xu

Multiple Object Tracking (MOT) has rapidly progressed in recent years. Existing works tend to design a single tracking algorithm to perform both detection and association. Though ensemble learning has been exploited in many tasks, i.e,…

Computer Vision and Pattern Recognition · Computer Science 2023-02-20 Yunhao Du , Zihang Liu , Fei Su

Inspired by Segment Anything 2, which generalizes segmentation from images to videos, we propose SAM2MOT--a novel segmentation-driven paradigm for multi-object tracking that breaks away from the conventional detection-association framework.…

Computer Vision and Pattern Recognition · Computer Science 2025-11-19 Junjie Jiang , Zelin Wang , Manqi Zhao , Yin Li , DongSheng Jiang

Motion-based association for Multi-Object Tracking (MOT) has recently re-achieved prominence with the rise of powerful object detectors. Despite this, little work has been done to incorporate appearance cues beyond simple heuristic models…

Computer Vision and Pattern Recognition · Computer Science 2023-02-24 Gerard Maggiolino , Adnan Ahmad , Jinkun Cao , Kris Kitani

Multiple Object Tracking (MOT) is crucial to autonomous vehicle perception. End-to-end transformer-based algorithms, which detect and track objects simultaneously, show great potential for the MOT task. However, most existing methods focus…

Computer Vision and Pattern Recognition · Computer Science 2023-06-30 Ce Zhang , Chengjie Zhang , Yiluan Guo , Lingji Chen , Michael Happold

Multi-object tracking (MOT) aims at estimating bounding boxes and identities of objects in videos. Most methods obtain identities by associating detection boxes whose scores are higher than a threshold. The objects with low detection…

Computer Vision and Pattern Recognition · Computer Science 2022-04-08 Yifu Zhang , Peize Sun , Yi Jiang , Dongdong Yu , Fucheng Weng , Zehuan Yuan , Ping Luo , Wenyu Liu , Xinggang Wang

Multi-object tracking (MOT) is a challenging vision task that aims to detect individual objects within a single frame and associate them across multiple frames. Recent MOT approaches can be categorized into two-stage tracking-by-detection…

Computer Vision and Pattern Recognition · Computer Science 2024-02-22 Run Luo , Zikai Song , Lintao Ma , Jinlin Wei , Wei Yang , Min Yang

Current approaches in Multiple Object Tracking (MOT) rely on the spatio-temporal coherence between detections combined with object appearance to match objects from consecutive frames. In this work, we explore MOT using object appearances as…

Computer Vision and Pattern Recognition · Computer Science 2022-10-10 Andreu Girbau , Ferran Marqués , Shin'ichi Satoh

3D object detection has recently become popular due to many applications in robotics, augmented reality, autonomy, and image retrieval. We introduce the Objectron dataset to advance the state of the art in 3D object detection and foster new…

Computer Vision and Pattern Recognition · Computer Science 2020-12-21 Adel Ahmadyan , Liangkai Zhang , Jianing Wei , Artsiom Ablavatski , Matthias Grundmann

Online Multi-Object Tracking (MOT) from videos is a challenging computer vision task which has been extensively studied for decades. Most of the existing MOT algorithms are based on the Tracking-by-Detection (TBD) paradigm combined with…

Computer Vision and Pattern Recognition · Computer Science 2019-04-10 Zhen He , Jian Li , Daxue Liu , Hangen He , David Barber

Referring video object segmentation (RVOS) is a task that aims to segment the target object in all video frames based on a sentence describing the object. Although existing RVOS methods have achieved significant performance, they depend on…

Computer Vision and Pattern Recognition · Computer Science 2023-12-18 Wangbo Zhao , Kepan Nan , Songyang Zhang , Kai Chen , Dahua Lin , Yang You

State-of-the-art multi-object tracking~(MOT) methods follow the tracking-by-detection paradigm, where object trajectories are obtained by associating per-frame outputs of object detectors. In crowded scenes, however, detectors often fail to…

Computer Vision and Pattern Recognition · Computer Science 2021-02-03 Weihong Ren , Xinchao Wang , Jiandong Tian , Yandong Tang , Antoni B. Chan

Visual Multi-Object Tracking (MOT) is a crucial component of robotic perception, yet existing Tracking-By-Detection (TBD) methods often rely on 2D cues, such as bounding boxes and motion modeling, which struggle under occlusions and…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Buyin Deng , Lingxin Huang , Kai Luo , Fei Teng , Kailun Yang