English
Related papers

Related papers: Beyond MOT: Semantic Multi-Object Tracking

200 papers

Tracking multiple objects in videos relies on modeling the spatial-temporal interactions of the objects. In this paper, we propose a solution named TransMOT, which leverages powerful graph transformers to efficiently model the spatial and…

Computer Vision and Pattern Recognition · Computer Science 2021-04-06 Peng Chu , Jiang Wang , Quanzeng You , Haibin Ling , Zicheng Liu

We propose a method for multi-object tracking and segmentation based on a novel memory-based mechanism to associate tracklets. The proposed tracker, MeNToS, addresses particularly the long-term data association problem, when objects are not…

Computer Vision and Pattern Recognition · Computer Science 2023-05-18 Mehdi Miah , Guillaume-Alexandre Bilodeau , Nicolas Saunier

Modern multiple object tracking (MOT) systems usually follow the \emph{tracking-by-detection} paradigm. It has 1) a detection model for target localization and 2) an appearance embedding model for data association. Having the two models…

Computer Vision and Pattern Recognition · Computer Science 2020-07-15 Zhongdao Wang , Liang Zheng , Yixuan Liu , Yali Li , Shengjin Wang

Visual tracking has achieved considerable progress in recent years. However, current research in the field mainly focuses on tracking of opaque objects, while little attention is paid to transparent object tracking. In this paper, we make…

Computer Vision and Pattern Recognition · Computer Science 2021-08-03 Heng Fan , Halady Akhilesha Miththanthaya , Harshit , Siranjiv Ramana Rajan , Xiaoqiong Liu , Zhilin Zou , Yuewei Lin , Haibin Ling

Multi-object tracking in traffic videos is a crucial research area, offering immense potential for enhancing traffic monitoring accuracy and promoting road safety measures through the utilisation of advanced machine learning algorithms.…

Computer Vision and Pattern Recognition · Computer Science 2023-12-01 Lihao Liu , Yanqi Cheng , Zhongying Deng , Shujun Wang , Dongdong Chen , Xiaowei Hu , Pietro Liò , Carola-Bibiane Schönlieb , Angelica Aviles-Rivero

As a significant application of multi-source information fusion in intelligent transportation perception systems, Referring Multi-Object Tracking (RMOT) involves localizing and tracking specific objects in video sequences based on language…

Computer Vision and Pattern Recognition · Computer Science 2025-05-28 Shaofeng Liang , Runwei Guan , Wangwang Lian , Daizong Liu , Xiaolou Sun , Dongming Wu , Yutao Yue , Weiping Ding , Hui Xiong

Open-vocabulary multi-object tracking (OVMOT) represents a critical new challenge involving the detection and tracking of diverse object categories in videos, encompassing both seen categories (base classes) and unseen categories (novel…

Computer Vision and Pattern Recognition · Computer Science 2024-10-14 Zekun Qian , Ruize Han , Junhui Hou , Linqi Song , Wei Feng

Underwater Object Tracking (UOT) is crucial for efficient marine robotics, large scale ecological monitoring, and ocean exploration; however, progress has been hindered by the scarcity of large, multimodal, and diverse datasets. Existing…

Computer Vision and Pattern Recognition · Computer Science 2026-02-23 Ahsan Baidar Bakht , Mohamad Alansari , Muhayy Ud Din , Muzammal Naseer , Sajid Javed , Irfan Hussain , Jiri Matas , Arif Mahmood

The goal of multi-object tracking is to detect and track all objects in a scene while maintaining unique identifiers for each, by associating their bounding boxes across video frames. This association relies on matching motion and…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Momir Adžemović , Predrag Tadić , Andrija Petrović , Mladen Nikolić

This paper introduces MCTrack, a new 3D multi-object tracking method that achieves state-of-the-art (SOTA) performance across KITTI, nuScenes, and Waymo datasets. Addressing the gap in existing tracking paradigms, which often perform well…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Xiyang Wang , Shouzheng Qi , Jieyou Zhao , Hangning Zhou , Siyu Zhang , Guoan Wang , Kai Tu , Songlin Guo , Jianbo Zhao , Jian Li , Mu Yang

Multi-object tracking (MOT) is a rising topic in video processing technologies and has important application value in consumer electronics. Currently, tracking-by-detection (TBD) is the dominant paradigm for MOT, which performs target…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Yanchao Wang , Dawei Zhang , Run Li , Zhonglong Zheng , Minglu Li

Most modern Multi-Object Tracking (MOT) systems typically apply REID-based paradigm to hold a balance between computational efficiency and performance. In the past few years, numerous attempts have been made to perfect the systems. Although…

Computer Vision and Pattern Recognition · Computer Science 2020-05-20 Xixi Xu , Chao Lu , Liang Zhu , Xiangyang Xue , Guanxian Chen , Qi Guo , Yining Lin , Zhijian Zhao

Temporal modeling of objects is a key challenge in multiple object tracking (MOT). Existing methods track by associating detections through motion-based and appearance-based similarity heuristics. The post-processing nature of association…

Computer Vision and Pattern Recognition · Computer Science 2022-07-20 Fangao Zeng , Bin Dong , Yuang Zhang , Tiancai Wang , Xiangyu Zhang , Yichen Wei

Referring Multi-Object Tracking (RMOT) aims to achieve precise object detection and tracking through natural language instructions, representing a fundamental capability for intelligent robotic systems. However, current RMOT research…

Although vital to computer vision systems, few-shot action recognition is still not mature despite the wide research of few-shot image classification. Popular few-shot learning algorithms extract a transferable embedding from seen classes…

Computer Vision and Pattern Recognition · Computer Science 2021-04-09 Su Lu , Han-Jia Ye , De-Chuan Zhan

For many years, multi-object tracking benchmarks have focused on a handful of categories. Motivated primarily by surveillance and self-driving applications, these datasets provide tracks for people, vehicles, and animals, ignoring the vast…

Computer Vision and Pattern Recognition · Computer Science 2020-05-22 Achal Dave , Tarasha Khurana , Pavel Tokmakov , Cordelia Schmid , Deva Ramanan

In recent years, numerous effective multi-object tracking (MOT) methods are developed because of the wide range of applications. Existing performance evaluations of MOT methods usually separate the object tracking step from the object…

Computer Vision and Pattern Recognition · Computer Science 2020-01-28 Longyin Wen , Dawei Du , Zhaowei Cai , Zhen Lei , Ming-Ching Chang , Honggang Qi , Jongwoo Lim , Ming-Hsuan Yang , Siwei Lyu

Robust multi-object tracking (MOT) is a prerequisite fora safe deployment of self-driving cars. Tracking objects, however, remains a highly challenging problem, especially in cluttered autonomous driving scenes in which objects tend to…

Computer Vision and Pattern Recognition · Computer Science 2020-08-20 Wei-Chih Hung , Henrik Kretzschmar , Tsung-Yi Lin , Yuning Chai , Ruichi Yu , Ming-Hsuan Yang , Dragomir Anguelov

In this work we contribute a novel pipeline to automatically generate training data, and to improve over state-of-the-art multi-object tracking and segmentation (MOTS) methods. Our proposed track mining algorithm turns raw street-level…

Computer Vision and Pattern Recognition · Computer Science 2020-03-31 Lorenzo Porzi , Markus Hofinger , Idoia Ruiz , Joan Serrat , Samuel Rota Bulò , Peter Kontschieder

The rapid movements and agile maneuvers of unmanned aerial vehicles (UAVs) induce significant observational challenges for multi-object tracking (MOT). However, existing UAV-perspective MOT benchmarks often lack these complexities,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Jingtao Ye , Kexin Zhang , Xunchi Ma , Yuehan Li , Guangming Zhu , Peiyi Shen , Linhua Jiang , Xiangdong Zhang , Liang Zhang