English
Related papers

Related papers: Beyond MOT: Semantic Multi-Object Tracking

200 papers

Cross-view multi-object tracking aims to link objects between frames and camera views with substantial overlaps. Although cross-view multi-object tracking has received increased attention in recent years, existing datasets still have…

Computer Vision and Pattern Recognition · Computer Science 2023-10-10 Shenghao Hao , Peiyuan Liu , Yibing Zhan , Kaixun Jin , Zuozhu Liu , Mingli Song , Jenq-Neng Hwang , Gaoang Wang

LVLMs have been shown to perform excellently in image-level tasks such as VQA and caption. However, in many instance-level tasks, such as visual grounding and object detection, LVLMs still show performance gaps compared to previous expert…

Computer Vision and Pattern Recognition · Computer Science 2025-11-24 Teng Fu , Mengyang Zhao , Ke Niu , Kaixin Peng , Bin Li

Multi-Object Tracking (MOT) has been notoriously difficult to evaluate. Previous metrics overemphasize the importance of either detection or association. To address this, we present a novel MOT evaluation metric, HOTA (Higher Order Tracking…

Computer Vision and Pattern Recognition · Computer Science 2020-10-09 Jonathon Luiten , Aljosa Osep , Patrick Dendorfer , Philip Torr , Andreas Geiger , Laura Leal-Taixe , Bastian Leibe

Robots navigating autonomously need to perceive and track the motion of objects and other agents in its surroundings. This information enables planning and executing robust and safe trajectories. To facilitate these processes, the motion…

Computer Vision and Pattern Recognition · Computer Science 2020-07-23 Abhijeet Shenoi , Mihir Patel , JunYoung Gwak , Patrick Goebel , Amir Sadeghian , Hamid Rezatofighi , Roberto Martín-Martín , Silvio Savarese

Multi-object tracking (MOT) in video sequences remains a challenging task, especially in scenarios with significant camera movements. This is because targets can drift considerably on the image plane, leading to erroneous tracking outcomes.…

Computer Vision and Pattern Recognition · Computer Science 2024-01-12 Kefu Yi , Kai Luo , Xiaolei Luo , Jiangui Huang , Hao Wu , Rongdong Hu , Wei Hao

This work proposes an end-to-end multi-camera 3D multi-object tracking (MOT) framework. It emphasizes spatio-temporal continuity and integrates both past and future reasoning for tracked objects. Thus, we name it "Past-and-Future reasoning…

Computer Vision and Pattern Recognition · Computer Science 2023-04-04 Ziqi Pang , Jie Li , Pavel Tokmakov , Dian Chen , Sergey Zagoruyko , Yu-Xiong Wang

Tracking a time-varying indefinite number of objects in a video sequence over time remains a challenge despite recent advances in the field. Most existing approaches are not able to properly handle multi-object tracking challenges such as…

Computer Vision and Pattern Recognition · Computer Science 2022-10-10 Tianyu Zhu , Markus Hiller , Mahsa Ehsanpour , Rongkai Ma , Tom Drummond , Ian Reid , Hamid Rezatofighi

Multi-object tracking (MOT) is essential for sports analytics, enabling performance evaluation and tactical insights. However, tracking in sports is challenging due to fast movements, occlusions, and camera shifts. Traditional…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Tomasz Stanczyk , Seongro Yoon , Francois Bremond

3D multiple object tracking (MOT) plays a crucial role in autonomous driving perception. Recent end-to-end query-based trackers simultaneously detect and track objects, which have shown promising potential for the 3D MOT task. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-05-16 Tao Tang , Lijun Zhou , Pengkun Hao , Zihang He , Kalok Ho , Shuo Gu , Zhihui Hao , Haiyang Sun , Kun Zhan , Peng Jia , XianPeng Lang , Xiaodan Liang

A short clip of video may contain progression of multiple events and an interesting story line. A human need to capture both the event in every shot and associate them together to understand the story behind it. In this work, we present a…

Computer Vision and Pattern Recognition · Computer Science 2025-02-06 Mingfei Han , Linjie Yang , Xiaojun Chang , Lina Yao , Heng Wang

The research on multi-object tracking (MOT) is essentially to solve for the data association assignment, the core of which is to design the association cost as discriminative as possible. Generally speaking, the match ambiguities caused by…

Computer Vision and Pattern Recognition · Computer Science 2017-11-09 Xiao Zhou , Peilin Jiang , Fei Wang

Multi-Object Tracking (MOT) plays a critical role in analyzing player behavior from videos, enabling performance evaluation. Current MOT methods are often evaluated using publicly available datasets. However, most of these focus on everyday…

Computer Vision and Pattern Recognition · Computer Science 2025-11-13 Rintaro Otsubo , Kanta Sawafuji , Hideo Saito

Most existing multi-object tracking methods typically learn visual tracking features via maximizing dis-similarities of different instances and minimizing similarities of the same instance. While such a feature learning scheme achieves…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Yuhao Li , Jiale Cao , Muzammal Naseer , Yu Zhu , Jinqiu Sun , Yanning Zhang , Fahad Shahbaz Khan

Multi-Object Tracking MOT encompasses various tracking scenarios, each characterized by unique traits. Effective trackers should demonstrate a high degree of generalizability across diverse scenarios. However, existing trackers struggle to…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Zheng Qin , Le Wang , Sanping Zhou , Panpan Fu , Gang Hua , Wei Tang

Multiple object tracking (MOT) in urban traffic aims to produce the trajectories of the different road users that move across the field of view with different directions and speeds and that can have varying appearances and sizes. Occlusions…

Computer Vision and Pattern Recognition · Computer Science 2018-09-07 Hui-Lee Ooi , Guillaume-Alexandre Bilodeau , Nicolas Saunier , David-Alexandre Beaupré

Template-based 3D object tracking still lacks a high-precision benchmark of real scenes due to the difficulty of annotating the accurate 3D poses of real moving video objects without using markers. In this paper, we present a multi-view…

Computer Vision and Pattern Recognition · Computer Science 2022-03-28 Jiachen Li , Bin Wang , Shiqiang Zhu , Xin Cao , Fan Zhong , Wenxuan Chen , Te Li , Jason Gu , Xueying Qin

In comparison to conventional RGB cameras, the superior temporal resolution of event cameras allows them to capture rich information between frames, making them prime candidates for object tracking. Yet in practice, despite their…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Song Wang , Zhu Wang , Can Li , Xiaojuan Qi , Hayden Kwok-Hay So

Multiple Object Tracking (MOT) plays an important role in solving many fundamental problems in video analysis in computer vision. Most MOT methods employ two steps: Object Detection and Data Association. The first step detects objects of…

Computer Vision and Pattern Recognition · Computer Science 2019-07-17 ShiJie Sun , Naveed Akhtar , HuanSheng Song , Ajmal Mian , Mubarak Shah

Traditional visual object tracking (VOT) methods typically rely on task-specific supervised training, limiting their generalization to unseen objects and challenging scenarios with distractors, occlusion, and nonlinear motion. Recent vision…

Computer Vision and Pattern Recognition · Computer Science 2026-05-22 Deyi Zhu , Yuji Wang , Yong Liu , Yansong Tang , Bingyao Yu , Jiwen Lu , Jie Zhou

Multi-object tracking (MOT) aims at estimating bounding boxes and identities of objects across video frames. Detection boxes serve as the basis of both 2D and 3D MOT. The inevitable changing of detection scores leads to object missing after…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Yifu Zhang , Xinggang Wang , Xiaoqing Ye , Wei Zhang , Jincheng Lu , Xiao Tan , Errui Ding , Peize Sun , Jingdong Wang