English
Related papers

Related papers: Beyond MOT: Semantic Multi-Object Tracking

200 papers

Despite recent progress, Multi-Object Tracking (MOT) continues to face significant challenges, particularly its dependence on prior knowledge and predefined categories, complicating the tracking of unfamiliar objects. Generic Multiple…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Duy Le Dinh Anh , Kim Hoang Tran , Quang-Thuc Nguyen , Ngan Hoang Le

Online multi-object tracking (MOT) is extremely important for high-level spatial reasoning and path planning for autonomous and highly-automated vehicles. In this paper, we present a modular framework for tracking multiple objects…

Computer Vision and Pattern Recognition · Computer Science 2019-02-20 Akshay Rangesh , Mohan M. Trivedi

Cross-modal object tracking (CMOT) is an emerging task that maintains target consistency while the video stream switches between different modalities, with only one modality available in each frame, mostly focusing on RGB-Near Infrared…

Computer Vision and Pattern Recognition · Computer Science 2025-11-21 Boyue Xu , Ruichao Hou , Tongwei Ren , Dongming Zhou , Gangshan Wu , Jinde Cao

One of the recent trends in vision problems is to use natural language captions to describe the objects of interest. This approach can overcome some limitations of traditional methods that rely on bounding boxes or category annotations.…

Computer Vision and Pattern Recognition · Computer Science 2023-10-03 Pha Nguyen , Kha Gia Quach , Kris Kitani , Khoa Luu

Multiple Object Tracking (MOT) has rapidly progressed in recent years. Existing works tend to design a single tracking algorithm to perform both detection and association. Though ensemble learning has been exploited in many tasks, i.e,…

Computer Vision and Pattern Recognition · Computer Science 2023-02-20 Yunhao Du , Zihang Liu , Fei Su

Multiple Object Tracking (MOT) is a core capability in modern computer vision, essential to autonomous driving, surveillance, sports analytics, robotics, and biomedical imaging. Persistent identity assignment across frames remains…

Computer Vision and Pattern Recognition · Computer Science 2026-03-12 Mk Bashar , Samia Islam , Kashifa Kawaakib Hussain , Md. Bakhtiar Hasan , A. B. M. Ashikur Rahman , Md. Hasanul Kabir

We present a method to perform online Multiple Object Tracking (MOT) of known object categories in monocular video data. Current Tracking-by-Detection MOT approaches build on top of 2D bounding box detections. In contrast, we exploit…

Computer Vision and Pattern Recognition · Computer Science 2017-05-16 Sebastian Bullinger , Christoph Bodensteiner , Michael Arens

In this paper, we present LaSOT, a high-quality benchmark for Large-scale Single Object Tracking. LaSOT consists of 1,400 sequences with more than 3.5M frames in total. Each frame in these sequences is carefully and manually annotated with…

Computer Vision and Pattern Recognition · Computer Science 2019-03-28 Heng Fan , Liting Lin , Fan Yang , Peng Chu , Ge Deng , Sijia Yu , Hexin Bai , Yong Xu , Chunyuan Liao , Haibin Ling

Drone-based multi-object tracking is essential yet highly challenging due to small targets, severe occlusions, and cluttered backgrounds. Existing RGB-based tracking algorithms heavily depend on spatial appearance cues such as color and…

Computer Vision and Pattern Recognition · Computer Science 2025-10-15 Tianhao Li , Tingfa Xu , Ying Wang , Haolin Qin , Xu Lin , Jianan Li

The paper presents a new method, SearchTrack, for multiple object tracking and segmentation (MOTS). To address the association problem between detected objects, SearchTrack proposes object-customized search and motion-aware features. By…

Computer Vision and Pattern Recognition · Computer Science 2022-11-01 Zhong-Min Tsai , Yu-Ju Tsai , Chien-Yao Wang , Hong-Yuan Liao , Youn-Long Lin , Yung-Yu Chuang

Autonomous-driving perception systems require robust Multi-Object Tracking (MOT) to operate reliably in dynamic environments. MOT maintains consistent object identities across frames while preserving spatial accuracy. Recent foundation…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Diogo Mendonça , Tiago Barros , Cristiano Premebida , Urbano J. Nunes

Multi-object tracking (MOT) is the task of estimating the state trajectories of an unknown and time-varying number of objects over a certain time window. Several algorithms have been proposed to tackle the multi-object smoothing task, where…

Computer Vision and Pattern Recognition · Computer Science 2024-01-01 Juliano Pinto , Georg Hess , Yuxuan Xia , Henk Wymeersch , Lennart Svensson

The recent trend in 2D multiple object tracking (MOT) is jointly solving detection and tracking, where object detection and appearance feature (or motion) are learned simultaneously. Despite competitive performance, in crowded scenes, joint…

Computer Vision and Pattern Recognition · Computer Science 2024-02-20 Weihong Ren , Denglu Wu , Hui Cao , Xi'ai Chen , Zhi Han , Honghai Liu

Open-vocabulary Multiple Object Tracking (MOT) aims to generalize trackers to novel categories not in the training set. Currently, the best-performing methods are mainly based on pure appearance matching. Due to the complexity of motion…

Computer Vision and Pattern Recognition · Computer Science 2024-09-18 Siyuan Li , Lei Ke , Yung-Hsu Yang , Luigi Piccinelli , Mattia Segù , Martin Danelljan , Luc Van Gool

We propose a method for multi-object tracking and segmentation (MOTS) that does not require fine-tuning or per benchmark hyperparameter selection. The proposed method addresses particularly the data association problem. Indeed, the recently…

Computer Vision and Pattern Recognition · Computer Science 2021-07-16 Mehdi Miah , Guillaume-Alexandre Bilodeau , Nicolas Saunier

Multiple-object tracking (MOT) is a challenging task that requires simultaneous reasoning about location, appearance, and identity of the objects in the scene over time. Our aim in this paper is to move beyond tracking-by-detection…

Computer Vision and Pattern Recognition · Computer Science 2022-10-27 Bruno Korbar , Andrew Zisserman

Online 3D multi-object tracking (MOT) has witnessed significant research interest in recent years, largely driven by demand from the autonomous systems community. However, 3D offline MOT is relatively less explored. Labeling 3D trajectory…

Computer Vision and Pattern Recognition · Computer Science 2022-05-17 Martin Buchner , Abhinav Valada

Benchmarking multi-object tracking and object detection model performance is an essential step in machine learning model development, as it allows researchers to evaluate model detection and tracker performance on human-generated 'test'…

Computer Vision and Pattern Recognition · Computer Science 2025-09-04 Kevin Barnard , Elaine Liu , Kristine Walz , Brian Schlining , Nancy Jacobsen Stout , Lonny Lundsten

Inspired by Segment Anything 2, which generalizes segmentation from images to videos, we propose SAM2MOT--a novel segmentation-driven paradigm for multi-object tracking that breaks away from the conventional detection-association framework.…

Computer Vision and Pattern Recognition · Computer Science 2025-11-19 Junjie Jiang , Zelin Wang , Manqi Zhao , Yin Li , DongSheng Jiang

The main challenge of Multiple Object Tracking (MOT) is the efficiency in associating indefinite number of objects between video frames. Standard motion estimators used in tracking, e.g., Long Short Term Memory (LSTM), only deal with single…

Computer Vision and Pattern Recognition · Computer Science 2019-05-08 Jimuyang Zhang , Sanping Zhou , Jinjun Wang , Dong Huang