English
Related papers

Related papers: Two is a crowd: tracking relations in videos

200 papers

We present an integrated framework for simultaneous tracking, group detection and multi-level activity recognition in crowd videos. Instead of solving these problems independently and sequentially, we solve them together in a unified…

Computer Vision and Pattern Recognition · Computer Science 2017-10-31 Neha Bhargava , Subhasis Chaudhuri

Most existing Multi-Object Tracking (MOT) approaches follow the Tracking-by-Detection paradigm and the data association framework where objects are firstly detected and then associated. Although deep-learning based method can noticeably…

Computer Vision and Pattern Recognition · Computer Science 2020-07-14 Xingyu Wan , Jiakai Cao , Sanping Zhou , Jinjun Wang

The tracking-by-detection paradigm today has become the dominant method for multi-object tracking and works by detecting objects in each frame and then performing data association across frames. However, its sequential frame-wise matching…

Computer Vision and Pattern Recognition · Computer Science 2022-12-21 Sanghyun Woo , Kwanyong Park , Seoung Wug Oh , In So Kweon , Joon-Young Lee

Multi-object tracking from RGB-D video sequences is a challenging problem due to the combination of changing viewpoints, motion, and occlusions over time. We observe that having the complete geometry of objects aids in their tracking, and…

Computer Vision and Pattern Recognition · Computer Science 2020-12-17 Norman Müller , Yu-Shiang Wong , Niloy J. Mitra , Angela Dai , Matthias Nießner

Multiple object tracking (MOT) in urban traffic aims to produce the trajectories of the different road users that move across the field of view with different directions and speeds and that can have varying appearances and sizes. Occlusions…

Computer Vision and Pattern Recognition · Computer Science 2018-09-07 Hui-Lee Ooi , Guillaume-Alexandre Bilodeau , Nicolas Saunier , David-Alexandre Beaupré

This paper presents our solution to ACM MM challenge: Large-scale Human-centric Video Analysis in Complex Events\cite{lin2020human}; specifically, here we focus on Track3: Crowd Pose Tracking in Complex Events. Remarkable progress has been…

Computer Vision and Pattern Recognition · Computer Science 2020-10-22 Li Yuan , Shuning Chang , Ziyuan Huang , Yichen Zhou , Yunpeng Chen , Xuecheng Nie , Francis E. H. Tay , Jiashi Feng , Shuicheng Yan

Multiple Object Tracking (MOT) is a core capability in modern computer vision, essential to autonomous driving, surveillance, sports analytics, robotics, and biomedical imaging. Persistent identity assignment across frames remains…

Computer Vision and Pattern Recognition · Computer Science 2026-03-12 Mk Bashar , Samia Islam , Kashifa Kawaakib Hussain , Md. Bakhtiar Hasan , A. B. M. Ashikur Rahman , Md. Hasanul Kabir

Multi-object tracking is a classic field in computer vision. Among them, pedestrian tracking has extremely high application value and has become the most popular research category. Existing methods mainly use motion or appearance…

Computer Vision and Pattern Recognition · Computer Science 2025-07-04 Teng Fu , Yuwen Chen , Zhuofan Chen , Mengyang Zhao , Bin Li , Xiangyang Xue

Referring multi-object tracking (RMOT) is an emerging cross-modal task that aims to localize an arbitrary number of targets based on a language expression and continuously track them in a video. This intricate task involves reasoning on…

Computer Vision and Pattern Recognition · Computer Science 2025-07-28 Wenjun Huang , Yang Ni , Hanning Chen , Yirui He , Ian Bryant , Yezi Liu , Mohsen Imani

Multi-Object Tracking (MOT) aims to detect and associate all desired objects across frames. Most methods accomplish the task by explicitly or implicitly leveraging strong cues (i.e., spatial and appearance information), which exhibit…

Computer Vision and Pattern Recognition · Computer Science 2024-01-23 Mingzhan Yang , Guangxin Han , Bin Yan , Wenhua Zhang , Jinqing Qi , Huchuan Lu , Dong Wang

Most current multi-object trackers focus on short-term tracking, and are based on deep and complex systems that do not operate in real-time, often making them impractical for video-surveillance. In this paper, we present a long-term…

Computer Vision and Pattern Recognition · Computer Science 2020-10-20 Germán Barquero , Carles Fernández , Isabelle Hupont

Multi-Object Tracking (MOT) has been a long-standing challenge in video understanding. A natural and intuitive approach is to split this task into two parts: object detection and association. Most mainstream methods employ meticulously…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Ruopeng Gao , Ji Qi , Limin Wang

We propose an online tracking algorithm that performs the object detection and data association under a common framework, capable of linking objects after a long time span. This is realized by preserving a large spatio-temporal memory to…

Computer Vision and Pattern Recognition · Computer Science 2022-04-01 Jiarui Cai , Mingze Xu , Wei Li , Yuanjun Xiong , Wei Xia , Zhuowen Tu , Stefano Soatto

Most modern multi-object tracking (MOT) systems follow the tracking-by-detection paradigm. It first localizes the objects of interest, then extracting their individual appearance features to make data association. The individual features,…

Computer Vision and Pattern Recognition · Computer Science 2020-07-02 Tianyi Liang , Long Lan , Zhigang Luo

Conventional multi-object tracking (MOT) systems are predominantly designed for pedestrian tracking and often exhibit limited generalization to other object categories. This paper presents a generalized tracking framework capable of…

Computer Vision and Pattern Recognition · Computer Science 2025-09-26 Hamidreza Hashempoor , Yu Dong Hwang

Existing referring understanding tasks tend to involve the detection of a single text-referred object. In this paper, we propose a new and general referring understanding task, termed referring multi-object tracking (RMOT). Its core idea is…

Computer Vision and Pattern Recognition · Computer Science 2023-03-14 Dongming Wu , Wencheng Han , Tiancai Wang , Xingping Dong , Xiangyu Zhang , Jianbing Shen

Referring multi-object tracking (RMOT) is an emerging cross-modal task that aims to locate an arbitrary number of target objects and maintain their identities referred by a language expression in a video. This intricate task involves the…

Computer Vision and Pattern Recognition · Computer Science 2024-10-18 Changcheng Xiao , Qiong Cao , Yujie Zhong , Xiang Zhang , Tao Wang , Canqun Yang , Long Lan

The challenging task of multi-object tracking (MOT) requires simultaneous reasoning about track initialization, identity, and spatio-temporal trajectories. We formulate this task as a frame-to-frame set prediction problem and introduce…

Computer Vision and Pattern Recognition · Computer Science 2022-05-02 Tim Meinhardt , Alexander Kirillov , Laura Leal-Taixe , Christoph Feichtenhofer

Robots need to have a memory of previously observed, but currently occluded objects to work reliably in realistic environments. We investigate the problem of encoding object-oriented memory into a multi-object manipulation reasoning and…

Robotics · Computer Science 2024-05-28 Yixuan Huang , Jialin Yuan , Chanho Kim , Pupul Pradhan , Bryan Chen , Li Fuxin , Tucker Hermans

The majority of contemporary object-tracking approaches do not model interactions between objects. This contrasts with the fact that objects' paths are not independent: a cyclist might abruptly deviate from a previously planned trajectory…

Computer Vision and Pattern Recognition · Computer Science 2020-09-29 Fabian B. Fuchs , Adam R. Kosiorek , Li Sun , Oiwi Parker Jones , Ingmar Posner