English
Related papers

Related papers: Multi-Object Tracking Retrieval with LLaVA-Video: …

200 papers

Temporal Action Detection and Moment Retrieval constitute two pivotal tasks in video understanding, focusing on precisely localizing temporal segments corresponding to specific actions or events. Recent advancements introduced Moment…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Weijun Zhuang , Qizhang Li , Xin Li , Ming Liu , Xiaopeng Hong , Feng Gao , Fan Yang , Wangmeng Zuo

This paper strives to solve complex video question answering (VideoQA) which features long video containing multiple objects and events at different time. To tackle the challenge, we highlight the importance of identifying question-critical…

Computer Vision and Pattern Recognition · Computer Science 2023-07-25 Yicong Li , Junbin Xiao , Chun Feng , Xiang Wang , Tat-Seng Chua

Spatio-temporal video grounding (or STVG) task aims at locating a spatio-temporal tube for a specific instance given a text query. Despite advancements, current methods easily suffer the distractors or heavy object appearance variations in…

Computer Vision and Pattern Recognition · Computer Science 2024-01-04 Xin Gu , Heng Fan , Yan Huang , Tiejian Luo , Libo Zhang

Multimodal Large Language Models (MLLMs) have shown strong performance on Video Temporal Grounding (VTG). However, their coarse recognition capabilities are insufficient for fine-grained temporal understanding, making task-specific…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Jiwook Han , Geo Ahn , Youngrae Kim , Jinwoo Choi

Reasoning Video Object Segmentation (ReasonVOS) is a challenging task that requires stable object segmentation across video sequences using implicit and complex textual inputs. Previous methods fine-tune Multimodal Large Language Models…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Zhengtong Zhu , Jiaqing Fan , Zhixuan Liu , Fanzhang Li

Tracking a time-varying indefinite number of objects in a video sequence over time remains a challenge despite recent advances in the field. Most existing approaches are not able to properly handle multi-object tracking challenges such as…

Computer Vision and Pattern Recognition · Computer Science 2022-10-10 Tianyu Zhu , Markus Hiller , Mahsa Ehsanpour , Rongkai Ma , Tom Drummond , Ian Reid , Hamid Rezatofighi

Multiple-Object Tracking (MOT) is of crucial importance for applications such as retail video analytics and video surveillance. Object detectors are often the computational bottleneck of modern MOT systems, limiting their use for real-time…

Computer Vision and Pattern Recognition · Computer Science 2019-08-14 Richard Cobos , Jefferson Hernandez , Andres G. Abad

Multi-object tracking (MOT) is the task of estimating the state trajectories of an unknown and time-varying number of objects over a certain time window. Several algorithms have been proposed to tackle the multi-object smoothing task, where…

Computer Vision and Pattern Recognition · Computer Science 2024-01-01 Juliano Pinto , Georg Hess , Yuxuan Xia , Henk Wymeersch , Lennart Svensson

In this paper, the main task we aim to tackle is the multi-instance semi-supervised video object segmentation across a sequence of frames where only the first-frame box-level ground-truth is provided. Detection-based algorithms are widely…

Computer Vision and Pattern Recognition · Computer Science 2020-04-17 Mingjie Sun , Jimin Xiao , Eng Gee Lim , Bingfeng Zhang , Yao Zhao

Single object tracking (SOT) heavily relies on the representation of the target object as a bounding box. However, due to the potential deformation and rotation experienced by the tracked targets, the genuine bounding box fails to capture…

Computer Vision and Pattern Recognition · Computer Science 2023-09-26 Guotian Zeng , Bi Zeng , Hong Zhang , Jianqi Liu , Qingmao Wei

In the realm of video analysis, the field of multiple object tracking (MOT) assumes paramount importance, with the motion state of objects-whether static or dynamic relative to the ground-holding practical significance across diverse…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Yang Feng , Liao Pan , Wu Di , Liu Bo , Zhang Xingle

Recent advances in diffusion-based text-to-video (T2V) models have demonstrated remarkable progress, but these models still face challenges in generating videos with multiple objects. Most models struggle with accurately capturing complex…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Aimon Rahman , Jiang Liu , Ze Wang , Ximeng Sun , Jialian Wu , Xiaodong Yu , Yusheng Su , Vishal M. Patel , Zicheng Liu , Emad Barsoum

The growing volume of video data and the introduction of complex retrieval challenges, such as the Temporal Retrieval and Alignment of Key Events (TRAKE) task at the Ho Chi Minh City AI Challenge 2025, expose critical limitations in…

Multimedia · Computer Science 2025-12-16 Thanh-Danh Luu , Le-Vu Nguyen Dinh , Duc-Thien Tran , Duy-Bao Bui , Nam-Tien Le , Tinh-Anh Nguyen Nhu

Multi-object tracking (MOT) aims to maintain consistent identities of objects across video frames. Associating objects in low-frame-rate videos captured by moving unmanned aerial vehicles (UAVs) in actual combat scenarios is complex due to…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Markiyan Kostiv , Anatolii Adamovskyi , Yevhen Cherniavskyi , Mykyta Varenyk , Ostap Viniavskyi , Igor Krashenyi , Oles Dobosevych

Spatio-temporal Human-Object Interaction (ST-HOI) understanding aims at detecting HOIs from videos, which is crucial for activity understanding. However, existing whole-body-object interaction video benchmarks overlook the truth that…

Computer Vision and Pattern Recognition · Computer Science 2025-02-25 Xiaoyang Liu , Boran Wen , Xinpeng Liu , Zizheng Zhou , Hongwei Fan , Cewu Lu , Lizhuang Ma , Yulong Chen , Yong-Lu Li

This paper presents an approach for tracking in a surveillance scenario. Typical aspects for this scenario are a 24/7 operation with a static camera mounted above the height of a human with many objects or people. The Multiple Object…

Computer Vision and Pattern Recognition · Computer Science 2021-06-03 Oliver Urbann , Oliver Bredtmann , Maximilian Otten , Jan-Philip Richter , Thilo Bauer , David Zibriczky

Object tracking is a hot topic in computer vision. Thanks to the booming of the very high resolution (VHR) remote sensing techniques, it is now possible to track targets of interests in satellite videos. However, since the targets in the…

Computer Vision and Pattern Recognition · Computer Science 2018-04-26 Bo Du , Shihan Cai , Chen Wu , Liangpei Zhang , Dacheng Tao

This technical report explores the MOSEv2 track of the PVUW 2026 Challenge, which targets complex semi-supervised video object segmentation. Built on SAM~3, we develop an automatic re-prompting framework to improve robustness under target…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Mingqi Gao , Sijie Li , Jungong Han

We present a Multi-Modal Recipe for Advancing Adaptation-based Pre-training towards effective and efficient zero-shot video-text retrieval, dubbed M2-RAAP. Upon popular image-text models like CLIP, most current adaptation-based video-text…

Computer Vision and Pattern Recognition · Computer Science 2024-02-01 Xingning Dong , Zipeng Feng , Chunluan Zhou , Xuzheng Yu , Ming Yang , Qingpei Guo

The recent trend in multiple object tracking (MOT) is heading towards leveraging deep learning to boost the tracking performance. In this paper, we propose a novel solution named TransSTAM, which leverages Transformer to effectively model…

Computer Vision and Pattern Recognition · Computer Science 2022-06-01 Peng Dai , Yiqiang Feng , Renliang Weng , Changshui Zhang