English
Related papers

Related papers: Video Object Segmentation and Tracking: A Survey

200 papers

Video Instance Segmentation (VIS) aims at segmenting and categorizing objects in videos from a closed set of training categories, lacking the generalization ability to handle novel categories in real-world videos. To address this…

Computer Vision and Pattern Recognition · Computer Science 2023-08-08 Haochen Wang , Cilin Yan , Shuai Wang , Xiaolong Jiang , XU Tang , Yao Hu , Weidi Xie , Efstratios Gavves

Visual Object Tracking (VOT) is an attractive and significant research area in computer vision, which aims to recognize and track specific targets in video sequences where the target objects are arbitrary and class-agnostic. The VOT…

Computer Vision and Pattern Recognition · Computer Science 2024-12-16 Mengmeng Wang , Teli Ma , Shuo Xin , Xiaojun Hou , Jiazheng Xing , Guang Dai , Jingdong Wang , Yong Liu

Object tracking is the cornerstone of many visual analytics systems. While considerable progress has been made in this area in recent years, robust, efficient, and accurate tracking in real-world video remains a challenge. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2018-06-19 Saeed Ranjbar Alvar , Ivan V. Bajić

The problem of Multiple Object Tracking (MOT) consists in following the trajectory of different objects in a sequence, usually a video. In recent years, with the rise of Deep Learning, the algorithms that provide a solution to this problem…

Computer Vision and Pattern Recognition · Computer Science 2019-11-21 Gioele Ciaparrone , Francisco Luque Sánchez , Siham Tabik , Luigi Troiano , Roberto Tagliaferri , Francisco Herrera

Open-vocabulary multi-object tracking (OVMOT) represents a critical new challenge involving the detection and tracking of diverse object categories in videos, encompassing both seen categories (base classes) and unseen categories (novel…

Computer Vision and Pattern Recognition · Computer Science 2024-10-14 Zekun Qian , Ruize Han , Junhui Hou , Linqi Song , Wei Feng

The objective of this paper is a model that is able to discover, track and segment multiple moving objects in a video. We make four contributions: First, we introduce an object-centric segmentation model with a depth-ordered layer…

Computer Vision and Pattern Recognition · Computer Science 2022-11-15 Junyu Xie , Weidi Xie , Andrew Zisserman

Object tracking can be formulated as "finding the right object in a video". We observe that recent approaches for class-agnostic tracking tend to focus on the "finding" part, but largely overlook the "object" part of the task, essentially…

Computer Vision and Pattern Recognition · Computer Science 2019-10-28 Achal Dave , Pavel Tokmakov , Cordelia Schmid , Deva Ramanan

Camouflaged Object Detection (COD) refers to the task of identifying and segmenting objects that blend seamlessly into their surroundings, posing a significant challenge for computer vision systems. In recent years, COD has garnered…

Computer Vision and Pattern Recognition · Computer Science 2024-08-28 Fengyang Xiao , Sujie Hu , Yuqi Shen , Chengyu Fang , Jinfa Huang , Chunming He , Longxiang Tang , Ziyun Yang , Xiu Li

Compared with still image object detection, video object detection (VOD) needs to particularly concern the high across-frame variation in object appearance, and the diverse deterioration in some frames. In principle, the detection in a…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Yuheng Shi , Tong Zhang , Xiaojie Guo

Video Scene Parsing (VSP) has emerged as a cornerstone in computer vision, facilitating the simultaneous segmentation, recognition, and tracking of diverse visual entities in dynamic scenes. In this survey, we present a holistic review of…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Guohuan Xie , Syed Ariff Syed Hesham , Wenya Guo , Bing Li , Ming-Ming Cheng , Guolei Sun , Yun Liu

Video instance segmentation (VIS) is the task that requires simultaneously classifying, segmenting and tracking object instances of interest in video. Recent methods typically develop sophisticated pipelines to tackle this task. Here, we…

Computer Vision and Pattern Recognition · Computer Science 2021-10-11 Yuqing Wang , Zhaoliang Xu , Xinlong Wang , Chunhua Shen , Baoshan Cheng , Hao Shen , Huaxia Xia

Can our video understanding systems perceive objects when a heavy occlusion exists in a scene? To answer this question, we collect a large-scale dataset called OVIS for occluded video instance segmentation, that is, to simultaneously…

Computer Vision and Pattern Recognition · Computer Science 2022-05-18 Jiyang Qi , Yan Gao , Yao Hu , Xinggang Wang , Xiaoyu Liu , Xiang Bai , Serge Belongie , Alan Yuille , Philip H. S. Torr , Song Bai

Moving Object Segmentation (MOS) aims to discover, segment, and track objects that move independently of the camera. Current MOS methods, however, exhibit two fundamental limitations: they rely on pre-computed 2D auxiliary modalities such…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Junyu Xie , Tengda Han , Weidi Xie , Andrew Zisserman

Tracking pixels in videos is typically studied as an optical flow estimation problem, where every pixel is described with a displacement vector that locates it in the next frame. Even though wider temporal context is freely available, prior…

Computer Vision and Pattern Recognition · Computer Science 2022-07-26 Adam W. Harley , Zhaoyuan Fang , Katerina Fragkiadaki

This paper tackles the task of semi-supervised video object segmentation, i.e., the separation of an object from the background in a video, given the mask of the first frame. We present One-Shot Video Object Segmentation (OSVOS), based on a…

Computer Vision and Pattern Recognition · Computer Science 2017-04-14 Sergi Caelles , Kevis-Kokitsi Maninis , Jordi Pont-Tuset , Laura Leal-Taixé , Daniel Cremers , Luc Van Gool

Tracking and segmenting multiple similar objects with distinct or complex parts in long-term videos is particularly challenging due to the ambiguity in identifying target components and the confusion caused by occlusion, background clutter,…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Xin Li , Deshui Miao , Zhenyu He , Yaowei Wang , Huchuan Lu , Ming-Hsuan Yang

We approach video object segmentation (VOS) by splitting the task into two sub-tasks: bounding box level tracking, followed by bounding box segmentation. Following this paradigm, we present BoLTVOS (Box-Level Tracking for VOS), which…

Computer Vision and Pattern Recognition · Computer Science 2020-01-01 Paul Voigtlaender , Jonathon Luiten , Bastian Leibe

Video Object Segmentation (VOS) is a vital task in computer vision, focusing on distinguishing foreground objects from the background across video frames. Our work draws inspiration from the Cutie model, and we investigate the effects of…

Computer Vision and Pattern Recognition · Computer Science 2024-06-07 Xinyu Liu , Jing Zhang , Kexin Zhang , Yuting Yang , Licheng Jiao , Shuyuan Yang

Given an object mask, Semi-supervised Video Object Segmentation (SVOS) technique aims to track and segment the object across video frames, serving as a fundamental task in computer vision. Although recent memory-based methods demonstrate…

Computer Vision and Pattern Recognition · Computer Science 2025-07-28 Guanyi Qin , Ziyue Wang , Daiyun Shen , Haofeng Liu , Hantao Zhou , Junde Wu , Runze Hu , Yueming Jin

The advancement of computer vision has pushed visual analysis tasks from still images to the video domain. In recent years, video instance segmentation, which aims to track and segment multiple objects in video frames, has drawn much…

Computer Vision and Pattern Recognition · Computer Science 2023-11-03 Yiming Cui , Cheng Han , Dongfang Liu