English
Related papers

Related papers: YouTube-VOS: A Large-Scale Video Object Segmentati…

200 papers

Video instance segmentation (VIS) aims to segment and associate all instances of predefined classes for each frame in videos. Prior methods usually obtain segmentation for a frame or clip first, and merge the incomplete results by tracking…

Computer Vision and Pattern Recognition · Computer Science 2021-10-01 Huaijia Lin , Ruizheng Wu , Shu Liu , Jiangbo Lu , Jiaya Jia

Video instance segmentation (VIS) is a challenging vision task that aims to detect, segment, and track objects in videos. Conventional VIS methods rely on densely-annotated object masks which are expensive. We reduce the human annotations…

Computer Vision and Pattern Recognition · Computer Science 2024-04-03 Shuaiyi Huang , De-An Huang , Zhiding Yu , Shiyi Lan , Subhashree Radhakrishnan , Jose M. Alvarez , Abhinav Shrivastava , Anima Anandkumar

State-of-the-art transformer-based video instance segmentation (VIS) approaches typically utilize either single-scale spatio-temporal features or per-frame multi-scale features during the attention computations. We argue that such an…

Computer Vision and Pattern Recognition · Computer Science 2022-03-25 Omkar Thawakar , Sanath Narayan , Jiale Cao , Hisham Cholakkal , Rao Muhammad Anwer , Muhammad Haris Khan , Salman Khan , Michael Felsberg , Fahad Shahbaz Khan

Semi-supervised video object segmentation is an interesting yet challenging task in machine learning. In this work, we conduct a series of refinements with the propagation-based video object segmentation method and empirically evaluate…

Computer Vision and Pattern Recognition · Computer Science 2019-10-01 Dongdong Yu , Kai Su , Hengkai Guo , Jian Wang , Kaihui Zhou , Yuanyuan Huang , Minghui Dong , Jie Shao , Changhu Wang

Reasoning video object segmentation predicts pixel-level masks in videos from natural-language queries that may involve implicit and temporally grounded references. However, existing methods are developed and evaluated in an offline regime,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Jinyuan Liu , Yang Wang , Zeyu Zhao , Weixin Li , Song Wang , Ruize Han

Training on large-scale datasets can boost the performance of video instance segmentation while the annotated datasets for VIS are hard to scale up due to the high labor cost. What we possess are numerous isolated filed-specific datasets,…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Rongkun Zheng , Lu Qi , Xi Chen , Yi Wang , Kun Wang , Yu Qiao , Hengshuang Zhao

With ever increasing computing power and data storage capacity, the potential for large digital video libraries is growing rapidly.However, the massive use of video for the moment is limited by its opaque characteristics. Indeed, a user who…

Computer Vision and Pattern Recognition · Computer Science 2014-12-16 Walid Mahdi , Liming Chen , Mohsen Ardebilian

Unsupervised multi-object segmentation has shown impressive results on images by utilizing powerful semantics learned from self-supervised pretraining. An additional modality such as depth or motion is often used to facilitate the…

Computer Vision and Pattern Recognition · Computer Science 2023-10-12 Görkay Aydemir , Weidi Xie , Fatma Güney

Given an object mask, Semi-supervised Video Object Segmentation (SVOS) technique aims to track and segment the object across video frames, serving as a fundamental task in computer vision. Although recent memory-based methods demonstrate…

Computer Vision and Pattern Recognition · Computer Science 2025-07-28 Guanyi Qin , Ziyue Wang , Daiyun Shen , Haofeng Liu , Hantao Zhou , Junde Wu , Runze Hu , Yueming Jin

We consider the challenging problem of zero-shot video object segmentation (VOS). That is, segmenting and tracking multiple moving objects within a video fully automatically, without any manual initialization. We treat this as a grouping…

Computer Vision and Pattern Recognition · Computer Science 2020-08-17 Shreyank N Gowda , Panagiotis Eustratiadis , Timothy Hospedales , Laura Sevilla-Lara

Video instance segmentation aims at predicting object segmentation masks for each frame, as well as associating the instances across multiple frames. Recent end-to-end video instance segmentation methods are capable of performing object…

Computer Vision and Pattern Recognition · Computer Science 2022-06-15 Quanzeng You , Jiang Wang , Peng Chu , Andre Abrantes , Zicheng Liu

Semi-supervised video object segmentation (Semi-VOS), which requires only annotating the first frame of a video to segment future frames, has received increased attention recently. Among existing pipelines, the memory-matching-based one is…

Computer Vision and Pattern Recognition · Computer Science 2023-10-24 Weihao Lin , Tao Chen , Chong Yu

As a milestone for video object segmentation, one-shot video object segmentation (OSVOS) has achieved a large margin compared to the conventional optical-flow based methods regarding to the segmentation accuracy. Its excellent performance…

Computer Vision and Pattern Recognition · Computer Science 2019-08-21 Yu Liu , Yutong Dai , Anh-Dzung Doan , Lingqiao Liu , Ian Reid

Online video object segmentation is a challenging task as it entails to process the image sequence timely and accurately. To segment a target object through the video, numerous CNN-based methods have been developed by heavily finetuning on…

Computer Vision and Pattern Recognition · Computer Science 2018-06-07 Jingchun Cheng , Yi-Hsuan Tsai , Wei-Chih Hung , Shengjin Wang , Ming-Hsuan Yang

Conventional approaches to video segmentation are confined to predefined object categories and cannot identify out-of-vocabulary objects, let alone objects that are not identified explicitly but only referred to implicitly in complex text…

Computer Vision and Pattern Recognition · Computer Science 2025-07-23 Yiqing Shen , Chenjia Li , Chenxiao Fan , Mathias Unberath

Video instance segmentation, also known as multi-object tracking and segmentation, is an emerging computer vision research area introduced in 2019, aiming at detecting, segmenting, and tracking instances in videos simultaneously. By…

Computer Vision and Pattern Recognition · Computer Science 2023-10-20 Chenhao Xu , Chang-Tsun Li , Yongjian Hu , Chee Peng Lim , Douglas Creighton

We introduce the Lecture Video Visual Objects (LVVO) dataset, a new benchmark for visual object detection in educational video content. The dataset consists of 4,000 frames extracted from 245 lecture videos spanning biology, computer…

Computer Vision and Pattern Recognition · Computer Science 2025-06-18 Dipayan Biswas , Shishir Shah , Jaspal Subhlok

Video Object Segmentation (VOS) presents several challenges, including object occlusion and fragmentation, the dis-appearance and re-appearance of objects, and tracking specific objects within crowded scenes. In this work, we combine the…

Computer Vision and Pattern Recognition · Computer Science 2024-08-22 Xinyu Liu , Jing Zhang , Kexin Zhang , Xu Liu , Lingling Li

Image segmentation is the task of associating pixels in an image with their respective object class labels. It has a wide range of applications in many industries including healthcare, transportation, robotics, fashion, home improvement,…

Computer Vision and Pattern Recognition · Computer Science 2023-01-19 Yuanbo Wang , Unaiza Ahsan , Hanyan Li , Matthew Hagen

With the growing deployment of autonomous driving agents, the detection and segmentation of road obstacles have become critical to ensure safe autonomous navigation. However, existing road-obstacle segmentation methods are applied on…

Computer Vision and Pattern Recognition · Computer Science 2025-09-17 Shyam Nandan Rai , Shyamgopal Karthik , Mariana-Iuliana Georgescu , Barbara Caputo , Carlo Masone , Zeynep Akata