English
Related papers

Related papers: Learning Fast and Robust Target Models for Video O…

200 papers

Video instance segmentation (VIS) is a challenging vision task that aims to detect, segment, and track objects in videos. Conventional VIS methods rely on densely-annotated object masks which are expensive. We reduce the human annotations…

Computer Vision and Pattern Recognition · Computer Science 2024-04-03 Shuaiyi Huang , De-An Huang , Zhiding Yu , Shiyi Lan , Subhashree Radhakrishnan , Jose M. Alvarez , Abhinav Shrivastava , Anima Anandkumar

We tackle the task of semi-supervised video object segmentation, i.e. segmenting the pixels belonging to an object in the video using the ground truth pixel mask for the first frame. We build on the recently introduced one-shot video object…

Computer Vision and Pattern Recognition · Computer Science 2017-08-02 Paul Voigtlaender , Bastian Leibe

This work focuses on multi-shot semi-supervised video object segmentation (MVOS), which aims at segmenting the target object indicated by an initial mask throughout a video with multiple shots. The existing VOS methods mainly focus on…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Hengrui Hu , Kaining Ying , Henghui Ding

We approach video object segmentation (VOS) by splitting the task into two sub-tasks: bounding box level tracking, followed by bounding box segmentation. Following this paradigm, we present BoLTVOS (Box-Level Tracking for VOS), which…

Computer Vision and Pattern Recognition · Computer Science 2020-01-01 Paul Voigtlaender , Jonathon Luiten , Bastian Leibe

Video object segmentation targets at segmenting a specific object throughout a video sequence, given only an annotated first frame. Recent deep learning based approaches find it effective by fine-tuning a general-purpose segmentation model…

Computer Vision and Pattern Recognition · Computer Science 2018-02-06 Linjie Yang , Yanran Wang , Xuehan Xiong , Jianchao Yang , Aggelos K. Katsaggelos

In this paper, we propose a simple yet effective approach for self-supervised video object segmentation (VOS). Our key insight is that the inherent structural dependencies present in DINO-pretrained Transformers can be leveraged to…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Shuangrui Ding , Rui Qian , Haohang Xu , Dahua Lin , Hongkai Xiong

Recently, transformer-based methods have achieved impressive results on Video Instance Segmentation (VIS). However, most of these top-performing methods run in an offline manner by processing the entire video clip at once to predict…

Computer Vision and Pattern Recognition · Computer Science 2022-11-17 Zitong Zhan , Daniel McKee , Svetlana Lazebnik

We propose a new method for video object segmentation (VOS) that addresses object pattern learning from unlabeled videos, unlike most existing methods which rely heavily on extensive annotated data. We introduce a unified…

Computer Vision and Pattern Recognition · Computer Science 2020-03-12 Xiankai Lu , Wenguan Wang , Jianbing Shen , Yu-Wing Tai , David Crandall , Steven C. H. Hoi

In this work, we present a new computer vision task named video object of interest segmentation (VOIS). Given a video and a target image of interest, our objective is to simultaneously segment and track all objects in the video that are…

Computer Vision and Pattern Recognition · Computer Science 2022-12-07 Siyuan Zhou , Chunru Zhan , Biao Wang , Tiezheng Ge , Yuning Jiang , Li Niu

In recent years, Video Object Segmentation (VOS) has emerged as a complementary method to Video Object Tracking (VOT). VOS focuses on classifying all the pixels around the target, allowing for precise shape labeling, while VOT primarily…

Computer Vision and Pattern Recognition · Computer Science 2023-10-19 Mohammed Leo , Kurban Ubul , ShengJie Cheng , Michael Ma

One-shot Video Object Segmentation~(VOS) is the task of pixel-wise tracking an object of interest within a video sequence, where the segmentation mask of the first frame is given at inference time. In recent years, Recurrent Neural…

Computer Vision and Pattern Recognition · Computer Science 2020-11-10 Fatemeh Azimi , Stanislav Frolov , Federico Raue , Joern Hees , Andreas Dengel

The recent transformer-based models have dominated the Referring Video Object Segmentation (RVOS) task due to the superior performance. Most prior works adopt unified DETR framework to generate segmentation masks in query-to-instance…

Computer Vision and Pattern Recognition · Computer Science 2024-01-02 Zhuoyan Luo , Yicheng Xiao , Yong Liu , Yitong Wang , Yansong Tang , Xiu Li , Yujiu Yang

Video Instance Segmentation (VIS) is a multi-task problem performing detection, segmentation, and tracking simultaneously. Extended from image set applications, video data additionally induces the temporal information, which, if handled…

Computer Vision and Pattern Recognition · Computer Science 2021-07-12 Thuy C. Nguyen , Tuan N. Tang , Nam LH. Phan , Chuong H. Nguyen , Masayuki Yamazaki , Masao Yamanaka

In this paper we introduce a Transformer-based approach to video object segmentation (VOS). To address compounding error and scalability issues of prior work, we propose a scalable, end-to-end method for VOS called Sparse Spatiotemporal…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Brendan Duke , Abdalla Ahmed , Christian Wolf , Parham Aarabi , Graham W. Taylor

This paper delves into the challenges of achieving scalable and effective multi-object modeling for semi-supervised Video Object Segmentation (VOS). Previous VOS methods decode features with a single positive object, limiting the learning…

Computer Vision and Pattern Recognition · Computer Science 2024-05-29 Zongxin Yang , Jiaxu Miao , Yunchao Wei , Wenguan Wang , Xiaohan Wang , Yi Yang

Most recent semi-supervised video object segmentation (VOS) methods rely on fine-tuning deep convolutional neural networks online using the given mask of the first frame or predicted masks of subsequent frames. However, the online…

Computer Vision and Pattern Recognition · Computer Science 2020-02-18 Yingjie Yin , De Xu , Xingang Wang , Lei Zhang

We present an approach to semi-supervised video object segmentation, in the context of the DAVIS 2017 challenge. Our approach combines category-based object detection, category-independent object appearance segmentation and temporal object…

Computer Vision and Pattern Recognition · Computer Science 2017-07-21 Gilad Sharir , Eddie Smolyansky , Itamar Friedman

Video Instance Segmentation (VIS) aims at segmenting and categorizing objects in videos from a closed set of training categories, lacking the generalization ability to handle novel categories in real-world videos. To address this…

Computer Vision and Pattern Recognition · Computer Science 2023-08-08 Haochen Wang , Cilin Yan , Shuai Wang , Xiaolong Jiang , XU Tang , Yao Hu , Weidi Xie , Efstratios Gavves

Video Object Segmentation (VOS) task aims to segment objects in videos. However, previous settings either require time-consuming manual masks of target objects at the first frame during inference or lack the flexibility to specify arbitrary…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Pinxue Guo , Lingyi Hong , Xinyu Zhou , Shuyong Gao , Wanyun Li , Jinglun Li , Zhaoyu Chen , Xiaoqiang Li , Wei Zhang , Wenqiang Zhang

Contemporary Video Object Segmentation (VOS) approaches typically consist stages of feature extraction, matching, memory management, and multiple objects aggregation. Recent advanced models either employ a discrete modeling for these…

Computer Vision and Pattern Recognition · Computer Science 2024-03-14 Wanyun Li , Pinxue Guo , Xinyu Zhou , Lingyi Hong , Yangji He , Xiangyu Zheng , Wei Zhang , Wenqiang Zhang