English
Related papers

Related papers: One-shot Training for Video Object Segmentation

200 papers

Video object segmentation (VOS) has made significant progress with the rise of deep learning. However, there still exist some thorny problems, for example, similar objects are easily confused and tiny objects are difficult to be found. To…

Computer Vision and Pattern Recognition · Computer Science 2022-06-22 Wangwang Yang , Jinming Su , Yiting Duan , Tingyi Guo , Junfeng Luo

Current semi-supervised video object segmentation (VOS) methods usually leverage the entire features of one frame to predict object masks and update memory. This introduces significant redundant computations. To reduce redundancy, we…

Computer Vision and Pattern Recognition · Computer Science 2022-07-22 Bo Miao , Mohammed Bennamoun , Yongsheng Gao , Ajmal Mian

We approach video object segmentation (VOS) by splitting the task into two sub-tasks: bounding box level tracking, followed by bounding box segmentation. Following this paradigm, we present BoLTVOS (Box-Level Tracking for VOS), which…

Computer Vision and Pattern Recognition · Computer Science 2020-01-01 Paul Voigtlaender , Jonathon Luiten , Bastian Leibe

In this paper, we propose a simple yet effective approach for self-supervised video object segmentation (VOS). Our key insight is that the inherent structural dependencies present in DINO-pretrained Transformers can be leveraged to…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Shuangrui Ding , Rui Qian , Haohang Xu , Dahua Lin , Hongkai Xiong

We consider the challenging problem of zero-shot video object segmentation (VOS). That is, segmenting and tracking multiple moving objects within a video fully automatically, without any manual initialization. We treat this as a grouping…

Computer Vision and Pattern Recognition · Computer Science 2020-08-17 Shreyank N Gowda , Panagiotis Eustratiadis , Timothy Hospedales , Laura Sevilla-Lara

Semi-supervised video object segmentation aims to separate a target object from a video sequence, given the mask in the first frame. Most of current prevailing methods utilize information from additional modules trained in other domains…

Computer Vision and Pattern Recognition · Computer Science 2020-04-17 Yizhuo Zhang , Zhirong Wu , Houwen Peng , Stephen Lin

Unsupervised video object segmentation (UVOS) is a per-pixel binary labeling problem which aims at separating the foreground object from the background in the video without using the ground truth (GT) mask of the foreground object. Most of…

Computer Vision and Pattern Recognition · Computer Science 2021-12-24 Youngjo Lee , Hongje Seong , Euntai Kim

Video object segmentation (VOS) aims at segmenting a particular object throughout the entire video clip sequence. The state-of-the-art VOS methods have achieved excellent performance (e.g., 90+% J&F) on existing datasets. However, since the…

Computer Vision and Pattern Recognition · Computer Science 2023-10-24 Henghui Ding , Chang Liu , Shuting He , Xudong Jiang , Philip H. S. Torr , Song Bai

The task of referring video object segmentation aims to segment the object in the frames of a given video to which the referring expressions refer. Previous methods adopt multi-stage approach and design complex pipelines to obtain promising…

Computer Vision and Pattern Recognition · Computer Science 2023-01-02 Zhiwei Hu , Bo Chen , Yuan Gao , Zhilong Ji , Jinfeng Bai

One-shot Video Object Segmentation~(VOS) is the task of pixel-wise tracking an object of interest within a video sequence, where the segmentation mask of the first frame is given at inference time. In recent years, Recurrent Neural…

Computer Vision and Pattern Recognition · Computer Science 2020-11-10 Fatemeh Azimi , Stanislav Frolov , Federico Raue , Joern Hees , Andreas Dengel

Online video object segmentation is a challenging task as it entails to process the image sequence timely and accurately. To segment a target object through the video, numerous CNN-based methods have been developed by heavily finetuning on…

Computer Vision and Pattern Recognition · Computer Science 2018-06-07 Jingchun Cheng , Yi-Hsuan Tsai , Wei-Chih Hung , Shengjin Wang , Ming-Hsuan Yang

Inspired by recent advances of deep learning in instance segmentation and object tracking, we introduce video object segmentation problem as a concept of guided instance segmentation. Our model proceeds on a per-frame basis, guided by the…

Computer Vision and Pattern Recognition · Computer Science 2019-02-05 Anna Khoreva , Federico Perazzi , Rodrigo Benenson , Bernt Schiele , Alexander Sorkine-Hornung

Many of the recent successful methods for video object segmentation (VOS) are overly complicated, heavily rely on fine-tuning on the first frame, and/or are slow, and are hence of limited practical use. In this work, we propose FEELVOS as a…

Computer Vision and Pattern Recognition · Computer Science 2019-04-09 Paul Voigtlaender , Yuning Chai , Florian Schroff , Hartwig Adam , Bastian Leibe , Liang-Chieh Chen

We address the highly challenging problem of video object segmentation. Given only the initial mask, the task is to segment the target in the subsequent frames. In order to effectively handle appearance changes and similar background…

Computer Vision and Pattern Recognition · Computer Science 2019-04-19 Andreas Robinson , Felix Järemo Lawin , Martin Danelljan , Fahad Shahbaz Khan , Michael Felsberg

Annotating videos with object segmentation masks typically involves a two stage procedure of drawing polygons per object instance for all the frames and then linking them through time. While simple, this is a very tedious, time consuming…

Computer Vision and Pattern Recognition · Computer Science 2021-01-19 Namdar Homayounfar , Justin Liang , Wei-Chiu Ma , Raquel Urtasun

We propose a novel solution for semi-supervised video object segmentation. By the nature of the problem, available cues (e.g. video frame(s) with object masks) become richer with the intermediate predictions. However, the existing methods…

Computer Vision and Pattern Recognition · Computer Science 2019-08-13 Seoung Wug Oh , Joon-Young Lee , Ning Xu , Seon Joo Kim

We present an approach to semi-supervised video object segmentation, in the context of the DAVIS 2017 challenge. Our approach combines category-based object detection, category-independent object appearance segmentation and temporal object…

Computer Vision and Pattern Recognition · Computer Science 2017-07-21 Gilad Sharir , Eddie Smolyansky , Itamar Friedman

In recent years, the task of segmenting foreground objects from background in a video, i.e. video object segmentation (VOS), has received considerable attention. In this paper, we propose a single end-to-end trainable deep neural network,…

Computer Vision and Pattern Recognition · Computer Science 2019-10-02 Ye Lyu , George Vosselman , Gui-Song Xia , Michael Ying Yang

Recently, video object segmentation (VOS) networks typically use memory-based methods: for each query frame, the mask is predicted by space-time matching to memory frames. Despite these methods having superior performance, they suffer from…

Computer Vision and Pattern Recognition · Computer Science 2024-05-08 Yadang Chen , Wentao Zhu , Zhi-Xin Yang , Enhua Wu

Video instance segmentation (VIS) is a challenging vision task that aims to detect, segment, and track objects in videos. Conventional VIS methods rely on densely-annotated object masks which are expensive. We reduce the human annotations…

Computer Vision and Pattern Recognition · Computer Science 2024-04-03 Shuaiyi Huang , De-An Huang , Zhiding Yu , Shiyi Lan , Subhashree Radhakrishnan , Jose M. Alvarez , Abhinav Shrivastava , Anima Anandkumar