English
Related papers

Related papers: Self-Supervised Video Object Segmentation by Motio…

200 papers

Semi-supervised video object segmentation is a task of segmenting the target object in a video sequence given only a mask annotation in the first frame. The limited information available makes it an extremely challenging task. Most previous…

Computer Vision and Pattern Recognition · Computer Science 2021-08-10 Yunyao Mao , Ning Wang , Wengang Zhou , Houqiang Li

Unsupervised video segmentation plays an important role in a wide variety of applications from object identification to compression. However, to date, fast motion, motion blur and occlusions pose significant challenges. To address these…

Computer Vision and Pattern Recognition · Computer Science 2018-09-05 Yuan-Ting Hu , Jia-Bin Huang , Alexander G. Schwing

We present IMAS, a method that segments the primary objects in videos without manual annotation in training or inference. Previous methods in unsupervised video object segmentation (UVOS) have demonstrated the effectiveness of motion as…

Computer Vision and Pattern Recognition · Computer Science 2022-12-20 Long Lian , Zhirong Wu , Stella X. Yu

Video object segmentation aims at accurately segmenting the target object regions across consecutive frames. It is technically challenging for coping with complicated factors (e.g., shape deformations, occlusion and out of the lens). Recent…

Computer Vision and Pattern Recognition · Computer Science 2019-07-03 Peng Sun , Peiwen Lin , Guangliang Cheng , Jianping Shi , Jiawan Zhang , Xi Li

Current top-leading solutions for video object segmentation (VOS) typically follow a matching-based regime: for each query frame, the segmentation mask is inferred according to its correspondence to previously processed and the first…

Computer Vision and Pattern Recognition · Computer Science 2023-04-14 Yurong Zhang , Liulei Li , Wenguan Wang , Rong Xie , Li Song , Wenjun Zhang

Temporal segmentation of long videos is an important problem, that has largely been tackled through supervised learning, often requiring large amounts of annotated training data. In this paper, we tackle the problem of self-supervised…

Computer Vision and Pattern Recognition · Computer Science 2019-04-09 Sathyanarayanan N. Aakur , Sudeep Sarkar

Existing deep learning based unsupervised video object segmentation methods still rely on ground-truth segmentation masks to train. Unsupervised in this context only means that no annotated frames are used during inference. As obtaining…

Computer Vision and Pattern Recognition · Computer Science 2021-11-30 Sahir Shrestha , Mohammad Ali Armin , Hongdong Li , Nick Barnes

Understanding objects in videos in terms of fine-grained localization masks and detailed semantic properties is a fundamental task in video understanding. In this paper, we propose VoCap, a flexible video model that consumes a video and a…

Computer Vision and Pattern Recognition · Computer Science 2025-09-01 Jasper Uijlings , Xingyi Zhou , Xiuye Gu , Arsha Nagrani , Anurag Arnab , Alireza Fathi , David Ross , Cordelia Schmid

We present Modular interactive VOS (MiVOS) framework which decouples interaction-to-mask and mask propagation, allowing for higher generalizability and better performance. Trained separately, the interaction module converts user…

Computer Vision and Pattern Recognition · Computer Science 2021-03-23 Ho Kei Cheng , Yu-Wing Tai , Chi-Keung Tang

In computer vision, video segmentation and tracking is an important challenging issue. In this paper, we describe a new video sequences segmentation and tracking algorithm based on MAS "multi-agent systems" and SURF "Speeded Up Robust…

Multimedia · Computer Science 2013-08-02 Mohamed Chakroun , Ali Wali , Adel M. Alimi

This paper addresses the task of segmenting moving objects in unconstrained videos. We introduce a novel two-stream neural network with an explicit memory module to achieve this. The two streams of the network encode spatial and temporal…

Computer Vision and Pattern Recognition · Computer Science 2017-07-13 Pavel Tokmakov , Karteek Alahari , Cordelia Schmid

Video Object Segmentation (VOS) is typically formulated in a semi-supervised setting. Given the ground-truth segmentation mask on the first frame, the task of VOS is to track and segment the single or multiple objects of interests in the…

Computer Vision and Pattern Recognition · Computer Science 2020-03-16 Kaihua Zhang , Long Wang , Dong Liu , Bo Liu , Qingshan Liu , Zhu Li

Intelligent agent naturally learns from motion. Various self-supervised algorithms have leveraged motion cues to learn effective visual representations. The hurdle here is that motion is both ambiguous and complex, rendering previous works…

Computer Vision and Pattern Recognition · Computer Science 2019-04-26 Xiaohang Zhan , Xingang Pan , Ziwei Liu , Dahua Lin , Chen Change Loy

Moving object segmentation plays a vital role in understanding dynamic visual environments. While existing methods rely on multi-frame image sequences to identify moving objects, single-image MOS is critical for applications like motion…

Computer Vision and Pattern Recognition · Computer Science 2025-04-10 Chang Nie , Yiqing Xu , Guangming Wang , Zhe Liu , Yanzi Miao , Hesheng Wang

This paper addresses the task of segmenting class-agnostic objects in semi-supervised setting. Although previous detection based methods achieve relatively good performance, these approaches extract the best proposal by a greedy strategy,…

Computer Vision and Pattern Recognition · Computer Science 2020-12-11 Daizong Liu , Shuangjie Xu , Xiao-Yang Liu , Zichuan Xu , Wei Wei , Pan Zhou

Self-attention is of vital importance in semantic segmentation as it enables modeling of long-range context, which translates into improved performance. We argue that it is equally important to model short-range context, especially to…

Computer Vision and Pattern Recognition · Computer Science 2022-12-29 Hasib Zunair , A. Ben Hamza

Video Instance Segmentation is a fundamental computer vision task that deals with segmenting and tracking object instances across a video sequence. Most existing methods typically accomplish this task by employing a multi-stage top-down…

Computer Vision and Pattern Recognition · Computer Science 2022-04-25 Jyoti Kini , Mubarak Shah

Video instance segmentation aims at predicting object segmentation masks for each frame, as well as associating the instances across multiple frames. Recent end-to-end video instance segmentation methods are capable of performing object…

Computer Vision and Pattern Recognition · Computer Science 2022-06-15 Quanzeng You , Jiang Wang , Peng Chu , Andre Abrantes , Zicheng Liu

Promptable segmentation has emerged as a powerful paradigm in computer vision, enabling users to guide models in parsing complex scenes with prompts such as clicks, boxes, or textual cues. Recent advances, exemplified by the Segment…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Yoonwoo Jeong , Cheng Sun , Yu-Chiang Frank Wang , Minsu Cho , Jaesung Choe

Accuracy and processing speed are two important factors that affect the use of video object segmentation (VOS) in real applications. With the advanced techniques of deep neural networks, the accuracy has been significantly improved,…

Computer Vision and Pattern Recognition · Computer Science 2019-08-29 Tao Zhuo , Zhiyong Cheng , Mohan Kankanhalli