English
Related papers

Related papers: Self-supervised Video Object Segmentation

200 papers

This paper addresses the problem of self-supervised video representation learning from a new perspective -- by video pace prediction. It stems from the observation that human visual system is sensitive to video pace, e.g., slow motion, a…

Computer Vision and Pattern Recognition · Computer Science 2020-09-07 Jiangliu Wang , Jianbo Jiao , Yun-Hui Liu

Most recent semi-supervised video object segmentation (VOS) methods rely on fine-tuning deep convolutional neural networks online using the given mask of the first frame or predicted masks of subsequent frames. However, the online…

Computer Vision and Pattern Recognition · Computer Science 2020-02-18 Yingjie Yin , De Xu , Xingang Wang , Lei Zhang

Modern video summarization methods are based on deep neural networks that require a large amount of annotated data for training. However, existing datasets for video summarization are small-scale, easily leading to over-fitting of the deep…

Computer Vision and Pattern Recognition · Computer Science 2022-10-20 Li Haopeng , Ke Qiuhong , Gong Mingming , Tom Drummond

This paper presents a novel semi-supervised deep learning algorithm for retrieving similar 2D and 3D videos based on visual content. The proposed approach combines the power of deep convolutional and recurrent neural networks with dynamic…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Yintai Ma , Diego Klabjan

This paper tackles the problem of semi-supervised video object segmentation, that is, segmenting an object in a sequence given its mask in the first frame. One of the main challenges in this scenario is the change of appearance of the…

Computer Vision and Pattern Recognition · Computer Science 2018-07-19 Sergi Caelles , Yuhua Chen , Jordi Pont-Tuset , Luc Van Gool

Recent progress of self-supervised visual representation learning has achieved remarkable success on many challenging computer vision benchmarks. However, whether these techniques can be used for domain adaptation has not been explored. In…

Computer Vision and Pattern Recognition · Computer Science 2019-12-12 Jiaolong Xu , Liang Xiao , Antonio M. Lopez

Unsupervised video segmentation plays an important role in a wide variety of applications from object identification to compression. However, to date, fast motion, motion blur and occlusions pose significant challenges. To address these…

Computer Vision and Pattern Recognition · Computer Science 2018-09-05 Yuan-Ting Hu , Jia-Bin Huang , Alexander G. Schwing

Video object segmentation is challenging yet important in a wide variety of applications for video analysis. Recent works formulate video object segmentation as a prediction task using deep nets to achieve appealing state-of-the-art…

Computer Vision and Pattern Recognition · Computer Science 2018-09-05 Yuan-Ting Hu , Jia-Bin Huang , Alexander G. Schwing

Unsupervised object discovery aims to localize objects in images, while removing the dependence on annotations required by most deep learning-based methods. To address this problem, we propose a fully unsupervised, bottom-up approach, for…

Computer Vision and Pattern Recognition · Computer Science 2022-12-21 Sandra Kara , Hejer Ammar , Florian Chabot , Quoc-Cuong Pham

We propose a self-supervised spatio-temporal matching method, coined Motion-Aware Mask Propagation (MAMP), for video object segmentation. MAMP leverages the frame reconstruction task for training without the need for annotations. During…

Computer Vision and Pattern Recognition · Computer Science 2021-10-29 Bo Miao , Mohammed Bennamoun , Yongsheng Gao , Ajmal Mian

Self-supervised tasks have been utilized to build useful representations that can be used in downstream tasks when the annotation is unavailable. In this paper, we introduce a self-supervised video representation learning method based on…

Computer Vision and Pattern Recognition · Computer Science 2021-02-23 Duc Quang Vu , Ngan T. H. Le , Jia-Ching Wang

Inspired by recent advances of deep learning in instance segmentation and object tracking, we introduce video object segmentation problem as a concept of guided instance segmentation. Our model proceeds on a per-frame basis, guided by the…

Computer Vision and Pattern Recognition · Computer Science 2019-02-05 Anna Khoreva , Federico Perazzi , Rodrigo Benenson , Bernt Schiele , Alexander Sorkine-Hornung

Video object segmentation aims at accurately segmenting the target object regions across consecutive frames. It is technically challenging for coping with complicated factors (e.g., shape deformations, occlusion and out of the lens). Recent…

Computer Vision and Pattern Recognition · Computer Science 2019-07-03 Peng Sun , Peiwen Lin , Guangliang Cheng , Jianping Shi , Jiawan Zhang , Xi Li

The goal of this paper is to bypass the need for labelled examples in few-shot video understanding at run time. While proven effective, in many practical video settings even labelling a few examples appears unrealistic. This is especially…

Computer Vision and Pattern Recognition · Computer Science 2022-04-20 Pengwan Yang , Yuki M. Asano , Pascal Mettes , Cees G. M. Snoek

We present a multiview pseudo-labeling approach to video learning, a novel framework that uses complementary views in the form of appearance and motion information for semi-supervised learning in video. The complementary views help obtain…

Computer Vision and Pattern Recognition · Computer Science 2021-04-02 Bo Xiong , Haoqi Fan , Kristen Grauman , Christoph Feichtenhofer

Semi-supervised video object segmentation (VOS) aims to segment arbitrary target objects in video when the ground truth segmentation mask of the initial frame is provided. Due to this limitation of using prior knowledge about the target…

Computer Vision and Pattern Recognition · Computer Science 2020-09-21 Suhwan Cho , Heansung Lee , Sungmin Woo , Sungjun Jang , Sangyoun Lee

Video segmentation -- partitioning video frames into multiple segments or objects -- plays a critical role in a broad range of practical applications, from enhancing visual effects in movie, to understanding scenes in autonomous driving, to…

Computer Vision and Pattern Recognition · Computer Science 2022-11-30 Tianfei Zhou , Fatih Porikli , David Crandall , Luc Van Gool , Wenguan Wang

The perception of transparent objects is one of the well-known challenges in computer vision. Conventional depth sensors have difficulty in sensing the depth of transparent objects due to refraction and reflection of light. Previous…

Computer Vision and Pattern Recognition · Computer Science 2025-12-05 Xianghui Fan , Zhaoyu Chen , Mengyang Pan , Anping Deng , Hang Yang

Self-supervised learning has emerged as a powerful paradigm for label-free model pretraining, particularly in the video domain, where manual annotation is costly and time-intensive. However, existing self-supervised approaches employ…

Computer Vision and Pattern Recognition · Computer Science 2025-04-09 Akash Kumar , Ashlesha Kumar , Vibhav Vineet , Yogesh S Rawat

Instance segmentation of unknown objects from images is regarded as relevant for several robot skills including grasping, tracking and object sorting. Recent results in computer vision have shown that large hand-labeled datasets enable high…

Computer Vision and Pattern Recognition · Computer Science 2020-05-20 Andreas Eitel , Nico Hauff , Wolfram Burgard