English
Related papers

Related papers: Fast Video Object Segmentation With Temporal Aggre…

200 papers

We propose a novel solution for semi-supervised video object segmentation. By the nature of the problem, available cues (e.g. video frame(s) with object masks) become richer with the intermediate predictions. However, the existing methods…

Computer Vision and Pattern Recognition · Computer Science 2019-08-13 Seoung Wug Oh , Joon-Young Lee , Ning Xu , Seon Joo Kim

This paper addresses the task of segmenting moving objects in unconstrained videos. We introduce a novel two-stream neural network with an explicit memory module to achieve this. The two streams of the network encode spatial and temporal…

Computer Vision and Pattern Recognition · Computer Science 2017-07-13 Pavel Tokmakov , Karteek Alahari , Cordelia Schmid

Semi-supervised video object segmentation (VOS) aims to densely track certain designated objects in videos. One of the main challenges in this task is the existence of background distractors that appear similar to the target objects. We…

Computer Vision and Pattern Recognition · Computer Science 2022-08-16 Suhwan Cho , Heansung Lee , Minhyeok Lee , Chaewon Park , Sungjun Jang , Minjung Kim , Sangyoun Lee

Video Object Segmentation, and video processing in general, has been historically dominated by methods that rely on the temporal consistency and redundancy in consecutive video frames. When the temporal smoothness is suddenly broken, such…

Computer Vision and Pattern Recognition · Computer Science 2018-05-17 Kevis-Kokitsi Maninis , Sergi Caelles , Yuhua Chen , Jordi Pont-Tuset , Laura Leal-Taixé , Daniel Cremers , Luc Van Gool

We present a novel approach to unsupervised learning for video object segmentation (VOS). Unlike previous work, our formulation allows to learn dense feature representations directly in a fully convolutional regime. We rely on uniform grid…

Computer Vision and Pattern Recognition · Computer Science 2021-11-12 Nikita Araslanov , Simone Schaub-Meyer , Stefan Roth

We propose a new method for video object segmentation (VOS) that addresses object pattern learning from unlabeled videos, unlike most existing methods which rely heavily on extensive annotated data. We introduce a unified…

Computer Vision and Pattern Recognition · Computer Science 2020-03-12 Xiankai Lu , Wenguan Wang , Jianbing Shen , Yu-Wing Tai , David Crandall , Steven C. H. Hoi

Video object segmentation (VOS) has made significant progress with the rise of deep learning. However, there still exist some thorny problems, for example, similar objects are easily confused and tiny objects are difficult to be found. To…

Computer Vision and Pattern Recognition · Computer Science 2022-06-22 Wangwang Yang , Jinming Su , Yiting Duan , Tingyi Guo , Junfeng Luo

This paper addresses the task of unsupervised video multi-object segmentation. Current approaches follow a two-stage paradigm: 1) detect object proposals using pre-trained Mask R-CNN, and 2) conduct generic feature matching for temporal…

Computer Vision and Pattern Recognition · Computer Science 2021-04-13 Tianfei Zhou , Jianwu Li , Xueyi Li , Ling Shao

We propose a new matching-based framework for semi-supervised video object segmentation (VOS). Recently, state-of-the-art VOS performance has been achieved by matching-based algorithms, in which feature banks are created to store features…

Computer Vision and Pattern Recognition · Computer Science 2020-10-19 Yongqing Liang , Xin Li , Navid Jafari , Qin Chen

Despite online learning (OL) techniques have boosted the performance of semi-supervised video object segmentation (VOS) methods, the huge time costs of OL greatly restrict their practicality. Matching based and propagation based methods run…

Computer Vision and Pattern Recognition · Computer Science 2020-05-29 Ziqin Wang , Jun Xu , Li Liu , Fan Zhu , Ling Shao

Multiple object video object segmentation is a challenging task, specially for the zero-shot case, when no object mask is given at the initial frame and the model has to find the objects to be segmented along the sequence. In our work, we…

Computer Vision and Pattern Recognition · Computer Science 2019-05-22 Carles Ventura , Miriam Bellver , Andreu Girbau , Amaia Salvador , Ferran Marques , Xavier Giro-i-Nieto

Segmentation of objects in a video is challenging due to the nuances such as motion blurring, parallax, occlusions, changes in illumination, etc. Instead of addressing these nuances separately, we focus on building a generalizable solution…

Computer Vision and Pattern Recognition · Computer Science 2023-07-11 Silky Singh , Shripad Deshmukh , Mausoom Sarkar , Rishabh Jain , Mayur Hemani , Balaji Krishnamurthy

In this work we present SwiftNet for real-time semisupervised video object segmentation (one-shot VOS), which reports 77.8% J &F and 70 FPS on DAVIS 2017 validation dataset, leading all present solutions in overall accuracy and speed…

Computer Vision and Pattern Recognition · Computer Science 2021-04-22 Haochen Wang , Xiaolong Jiang , Haibing Ren , Yao Hu , Song Bai

Video object segmentation (VOS) -- predicting pixel-level regions for objects within each frame of a video -- is particularly challenging in agricultural scenarios, where videos of crops include hundreds of small, dense, and occluded…

Computer Vision and Pattern Recognition · Computer Science 2025-04-17 Keyhan Najafian , Farhad Maleki , Lingling Jin , Ian Stavness

The problem of video object segmentation can become extremely challenging when multiple instances co-exist. While each instance may exhibit large scale and pose variations, the problem is compounded when instances occlude each other causing…

Computer Vision and Pattern Recognition · Computer Science 2018-03-15 Xiaoxiao Li , Chen Change Loy

In this paper we introduce a Transformer-based approach to video object segmentation (VOS). To address compounding error and scalability issues of prior work, we propose a scalable, end-to-end method for VOS called Sparse Spatiotemporal…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Brendan Duke , Abdalla Ahmed , Christian Wolf , Parham Aarabi , Graham W. Taylor

Matching-based networks have achieved state-of-the-art performance for video object segmentation (VOS) tasks by storing every-k frames in an external memory bank for future inference. Storing the intermediate frames' predictions provides…

Computer Vision and Pattern Recognition · Computer Science 2022-04-15 Ali Pourganjalikhan , Charalambos Poullis

We tackle the task of semi-supervised video object segmentation, i.e. segmenting the pixels belonging to an object in the video using the ground truth pixel mask for the first frame. We build on the recently introduced one-shot video object…

Computer Vision and Pattern Recognition · Computer Science 2017-08-02 Paul Voigtlaender , Bastian Leibe

The objective of this paper is self-supervised representation learning, with the goal of solving semi-supervised video object segmentation (a.k.a. dense tracking). We make the following contributions: (i) we propose to improve the existing…

Computer Vision and Pattern Recognition · Computer Science 2020-06-23 Fangrui Zhu , Li Zhang , Yanwei Fu , Guodong Guo , Weidi Xie

In Video Instance Segmentation (VIS), current approaches either focus on the quality of the results, by taking the whole video as input and processing it offline; or on speed, by handling it frame by frame at the cost of competitive…

Computer Vision and Pattern Recognition · Computer Science 2022-11-01 Çağan Selim Çoban , Oğuzhan Keskin , Jordi Pont-Tuset , Fatma Güney