English
Related papers

Related papers: Learning Video Object Segmentation with Visual Mem…

200 papers

We propose a novel video object segmentation algorithm based on pixel-level matching using Convolutional Neural Networks (CNN). Our network aims to distinguish the target area from the background on the basis of the pixel-level similarity…

Computer Vision and Pattern Recognition · Computer Science 2017-08-18 Jae Shin Yoon , Francois Rameau , Junsik Kim , Seokju Lee , Seunghak Shin , In So Kweon

Segmenting objects in images and separating sound sources in audio are challenging tasks, in part because traditional approaches require large amounts of labeled data. In this paper we develop a neural network model for visual object…

Computer Vision and Pattern Recognition · Computer Science 2019-04-22 Andrew Rouditchenko , Hang Zhao , Chuang Gan , Josh McDermott , Antonio Torralba

Humans can easily segment moving objects without knowing what they are. That objectness could emerge from continuous visual observations motivates us to model grouping and movement concurrently from unlabeled videos. Our premise is that a…

Computer Vision and Pattern Recognition · Computer Science 2021-11-12 Runtao Liu , Zhirong Wu , Stella X. Yu , Stephen Lin

Recently, Space-Time Memory Network (STM) based methods have achieved state-of-the-art performance in semi-supervised video object segmentation (VOS). A crucial problem in this task is how to model the dependency both among different frames…

Computer Vision and Pattern Recognition · Computer Science 2021-09-21 Jianbiao Mei , Mengmeng Wang , Yeneng Lin , Yi Yuan , Yong Liu

We developed a real-time, high-quality semi-supervised video object segmentation algorithm. Its accuracy is on par with the most accurate, time-consuming online-learning model, while its speed is similar to the fastest template-matching…

Computer Vision and Pattern Recognition · Computer Science 2020-07-21 Yu Li , Zhuoran Shen , Ying Shan

As a milestone for video object segmentation, one-shot video object segmentation (OSVOS) has achieved a large margin compared to the conventional optical-flow based methods regarding to the segmentation accuracy. Its excellent performance…

Computer Vision and Pattern Recognition · Computer Science 2019-08-21 Yu Liu , Yutong Dai , Anh-Dzung Doan , Lingqiao Liu , Ian Reid

Multi-instance video object segmentation is to segment specific instances throughout a video sequence in pixel level, given only an annotated first frame. In this paper, we implement an effective fully convolutional networks with U-Net…

Computer Vision and Pattern Recognition · Computer Science 2019-05-21 Heguang Liu , Jingle Jiang

Video object segmentation targets at segmenting a specific object throughout a video sequence, given only an annotated first frame. Recent deep learning based approaches find it effective by fine-tuning a general-purpose segmentation model…

Computer Vision and Pattern Recognition · Computer Science 2018-02-06 Linjie Yang , Yanran Wang , Xuehan Xiong , Jianchao Yang , Aggelos K. Katsaggelos

Moving object segmentation is a crucial task for achieving a high-level understanding of visual scenes and has numerous downstream applications. Humans can effortlessly segment moving objects in videos. Previous work has largely relied on…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Nan Huang , Wenzhao Zheng , Chenfeng Xu , Kurt Keutzer , Shanghang Zhang , Angjoo Kanazawa , Qianqian Wang

In order to learn object segmentation models in videos, conventional methods require a large amount of pixel-wise ground truth annotations. However, collecting such supervised data is time-consuming and labor-intensive. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2019-01-09 Yi-Wen Chen , Yi-Hsuan Tsai , Chu-Ya Yang , Yen-Yu Lin , Ming-Hsuan Yang

Convolutional networks reach top quality in pixel-level video object segmentation but require a large amount of training data (1k~100k) to deliver such results. We propose a new training strategy which achieves state-of-the-art results…

Computer Vision and Pattern Recognition · Computer Science 2019-03-15 Anna Khoreva , Rodrigo Benenson , Eddy Ilg , Thomas Brox , Bernt Schiele

One of the fundamental challenges in video object segmentation is to find an effective representation of the target and background appearance. The best performing approaches resort to extensive fine-tuning of a convolutional neural network…

Computer Vision and Pattern Recognition · Computer Science 2018-12-10 Joakim Johnander , Martin Danelljan , Emil Brissman , Fahad Shahbaz Khan , Michael Felsberg

This paper proposes a new framework for semantic segmentation of objects in videos. We address the label inconsistency problem of deep convolutional neural networks (DCNNs) by exploiting the fact that videos have multiple frames; in a few…

Computer Vision and Pattern Recognition · Computer Science 2017-11-23 Seong-Jin Park , Ki-Sang Hong

Spatio-temporal feature learning is of central importance for action recognition in videos. Existing deep neural network models either learn spatial and temporal features independently (C2D) or jointly with unconstrained parameters (C3D).…

Computer Vision and Pattern Recognition · Computer Science 2019-03-05 Chao Li , Qiaoyong Zhong , Di Xie , Shiliang Pu

We describe a new spatio-temporal video autoencoder, based on a classic spatial image autoencoder and a novel nested temporal autoencoder. The temporal encoder is represented by a differentiable visual memory composed of convolutional long…

Machine Learning · Computer Science 2016-09-02 Viorica Patraucean , Ankur Handa , Roberto Cipolla

We introduce ReConvNet, a recurrent convolutional architecture for semi-supervised video object segmentation that is able to fast adapt its features to focus on any specific object of interest at inference time. Generalization to new…

Computer Vision and Pattern Recognition · Computer Science 2018-06-19 Francesco Lattari , Marco Ciccone , Matteo Matteucci , Jonathan Masci , Francesco Visin

We address the highly challenging problem of video object segmentation. Given only the initial mask, the task is to segment the target in the subsequent frames. In order to effectively handle appearance changes and similar background…

Computer Vision and Pattern Recognition · Computer Science 2019-04-19 Andreas Robinson , Felix Järemo Lawin , Martin Danelljan , Fahad Shahbaz Khan , Michael Felsberg

Recent state-of-the-art semi-supervised Video Object Segmentation (VOS) methods have shown significant improvements in target object segmentation accuracy when information from preceding frames is used in segmenting the current frame. In…

Computer Vision and Pattern Recognition · Computer Science 2024-02-15 Amir Nazemi , Mohammad Javad Shafiee , Zahra Gharaee , Paul Fieguth

In this paper, we present a unified, end-to-end trainable spatiotemporal CNN model for VOS, which consists of two branches, i.e., the temporal coherence branch and the spatial segmentation branch. Specifically, the temporal coherence branch…

Computer Vision and Pattern Recognition · Computer Science 2019-04-05 Kai Xu , Longyin Wen , Guorong Li , Liefeng Bo , Qingming Huang

Recent co-part segmentation methods mostly operate in a supervised learning setting, which requires a large amount of annotated data for training. To overcome this limitation, we propose a self-supervised deep learning method for co-part…

Computer Vision and Pattern Recognition · Computer Science 2021-04-12 Aliaksandr Siarohin , Subhankar Roy , Stéphane Lathuilière , Sergey Tulyakov , Elisa Ricci , Nicu Sebe