English
Related papers

Related papers: End-to-end video instance segmentation via spatial…

200 papers

We propose a deep learning-based framework for instance-level object segmentation. Our method mainly consists of three steps. First, We train a generic model based on ResNet-101 for foreground/background segmentations. Second, based on this…

Computer Vision and Pattern Recognition · Computer Science 2017-09-15 Jingchun Cheng , Sifei Liu , Yi-Hsuan Tsai , Wei-Chih Hung , Shalini De Mello , Jinwei Gu , Jan Kautz , Shengjin Wang , Ming-Hsuan Yang

How to make a segmentation model efficiently adapt to a specific video and to online target appearance variations are fundamentally crucial issues in the field of video object segmentation. In this work, a graph memory network is developed…

Computer Vision and Pattern Recognition · Computer Science 2020-12-10 Xiankai Lu , Wenguan Wang , Martin Danelljan , Tianfei Zhou , Jianbing Shen , Luc Van Gool

Segmentation-based tracking has been actively studied in computer vision and multimedia. Superpixel based object segmentation and tracking methods are usually developed for this task. However, they independently perform feature…

Computer Vision and Pattern Recognition · Computer Science 2020-09-09 Bo Jiang , Panpan Zhang , Lili Huang

Instance segmentation in videos, which aims to segment and track multiple objects in video frames, has garnered a flurry of research attention in recent years. In this paper, we present a novel weakly supervised framework with…

Computer Vision and Pattern Recognition · Computer Science 2022-12-16 Liqi Yan , Qifan Wang , Siqi Ma , Jingang Wang , Changbin Yu

Video instance segmentation (VIS) aims to segment and associate all instances of predefined classes for each frame in videos. Prior methods usually obtain segmentation for a frame or clip first, and merge the incomplete results by tracking…

Computer Vision and Pattern Recognition · Computer Science 2021-10-01 Huaijia Lin , Ruizheng Wu , Shu Liu , Jiangbo Lu , Jiaya Jia

In Video Instance Segmentation (VIS), current approaches either focus on the quality of the results, by taking the whole video as input and processing it offline; or on speed, by handling it frame by frame at the cost of competitive…

Computer Vision and Pattern Recognition · Computer Science 2022-11-01 Çağan Selim Çoban , Oğuzhan Keskin , Jordi Pont-Tuset , Fatma Güney

Multi-instance video object segmentation is to segment specific instances throughout a video sequence in pixel level, given only an annotated first frame. In this paper, we implement an effective fully convolutional networks with U-Net…

Computer Vision and Pattern Recognition · Computer Science 2019-05-21 Heguang Liu , Jingle Jiang

We address the challenging task of foreground object discovery and segmentation in video. We introduce an efficient solution, suitable for both unsupervised and supervised scenarios, based on a spacetime graph representation of the video…

Computer Vision and Pattern Recognition · Computer Science 2019-08-06 Emanuela Haller , Adina Magda Florea , Marius Leordeanu

Human video instance segmentation plays an important role in computer understanding of human activities and is widely used in video processing, video surveillance, and human modeling in virtual reality. Most current VIS methods are based on…

Computer Vision and Pattern Recognition · Computer Science 2022-04-01 Lu Cheng , Mingbo Zhao

3D instance segmentation remains a challenging problem in computer vision. Particle tracking at colliders like the LHC can be conceptualized as an instance segmentation task: beginning from a point cloud of hits in a particle detector, an…

Computer Vision and Pattern Recognition · Computer Science 2021-03-12 Savannah Thais , Gage DeZoort

We propose a method for unsupervised video object segmentation by transferring the knowledge encapsulated in image-based instance embedding networks. The instance embedding network produces an embedding vector for each pixel that enables…

Computer Vision and Pattern Recognition · Computer Science 2018-02-28 Siyang Li , Bryan Seybold , Alexey Vorobyov , Alireza Fathi , Qin Huang , C. -C. Jay Kuo

Image segmentation is an important step in most visual tasks. While convolutional neural networks have shown to perform well on single image segmentation, to our knowledge, no study has been been done on leveraging recurrent gated…

Computer Vision and Pattern Recognition · Computer Science 2016-11-01 Sepehr Valipour , Mennatullah Siam , Martin Jagersand , Nilanjan Ray

This paper addresses the challenge of 3D instance segmentation by simultaneously leveraging 3D geometric and multi-view image information. Many previous works have applied deep learning techniques to 3D point clouds for instance…

Computer Vision and Pattern Recognition · Computer Science 2024-08-05 Haoyu Guo , He Zhu , Sida Peng , Yuang Wang , Yujun Shen , Ruizhen Hu , Xiaowei Zhou

Instance level video object segmentation is an important technique for video editing and compression. To capture the temporal coherence, in this paper, we develop MaskRNN, a recurrent neural net approach which fuses in each frame the output…

Computer Vision and Pattern Recognition · Computer Science 2018-03-30 Yuan-Ting Hu , Jia-Bin Huang , Alexander G. Schwing

Different to semantic segmentation, instance segmentation assigns unique labels to each individual instance of the same class. In this work, we propose a novel recurrent fully convolutional network architecture for tracking such instance…

Computer Vision and Pattern Recognition · Computer Science 2018-07-31 Christian Payer , Darko Štern , Thomas Neff , Horst Bischof , Martin Urschler

We present a novel graph neural network (GNN) approach for cell tracking in high-throughput microscopy videos. By modeling the entire time-lapse sequence as a direct graph where cell instances are represented by its nodes and their…

Computer Vision and Pattern Recognition · Computer Science 2022-07-19 Tal Ben-Haim , Tammy Riklin Raviv

The handling of long videos with complex and occluded sequences has recently emerged as a new challenge in the video instance segmentation (VIS) community. However, existing methods have limitations in addressing this challenge. We argue…

Computer Vision and Pattern Recognition · Computer Science 2023-03-27 Miran Heo , Sukjun Hwang , Jeongseok Hyun , Hanjung Kim , Seoung Wug Oh , Joon-Young Lee , Seon Joo Kim

Video Instance Segmentation (VIS) is a multi-task problem performing detection, segmentation, and tracking simultaneously. Extended from image set applications, video data additionally induces the temporal information, which, if handled…

Computer Vision and Pattern Recognition · Computer Science 2021-07-12 Thuy C. Nguyen , Tuan N. Tang , Nam LH. Phan , Chuong H. Nguyen , Masayuki Yamazaki , Masao Yamanaka

This study explores the potential of graph neural networks (GNNs) to enhance semantic segmentation across diverse image modalities. We evaluate the effectiveness of a novel GNN-based U-Net architecture on three distinct datasets: PascalVOC,…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Aryan Singh , Pepijn Van de Ven , Ciarán Eising , Patrick Denny

This paper presents a method for automatic video object segmentation based on the fusion of motion stream, appearance stream, and instance-aware segmentation. The proposed scheme consists of a two-stream fusion network and an instance…

Computer Vision and Pattern Recognition · Computer Science 2019-12-04 Sungkwon Choo , Wonkyo Seo , Nam Ik Cho