English
Related papers

Related papers: Learning to Segment Instances in Videos with Spati…

200 papers

Video instance segmentation (VIS) aims at segmenting and tracking objects in videos. Prior methods typically generate frame-level or clip-level object instances first and then associate them by either additional tracking heads or complex…

Computer Vision and Pattern Recognition · Computer Science 2023-01-06 Fei He , Haoyang Zhang , Naiyu Gao , Jian Jia , Yanhu Shan , Xin Zhao , Kaiqi Huang

Video segmentation -- partitioning video frames into multiple segments or objects -- plays a critical role in a broad range of practical applications, from enhancing visual effects in movie, to understanding scenes in autonomous driving, to…

Computer Vision and Pattern Recognition · Computer Science 2022-11-30 Tianfei Zhou , Fatih Porikli , David Crandall , Luc Van Gool , Wenguan Wang

Object detection and instance segmentation are two fundamental computer vision tasks. They are closely correlated but their relations have not yet been fully explored in most previous work. This paper presents RDSNet, a novel deep…

Computer Vision and Pattern Recognition · Computer Science 2019-12-12 Shaoru Wang , Yongchao Gong , Junliang Xing , Lichao Huang , Chang Huang , Weiming Hu

Video instance segmentation aims to detect, segment, and track objects in a video. Current approaches extend image-level segmentation algorithms to the temporal domain. However, this results in temporally inconsistent masks. In this work,…

Computer Vision and Pattern Recognition · Computer Science 2021-12-15 Anirudh S Chakravarthy , Won-Dong Jang , Zudi Lin , Donglai Wei , Song Bai , Hanspeter Pfister

Instance level video object segmentation is an important technique for video editing and compression. To capture the temporal coherence, in this paper, we develop MaskRNN, a recurrent neural net approach which fuses in each frame the output…

Computer Vision and Pattern Recognition · Computer Science 2018-03-30 Yuan-Ting Hu , Jia-Bin Huang , Alexander G. Schwing

Traditional Scene Understanding problems such as Object Detection and Semantic Segmentation have made breakthroughs in recent years due to the adoption of deep learning. However, the former task is not able to localise objects at a pixel…

Computer Vision and Pattern Recognition · Computer Science 2016-09-12 Anurag Arnab , Philip H. S. Torr

Instance segmentation is the problem of detecting and delineating each distinct object of interest appearing in an image. Current instance segmentation approaches consist of ensembles of modules that are trained independently of each other,…

Computer Vision and Pattern Recognition · Computer Science 2016-10-26 Bernardino Romera-Paredes , Philip H. S. Torr

Pixelwise annotation of image sequences can be very tedious for humans. Interactive video object segmentation aims to utilize automatic methods to speed up the process and reduce the workload of the annotators. Most contemporary approaches…

Computer Vision and Pattern Recognition · Computer Science 2021-04-22 Viktor Varga , András Lőrincz

We propose a method for unsupervised video object segmentation by transferring the knowledge encapsulated in image-based instance embedding networks. The instance embedding network produces an embedding vector for each pixel that enables…

Computer Vision and Pattern Recognition · Computer Science 2018-02-28 Siyang Li , Bryan Seybold , Alexey Vorobyov , Alireza Fathi , Qin Huang , C. -C. Jay Kuo

Moving object segmentation plays a crucial role in understanding dynamic scenes involving multiple moving objects, while the difficulties lie in taking into account both spatial texture structures and temporal motion cues. Existing methods…

Computer Vision and Pattern Recognition · Computer Science 2025-02-19 Zhexiong Wan , Bin Fan , Le Hui , Yuchao Dai , Gim Hee Lee

Tracking and segmenting multiple similar objects with distinct or complex parts in long-term videos is particularly challenging due to the ambiguity in identifying target components and the confusion caused by occlusion, background clutter,…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Xin Li , Deshui Miao , Zhenyu He , Yaowei Wang , Huchuan Lu , Ming-Hsuan Yang

Panoptic Segmentation aims to provide an understanding of background (stuff) and instances of objects (things) at a pixel level. It combines the separate tasks of semantic segmentation (pixel level classification) and instance segmentation…

Computer Vision and Pattern Recognition · Computer Science 2021-04-07 Sumanth Chennupati , Venkatraman Narayanan , Ganesh Sistu , Senthil Yogamani , Samir A Rawashdeh

We propose an approach to instance-level image segmentation that is built on top of category-level segmentation. Specifically, for each pixel in a semantic category mask, its corresponding instance bounding box is predicted using a deep…

Computer Vision and Pattern Recognition · Computer Science 2016-05-24 Zifeng Wu , Chunhua Shen , Anton van den Hengel

Weakly supervised instance segmentation reduces the cost of annotations required to train models. However, existing approaches which rely only on image-level class labels predominantly suffer from errors due to (a) partial segmentation of…

Computer Vision and Pattern Recognition · Computer Science 2021-03-25 Qing Liu , Vignesh Ramanathan , Dhruv Mahajan , Alan Yuille , Zhenheng Yang

Video instance segmentation aims at predicting object segmentation masks for each frame, as well as associating the instances across multiple frames. Recent end-to-end video instance segmentation methods are capable of performing object…

Computer Vision and Pattern Recognition · Computer Science 2022-06-15 Quanzeng You , Jiang Wang , Peng Chu , Andre Abrantes , Zicheng Liu

We propose an end-to-end learning framework for generating foreground object segmentations. Given a single novel image, our approach produces pixel-level masks for all "object-like" regions---even for object categories never seen during…

Computer Vision and Pattern Recognition · Computer Science 2017-04-13 Suyog Dutt Jain , Bo Xiong , Kristen Grauman

Online video object segmentation is a challenging task as it entails to process the image sequence timely and accurately. To segment a target object through the video, numerous CNN-based methods have been developed by heavily finetuning on…

Computer Vision and Pattern Recognition · Computer Science 2018-06-07 Jingchun Cheng , Yi-Hsuan Tsai , Wei-Chih Hung , Shengjin Wang , Ming-Hsuan Yang

We propose a novel video object segmentation algorithm based on pixel-level matching using Convolutional Neural Networks (CNN). Our network aims to distinguish the target area from the background on the basis of the pixel-level similarity…

Computer Vision and Pattern Recognition · Computer Science 2017-08-18 Jae Shin Yoon , Francois Rameau , Junsik Kim , Seokju Lee , Seunghak Shin , In So Kweon

Instance segmentation in videos, which aims to segment and track multiple objects in video frames, has garnered a flurry of research attention in recent years. In this paper, we present a novel weakly supervised framework with…

Computer Vision and Pattern Recognition · Computer Science 2022-12-16 Liqi Yan , Qifan Wang , Siqi Ma , Jingang Wang , Changbin Yu

Instance segmentation is one of the actively studied research topics in computer vision in which many objects of interest should be separated individually. While many feed-forward networks produce high-quality segmentation on different…

Computer Vision and Pattern Recognition · Computer Science 2020-05-20 Tuan Tran Anh , Khoa Nguyen-Tuan , Tran Minh Quan , Won-Ki Jeong