English
Related papers

Related papers: Learning to Segment Instances in Videos with Spati…

200 papers

Video object segmentation, aiming to segment the foreground objects given the annotation of the first frame, has been attracting increasing attentions. Many state-of-the-art approaches have achieved great performance by relying on online…

Computer Vision and Pattern Recognition · Computer Science 2021-07-12 Siyue Yu , Jimin Xiao , BingFeng Zhang , Eng Gee Lim

Object detection and semantic segmentation are two main themes in object retrieval from high-resolution remote sensing images, which have recently achieved remarkable performance by surfing the wave of deep learning and, more notably,…

Computer Vision and Pattern Recognition · Computer Science 2018-12-05 Lichao Mou , Xiao Xiang Zhu

We propose spatial semantic embedding network (SSEN), a simple, yet efficient algorithm for 3D instance segmentation using deep metric learning. The raw 3D reconstruction of an indoor environment suffers from occlusions, noise, and is…

Computer Vision and Pattern Recognition · Computer Science 2020-07-08 Dongsu Zhang , Junha Chun , Sang Kyun Cha , Young Min Kim

In-context segmentation has drawn increasing attention with the advent of vision foundation models. Its goal is to segment objects using given reference images. Most existing approaches adopt metric learning or masked image modeling to…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Chaoyang Wang , Xiangtai Li , Henghui Ding , Lu Qi , Jiangning Zhang , Yunhai Tong , Chen Change Loy , Shuicheng Yan

Video segmentation consists of a frame-by-frame selection process of meaningful areas related to foreground moving objects. Some applications include traffic monitoring, human tracking, action recognition, efficient video surveillance, and…

Computer Vision and Pattern Recognition · Computer Science 2022-12-22 Daniel F. S. Santos , Rafael G. Pires , Danilo Colombo , João P. Papa

Video object segmentation aims at accurately segmenting the target object regions across consecutive frames. It is technically challenging for coping with complicated factors (e.g., shape deformations, occlusion and out of the lens). Recent…

Computer Vision and Pattern Recognition · Computer Science 2019-07-03 Peng Sun , Peiwen Lin , Guangliang Cheng , Jianping Shi , Jiawan Zhang , Xi Li

In this paper, we propose a novel approach to learning semantic contextual relationships in videos for semantic object segmentation. Our algorithm derives the semantic contexts from video object proposals which encode the key evolution of…

Computer Vision and Pattern Recognition · Computer Science 2024-07-10 Tinghuai Wang

This paper proposes a new framework for semantic segmentation of objects in videos. We address the label inconsistency problem of deep convolutional neural networks (DCNNs) by exploiting the fact that videos have multiple frames; in a few…

Computer Vision and Pattern Recognition · Computer Science 2017-11-23 Seong-Jin Park , Ki-Sang Hong

Instance segmentation with neural networks is an essential task in environment perception. In many works, it has been observed that neural networks can predict false positive instances with high confidence values and true positives with low…

Computer Vision and Pattern Recognition · Computer Science 2026-01-13 Kira Maag , Matthias Rottmann , Serin Varghese , Fabian Hueger , Peter Schlicht , Hanno Gottschalk

In this work we present a novel solution for Video Instance Segmentation(VIS), that is automatically generating instance level segmentation masks along with object class and tracking them in a video. Our method improves the masks from…

Computer Vision and Pattern Recognition · Computer Science 2021-06-22 Vidit Goel , Jiachen Li , Shubhika Garg , Harsh Maheshwari , Humphrey Shi

Recent co-part segmentation methods mostly operate in a supervised learning setting, which requires a large amount of annotated data for training. To overcome this limitation, we propose a self-supervised deep learning method for co-part…

Computer Vision and Pattern Recognition · Computer Science 2021-04-12 Aliaksandr Siarohin , Subhankar Roy , Stéphane Lathuilière , Sergey Tulyakov , Elisa Ricci , Nicu Sebe

This paper addresses the task of unsupervised video multi-object segmentation. Current approaches follow a two-stage paradigm: 1) detect object proposals using pre-trained Mask R-CNN, and 2) conduct generic feature matching for temporal…

Computer Vision and Pattern Recognition · Computer Science 2021-04-13 Tianfei Zhou , Jianwu Li , Xueyi Li , Ling Shao

A major obstacle in instance segmentation is that existing methods often need many per-pixel labels in order to be effective. These labels require large human effort and for certain applications, such labels are not readily available. To…

Computer Vision and Pattern Recognition · Computer Science 2019-07-03 Issam H. Laradji , David Vazquez , Mark Schmidt

The goal of this paper is to discover, segment, and track independently moving objects in complex visual scenes. Previous approaches have explored the use of optical flow for motion segmentation, leading to imperfect predictions due to…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Junyu Xie , Weidi Xie , Andrew Zisserman

Segmenting object instances is a key task in machine perception, with safety-critical applications in robotics and autonomous driving. We introduce a novel approach to instance segmentation that jointly leverages measurements from multiple…

Computer Vision and Pattern Recognition · Computer Science 2022-10-18 Alex Zihao Zhu , Vincent Casser , Reza Mahjourian , Henrik Kretzschmar , Sören Pirk

Video instance segmentation is a challenging task that extends image instance segmentation to the video domain. Existing methods either rely only on single-frame information for the detection and segmentation subproblems or handle tracking…

Computer Vision and Pattern Recognition · Computer Science 2022-03-08 Tao Wang , Ning Xu , Kean Chen , Weiyao Lin

Semi-supervised video object segmentation is an interesting yet challenging task in machine learning. In this work, we conduct a series of refinements with the propagation-based video object segmentation method and empirically evaluate…

Computer Vision and Pattern Recognition · Computer Science 2019-10-01 Dongdong Yu , Kai Su , Hengkai Guo , Jian Wang , Kaihui Zhou , Yuanyuan Huang , Minghui Dong , Jie Shao , Changhu Wang

Segmenting an object in a video presents significant challenges. Each pixel must be accurately labelled, and these labels must remain consistent across frames. The difficulty increases when the segmentation is with arbitrary granularity,…

Computer Vision and Pattern Recognition · Computer Science 2025-02-20 Amirhossein Alimohammadi , Sauradip Nag , Saeid Asgari Taghanaki , Andrea Tagliasacchi , Ghassan Hamarneh , Ali Mahdavi Amiri

Panoptic segmentation assigns semantic and instance ID labels to every pixel of an image. As permutations of instance IDs are also valid solutions, the task requires learning of high-dimensional one-to-many mapping. As a result,…

Computer Vision and Pattern Recognition · Computer Science 2023-10-16 Ting Chen , Lala Li , Saurabh Saxena , Geoffrey Hinton , David J. Fleet

Performing data augmentation for learning deep neural networks is known to be important for training visual recognition systems. By artificially increasing the number of training examples, it helps reducing overfitting and improves…

Computer Vision and Pattern Recognition · Computer Science 2019-09-23 Nikita Dvornik , Julien Mairal , Cordelia Schmid