English
Related papers

Related papers: Contextual Guided Segmentation Framework for Semi-…

200 papers

This paper presents a weakly-supervised approach to object instance segmentation. Starting with known or predicted object bounding boxes, we learn object masks by playing a game of cut-and-paste in an adversarial learning setup. A mask…

Computer Vision and Pattern Recognition · Computer Science 2018-03-20 Tal Remez , Jonathan Huang , Matthew Brown

Video Object Segmentation (VOS) task aims to segment objects in videos. However, previous settings either require time-consuming manual masks of target objects at the first frame during inference or lack the flexibility to specify arbitrary…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Pinxue Guo , Lingyi Hong , Xinyu Zhou , Shuyong Gao , Wanyun Li , Jinglun Li , Zhaoyu Chen , Xiaoqiang Li , Wei Zhang , Wenqiang Zhang

Instance segmentation is a computer vision task where separate objects in an image are detected and segmented. State-of-the-art deep neural network models require large amounts of labeled data in order to perform well in this task. Making…

Computer Vision and Pattern Recognition · Computer Science 2022-02-21 Tuomas Sormunen , Arttu Lämsä , Miguel Bordallo Lopez

Panoptic Segmentation aims to provide an understanding of background (stuff) and instances of objects (things) at a pixel level. It combines the separate tasks of semantic segmentation (pixel level classification) and instance segmentation…

Computer Vision and Pattern Recognition · Computer Science 2021-04-07 Sumanth Chennupati , Venkatraman Narayanan , Ganesh Sistu , Senthil Yogamani , Samir A Rawashdeh

Partially-supervised instance segmentation is a task which requests segmenting objects from novel unseen categories via learning on limited seen categories with annotated masks thus eliminating demands of heavy annotation burden. The key to…

Computer Vision and Pattern Recognition · Computer Science 2022-03-25 Xuehui Wang , Kai Zhao , Ruixin Zhang , Shouhong Ding , Yan Wang , Wei Shen

Self-supervised learning has drawn attention through its effectiveness in learning in-domain representations with no ground-truth annotations; in particular, it is shown that properly designed pretext tasks (e.g., contrastive prediction…

Computer Vision and Pattern Recognition · Computer Science 2022-01-17 Jonghwan Mun , Minchul Shin , Gunsoo Han , Sangho Lee , Seongsu Ha , Joonseok Lee , Eun-Sol Kim

Many of the recent successful methods for video object segmentation (VOS) are overly complicated, heavily rely on fine-tuning on the first frame, and/or are slow, and are hence of limited practical use. In this work, we propose FEELVOS as a…

Computer Vision and Pattern Recognition · Computer Science 2019-04-09 Paul Voigtlaender , Yuning Chai , Florian Schroff , Hartwig Adam , Bastian Leibe , Liang-Chieh Chen

Spatio-temporal video grounding (or STVG) task aims at locating a spatio-temporal tube for a specific instance given a text query. Despite advancements, current methods easily suffer the distractors or heavy object appearance variations in…

Computer Vision and Pattern Recognition · Computer Science 2024-01-04 Xin Gu , Heng Fan , Yan Huang , Tiejian Luo , Libo Zhang

The discrimination of instance embeddings plays a vital role in associating instances across time for online video instance segmentation (VIS). Instance embedding learning is directly supervised by the contrastive loss computed upon the…

Computer Vision and Pattern Recognition · Computer Science 2023-07-25 Kaining Ying , Qing Zhong , Weian Mao , Zhenhua Wang , Hao Chen , Lin Yuanbo Wu , Yifan Liu , Chengxiang Fan , Yunzhi Zhuge , Chunhua Shen

Existing Video Object Segmentation (VOS) relies on explicit user instructions, such as categories, masks, or short phrases, restricting their ability to perform complex video segmentation requiring reasoning with world knowledge. In this…

Computer Vision and Pattern Recognition · Computer Science 2024-07-17 Cilin Yan , Haochen Wang , Shilin Yan , Xiaolong Jiang , Yao Hu , Guoliang Kang , Weidi Xie , Efstratios Gavves

Semantic Segmentation combines two sub-tasks: the identification of pixel-level image masks and the application of semantic labels to those masks. Recently, so-called Foundation Models have been introduced; general models trained on very…

Computer Vision and Pattern Recognition · Computer Science 2023-10-03 David Balaban , Justin Medich , Pranay Gosar , Justin Hart

Referring video object segmentation (RVOS) relies on natural language expressions to segment target objects in video, emphasizing modeling dense text-video relations. The current RVOS methods typically use independently pre-trained vision…

Computer Vision and Pattern Recognition · Computer Science 2024-06-10 Feiyu Pan , Hao Fang , Xiankai Lu

Separating 3D point clouds into individual instances is an important task for 3D vision. It is challenging due to the unknown and varying number of instances in a scene. Existing deep learning based works focus on a two-step pipeline: first…

Computer Vision and Pattern Recognition · Computer Science 2021-08-27 Ruihang Chu , Yukang Chen , Tao Kong , Lu Qi , Lei Li

Video instance segmentation (VIS) aims at segmenting and tracking objects in videos. Prior methods typically generate frame-level or clip-level object instances first and then associate them by either additional tracking heads or complex…

Computer Vision and Pattern Recognition · Computer Science 2023-01-06 Fei He , Haoyang Zhang , Naiyu Gao , Jian Jia , Yanhu Shan , Xin Zhao , Kaiqi Huang

The recent transformer-based models have dominated the Referring Video Object Segmentation (RVOS) task due to the superior performance. Most prior works adopt unified DETR framework to generate segmentation masks in query-to-instance…

Computer Vision and Pattern Recognition · Computer Science 2024-01-02 Zhuoyan Luo , Yicheng Xiao , Yong Liu , Yitong Wang , Yansong Tang , Xiu Li , Yujiu Yang

Instance segmentation aims to detect and segment individual objects in a scene. Most existing methods rely on precise mask annotations of every category. However, it is difficult and costly to segment objects in novel categories because a…

Computer Vision and Pattern Recognition · Computer Science 2020-05-12 Weicheng Kuo , Anelia Angelova , Jitendra Malik , Tsung-Yi Lin

We present the 2017 DAVIS Challenge on Video Object Segmentation, a public dataset, benchmark, and competition specifically designed for the task of video object segmentation. Following the footsteps of other successful initiatives, such as…

Computer Vision and Pattern Recognition · Computer Science 2018-03-02 Jordi Pont-Tuset , Federico Perazzi , Sergi Caelles , Pablo Arbeláez , Alex Sorkine-Hornung , Luc Van Gool

We tackle the task of semi-supervised video object segmentation, i.e. segmenting the pixels belonging to an object in the video using the ground truth pixel mask for the first frame. We build on the recently introduced one-shot video object…

Computer Vision and Pattern Recognition · Computer Science 2017-08-02 Paul Voigtlaender , Bastian Leibe

We propose a novel guided interactive segmentation (GIS) algorithm for video objects to improve the segmentation accuracy and reduce the interaction time. First, we design the reliability-based attention module to analyze the reliability of…

Computer Vision and Pattern Recognition · Computer Science 2021-04-22 Yuk Heo , Yeong Jun Koh , Chang-Su Kim

We address the problem of segmenting an object given a natural language expression that describes it. Current techniques tackle this task by either (\textit{i}) directly or recursively merging linguistic and visual information in the…

Computer Vision and Pattern Recognition · Computer Science 2018-07-24 Edgar Margffoy-Tuay , Juan C. Pérez , Emilio Botero , Pablo Arbeláez