English
Related papers

Related papers: Sketch-based Video Object Segmentation: Benchmark …

200 papers

Video object segmentation is a fundamental research problem in computer vision. Recent techniques have often applied attention mechanism to object representation learning from video sequences. However, due to temporal changes in the video…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Quang-Trung Truong , Duc Thanh Nguyen , Binh-Son Hua , Sai-Kit Yeung

Instance segmentation aims to detect and segment individual objects in a scene. Most existing methods rely on precise mask annotations of every category. However, it is difficult and costly to segment objects in novel categories because a…

Computer Vision and Pattern Recognition · Computer Science 2020-05-12 Weicheng Kuo , Anelia Angelova , Jitendra Malik , Tsung-Yi Lin

Video object segmentation (VOS) aims at segmenting a particular object throughout the entire video clip sequence. The state-of-the-art VOS methods have achieved excellent performance (e.g., 90+% J&F) on existing datasets. However, since the…

Computer Vision and Pattern Recognition · Computer Science 2023-10-24 Henghui Ding , Chang Liu , Shuting He , Xudong Jiang , Philip H. S. Torr , Song Bai

Semi-supervised video object segmentation has made significant progress on real and challenging videos in recent years. The current paradigm for segmentation methods and benchmark datasets is to segment objects in video provided a single…

Computer Vision and Pattern Recognition · Computer Science 2020-11-25 Brent A. Griffin , Jason J. Corso

Referring Video Object Segmentation (RVOS) requires segmenting specific objects in a video guided by a natural language description. The core challenge of RVOS is to anchor abstract linguistic concepts onto a specific set of pixels and…

Computer Vision and Pattern Recognition · Computer Science 2026-02-27 Zanyi Wang , Dengyang Jiang , Liuzhuozheng Li , Sizhe Dang , Chengzu Li , Harry Yang , Guang Dai , Mengmeng Wang , Jingdong Wang

Referring video object segmentation aims to segment and track a target object in a video using a natural language prompt. Existing methods typically fuse visual and textual features in a highly entangled manner, processing multi-modal…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Suhwan Cho , Seunghoon Lee , Minhyeok Lee , Jungho Lee , Sangyoun Lee

Referring video object segmentation (RVOS) aims to segment target objects throughout a video based on a text description. This is challenging as it involves deep vision-language understanding, pixel-level dense prediction and spatiotemporal…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Tianming Liang , Kun-Yu Lin , Chaolei Tan , Jianguo Zhang , Wei-Shi Zheng , Jian-Fang Hu

We propose a new method for video object segmentation (VOS) that addresses object pattern learning from unlabeled videos, unlike most existing methods which rely heavily on extensive annotated data. We introduce a unified…

Computer Vision and Pattern Recognition · Computer Science 2020-03-12 Xiankai Lu , Wenguan Wang , Jianbing Shen , Yu-Wing Tai , David Crandall , Steven C. H. Hoi

Referring image segmentation aims to segment the objects referred by a natural language expression. Previous methods usually focus on designing an implicit and recurrent feature interaction mechanism to fuse the visual-linguistic features…

Computer Vision and Pattern Recognition · Computer Science 2021-03-31 Ya Jing , Tao Kong , Wei Wang , Liang Wang , Lei Li , Tieniu Tan

As the most fundamental scene understanding tasks, object detection and segmentation have made tremendous progress in deep learning era. Due to the expensive manual labeling cost, the annotated categories in existing datasets are often…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Chaoyang Zhu , Long Chen

We propose a simple, yet powerful approach for unsupervised object segmentation in videos. We introduce an objective function whose minimum represents the mask of the main salient object over the input sequence. It only relies on…

Computer Vision and Pattern Recognition · Computer Science 2022-10-20 Georgy Ponimatkin , Nermin Samet , Yang Xiao , Yuming Du , Renaud Marlet , Vincent Lepetit

Video object segmentation, aiming to segment the foreground objects given the annotation of the first frame, has been attracting increasing attentions. Many state-of-the-art approaches have achieved great performance by relying on online…

Computer Vision and Pattern Recognition · Computer Science 2021-07-12 Siyue Yu , Jimin Xiao , BingFeng Zhang , Eng Gee Lim

Personal robots and driverless cars need to be able to operate in novel environments and thus quickly and efficiently learn to recognise new object classes. We address this problem by considering the task of video object segmentation.…

Computer Vision and Pattern Recognition · Computer Science 2020-08-18 Harkirat Singh Behl , Mohammad Najafi , Anurag Arnab , Philip H. S. Torr

It is expensive and labour-extensive to label the pixel-wise object masks in a video. As a result, the amount of pixel-wise annotations in existing video instance segmentation (VIS) datasets is small, limiting the generalization capability…

Computer Vision and Pattern Recognition · Computer Science 2023-07-13 Minghan Li , Lei Zhang

Image segmentation from referring expressions is a joint vision and language modeling task, where the input is an image and a textual expression describing a particular region in the image; and the goal is to localize and segment the…

Computer Vision and Pattern Recognition · Computer Science 2016-08-31 Ronghang Hu , Marcus Rohrbach , Subhashini Venugopalan , Trevor Darrell

Despite significant efforts, cutting-edge video segmentation methods still remain sensitive to occlusion and rapid movement, due to their reliance on the appearance of objects in the form of object embeddings, which are vulnerable to these…

Computer Vision and Pattern Recognition · Computer Science 2023-03-31 Qihao Liu , Junfeng Wu , Yi Jiang , Xiang Bai , Alan Yuille , Song Bai

This paper addresses the task of segmenting class-agnostic objects in semi-supervised setting. Although previous detection based methods achieve relatively good performance, these approaches extract the best proposal by a greedy strategy,…

Computer Vision and Pattern Recognition · Computer Science 2020-12-11 Daizong Liu , Shuangjie Xu , Xiao-Yang Liu , Zichuan Xu , Wei Wei , Pan Zhou

Self-supervised Object Segmentation (SOS) aims to segment objects without any annotations. Under conditions of multi-camera inputs, the structural, textural and geometrical consistency among each view can be leveraged to achieve…

Computer Vision and Pattern Recognition · Computer Science 2025-01-20 Xiaoyun Zheng , Liwei Liao , Jianbo Jiao , Feng Gao , Ronggang Wang

Given an object mask, Semi-supervised Video Object Segmentation (SVOS) technique aims to track and segment the object across video frames, serving as a fundamental task in computer vision. Although recent memory-based methods demonstrate…

Computer Vision and Pattern Recognition · Computer Science 2025-07-28 Guanyi Qin , Ziyue Wang , Daiyun Shen , Haofeng Liu , Hantao Zhou , Junde Wu , Runze Hu , Yueming Jin

We introduce the novel problem of localizing all the instances of an object (seen or unseen during training) in a natural image via sketch query. We refer to this problem as sketch-guided object localization. This problem is distinctively…

Computer Vision and Pattern Recognition · Computer Science 2020-08-18 Aditay Tripathi , Rajath R Dani , Anand Mishra , Anirban Chakraborty