English
Related papers

Related papers: Boosting Video Object Segmentation via Space-time …

200 papers

Previous works on video object segmentation (VOS) are trained on densely annotated videos. Nevertheless, acquiring annotations in pixel level is expensive and time-consuming. In this work, we demonstrate the feasibility of training a…

Computer Vision and Pattern Recognition · Computer Science 2023-03-22 Kun Yan , Xiao Li , Fangyun Wei , Jinglu Wang , Chenbin Zhang , Ping Wang , Yan Lu

Open-vocabulary segmentation (OVS) extends the zero-shot recognition capabilities of vision-language models (VLMs) to pixel-level prediction, enabling segmentation of arbitrary categories specified by text prompts. Despite recent progress,…

Computer Vision and Pattern Recognition · Computer Science 2026-02-27 Tilemachos Aravanis , Vladan Stojnić , Bill Psomas , Nikos Komodakis , Giorgos Tolias

Video Object Segmentation (VOS) is one of the most fundamental and challenging tasks in computer vision and has a wide range of applications. Most existing methods rely on spatiotemporal memory networks to extract frame-level features and…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Mengjiao Wang , Junpei Zhang , Xu Liu , Yuting Yang , Mengru Ma

Learning long-term spatial-temporal features are critical for many video analysis tasks. However, existing video segmentation methods predominantly rely on static image segmentation techniques, and methods capturing temporal dependency for…

Computer Vision and Pattern Recognition · Computer Science 2018-09-05 Ning Xu , Linjie Yang , Yuchen Fan , Jianchao Yang , Dingcheng Yue , Yuchen Liang , Brian Price , Scott Cohen , Thomas Huang

Referring video object segmentation (RVOS) aims to segment video objects with the guidance of natural language reference. Previous methods typically tackle RVOS through directly grounding linguistic reference over the image lattice. Such…

Computer Vision and Pattern Recognition · Computer Science 2024-01-22 Chen Liang , Yu Wu , Tianfei Zhou , Wenguan Wang , Zongxin Yang , Yunchao Wei , Yi Yang

Most state-of-the-art semi-supervised video object segmentation methods rely on a pixel-accurate mask of a target object provided for the first frame of a video. However, obtaining a detailed segmentation mask is expensive and…

Computer Vision and Pattern Recognition · Computer Science 2019-02-06 Anna Khoreva , Anna Rohrbach , Bernt Schiele

Existing Video Object Segmentation (VOS) relies on explicit user instructions, such as categories, masks, or short phrases, restricting their ability to perform complex video segmentation requiring reasoning with world knowledge. In this…

Computer Vision and Pattern Recognition · Computer Science 2024-07-17 Cilin Yan , Haochen Wang , Shilin Yan , Xiaolong Jiang , Yao Hu , Guoliang Kang , Weidi Xie , Efstratios Gavves

We present a novel approach to unsupervised learning for video object segmentation (VOS). Unlike previous work, our formulation allows to learn dense feature representations directly in a fully convolutional regime. We rely on uniform grid…

Computer Vision and Pattern Recognition · Computer Science 2021-11-12 Nikita Araslanov , Simone Schaub-Meyer , Stefan Roth

The recent transformer-based models have dominated the Referring Video Object Segmentation (RVOS) task due to the superior performance. Most prior works adopt unified DETR framework to generate segmentation masks in query-to-instance…

Computer Vision and Pattern Recognition · Computer Science 2024-01-02 Zhuoyan Luo , Yicheng Xiao , Yong Liu , Yitong Wang , Yansong Tang , Xiu Li , Yujiu Yang

The task of video object segmentation with referring expressions (language-guided VOS) is to, given a linguistic phrase and a video, generate binary masks for the object to which the phrase refers. Our work argues that existing benchmarks…

Computer Vision and Pattern Recognition · Computer Science 2020-10-02 Miriam Bellver , Carles Ventura , Carina Silberer , Ioannis Kazakos , Jordi Torres , Xavier Giro-i-Nieto

The objective of this paper is self-supervised representation learning, with the goal of solving semi-supervised video object segmentation (a.k.a. dense tracking). We make the following contributions: (i) we propose to improve the existing…

Computer Vision and Pattern Recognition · Computer Science 2020-06-23 Fangrui Zhu , Li Zhang , Yanwei Fu , Guodong Guo , Weidi Xie

Recent state-of-the-art semi-supervised Video Object Segmentation (VOS) methods have shown significant improvements in target object segmentation accuracy when information from preceding frames is used in segmenting the current frame. In…

Computer Vision and Pattern Recognition · Computer Science 2024-02-15 Amir Nazemi , Mohammad Javad Shafiee , Zahra Gharaee , Paul Fieguth

Reasoning Video Object Segmentation (ReasonVOS) is a challenging task that requires stable object segmentation across video sequences using implicit and complex textual inputs. Previous methods fine-tune Multimodal Large Language Models…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Zhengtong Zhu , Jiaqing Fan , Zhixuan Liu , Fanzhang Li

Video Object Segmentation (VOS) is foundational to numerous computer vision applications, including surveillance, autonomous driving, robotics and generative video editing. However, existing VOS models often struggle with precise mask…

Computer Vision and Pattern Recognition · Computer Science 2025-07-28 Elham Soltani Kazemi , Imad Eddine Toubal , Gani Rahmon , Jaired Collins , K. Palaniappan

Learning a good representation for space-time correspondence is the key for various computer vision tasks, including tracking object bounding boxes and performing video object pixel segmentation. To learn generalizable representation for…

Computer Vision and Pattern Recognition · Computer Science 2021-10-15 Jiarui Xu , Xiaolong Wang

Referring Video Object Segmentation (RVOS) requires segmenting specific objects in a video guided by a natural language description. The core challenge of RVOS is to anchor abstract linguistic concepts onto a specific set of pixels and…

Computer Vision and Pattern Recognition · Computer Science 2026-02-27 Zanyi Wang , Dengyang Jiang , Liuzhuozheng Li , Sizhe Dang , Chengzu Li , Harry Yang , Guang Dai , Mengmeng Wang , Jingdong Wang

In this paper, we consider the problem of open-vocabulary semantic segmentation (OVS), which aims to segment objects of arbitrary classes instead of pre-defined, closed-set categories. The main contributions are as follows: First, we…

Computer Vision and Pattern Recognition · Computer Science 2023-03-06 Jilan Xu , Junlin Hou , Yuejie Zhang , Rui Feng , Yi Wang , Yu Qiao , Weidi Xie

Video object segmentation aims at accurately segmenting the target object regions across consecutive frames. It is technically challenging for coping with complicated factors (e.g., shape deformations, occlusion and out of the lens). Recent…

Computer Vision and Pattern Recognition · Computer Science 2019-07-03 Peng Sun , Peiwen Lin , Guangliang Cheng , Jianping Shi , Jiawan Zhang , Xi Li

Semi-supervised video object segmentation (semi-VOS) is widely used in many applications. This task is tracking class-agnostic objects from a given target mask. For doing this, various approaches have been developed based on…

Computer Vision and Pattern Recognition · Computer Science 2021-04-06 Hyojin Park , Ganesh Venkatesh , Nojun Kwak

We present an approach to semi-supervised video object segmentation, in the context of the DAVIS 2017 challenge. Our approach combines category-based object detection, category-independent object appearance segmentation and temporal object…

Computer Vision and Pattern Recognition · Computer Science 2017-07-21 Gilad Sharir , Eddie Smolyansky , Itamar Friedman