English
Related papers

Related papers: Towards Robust Video Object Segmentation with Adap…

200 papers

Contemporary Video Object Segmentation (VOS) approaches typically consist stages of feature extraction, matching, memory management, and multiple objects aggregation. Recent advanced models either employ a discrete modeling for these…

Computer Vision and Pattern Recognition · Computer Science 2024-03-14 Wanyun Li , Pinxue Guo , Xinyu Zhou , Lingyi Hong , Yangji He , Xiangyu Zheng , Wei Zhang , Wenqiang Zhang

The objective of this paper is self-supervised learning of video object segmentation. We develop a unified framework which simultaneously models cross-frame dense correspondence for locally discriminative feature learning and embeds…

Computer Vision and Pattern Recognition · Computer Science 2023-03-20 Liulei Li , Wenguan Wang , Tianfei Zhou , Jianwu Li , Yi Yang

This work focuses on multi-shot semi-supervised video object segmentation (MVOS), which aims at segmenting the target object indicated by an initial mask throughout a video with multiple shots. The existing VOS methods mainly focus on…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Hengrui Hu , Kaining Ying , Henghui Ding

Video amodal segmentation is a particularly challenging task in computer vision, which requires to deduce the full shape of an object from the visible parts of it. Recently, some studies have achieved promising performance by using motion…

Computer Vision and Pattern Recognition · Computer Science 2023-09-26 Ke Fan , Jingshi Lei , Xuelin Qian , Miaopeng Yu , Tianjun Xiao , Tong He , Zheng Zhang , Yanwei Fu

Video object segmentation is a fundamental research problem in computer vision. Recent techniques have often applied attention mechanism to object representation learning from video sequences. However, due to temporal changes in the video…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Quang-Trung Truong , Duc Thanh Nguyen , Binh-Son Hua , Sai-Kit Yeung

Exploring dense matching between the current frame and past frames for long-range context modeling, memory-based methods have demonstrated impressive results in video object segmentation (VOS) recently. Nevertheless, due to the lack of…

Computer Vision and Pattern Recognition · Computer Science 2022-12-14 Junke Wang , Dongdong Chen , Zuxuan Wu , Chong Luo , Chuanxin Tang , Xiyang Dai , Yucheng Zhao , Yujia Xie , Lu Yuan , Yu-Gang Jiang

Referring Video Object Segmentation (RVOS) aims to segment specific objects in a video according to textual descriptions. We observe that recent RVOS approaches often place excessive emphasis on feature extraction and temporal modeling,…

Computer Vision and Pattern Recognition · Computer Science 2025-08-20 Ruixin Zhang , Jiaqing Fan , Yifan Liao , Qian Qiao , Fanzhang Li

Semi-supervised video object segmentation (semi-VOS) is widely used in many applications. This task is tracking class-agnostic objects from a given target mask. For doing this, various approaches have been developed based on…

Computer Vision and Pattern Recognition · Computer Science 2021-04-06 Hyojin Park , Ganesh Venkatesh , Nojun Kwak

This paper studies referring video object segmentation (RVOS) by boosting video-level visual-linguistic alignment. Recent approaches model the RVOS task as a sequence prediction problem and perform multi-modal interaction as well as…

Computer Vision and Pattern Recognition · Computer Science 2023-05-29 Zhuoyan Luo , Yicheng Xiao , Yong Liu , Shuyan Li , Yitong Wang , Yansong Tang , Xiu Li , Yujiu Yang

The referring video object segmentation task (RVOS) aims to segment object instances in a given video referred by a language expression in all video frames. Due to the requirement of understanding cross-modal semantics within individual…

Computer Vision and Pattern Recognition · Computer Science 2022-06-27 Leilei Cao , Zhuang Li , Bo Yan , Feng Zhang , Fengliang Qi , Yuchen Hu , Hongbin Wang

The aim of audio-visual segmentation (AVS) is to precisely differentiate audible objects within videos down to the pixel level. Traditional approaches often tackle this challenge by combining information from various modalities, where the…

Computer Vision and Pattern Recognition · Computer Science 2023-12-20 Dawei Hao , Yuxin Mao , Bowen He , Xiaodong Han , Yuchao Dai , Yiran Zhong

The recent transformer-based models have dominated the Referring Video Object Segmentation (RVOS) task due to the superior performance. Most prior works adopt unified DETR framework to generate segmentation masks in query-to-instance…

Computer Vision and Pattern Recognition · Computer Science 2024-01-02 Zhuoyan Luo , Yicheng Xiao , Yong Liu , Yitong Wang , Yansong Tang , Xiu Li , Yujiu Yang

Recent state-of-the-art semi-supervised Video Object Segmentation (VOS) methods have shown significant improvements in target object segmentation accuracy when information from preceding frames is used in segmenting the current frame. In…

Computer Vision and Pattern Recognition · Computer Science 2024-02-15 Amir Nazemi , Mohammad Javad Shafiee , Zahra Gharaee , Paul Fieguth

Reasoning video object segmentation predicts pixel-level masks in videos from natural-language queries that may involve implicit and temporally grounded references. However, existing methods are developed and evaluated in an offline regime,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Jinyuan Liu , Yang Wang , Zeyu Zhao , Weixin Li , Song Wang , Ruize Han

Referring Video Object Segmentation (RVOS) requires segmenting specific objects in a video guided by a natural language description. The core challenge of RVOS is to anchor abstract linguistic concepts onto a specific set of pixels and…

Computer Vision and Pattern Recognition · Computer Science 2026-02-27 Zanyi Wang , Dengyang Jiang , Liuzhuozheng Li , Sizhe Dang , Chengzu Li , Harry Yang , Guang Dai , Mengmeng Wang , Jingdong Wang

Contemporary state-of-the-art video object segmentation (VOS) models compare incoming unannotated images to a history of image-mask relations via affinity or cross-attention to predict object masks. We refer to the internal memory state of…

Computer Vision and Pattern Recognition · Computer Science 2024-10-31 Clayton Bromley , Alexander Moore , Amar Saini , Douglas Poland , Carmen Carrano

Storing intermediate frame segmentations as memory for long-range context modeling, spatial-temporal memory-based methods have recently showcased impressive results in semi-supervised video object segmentation (SVOS). However, these methods…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Hantao Zhou , Runze Hu , Xiu Li

The performance of promptable video object segmentation (PVOS) models substantially degrades under input corruptions, which prevents PVOS deployment in safety-critical domains. This paper offers the first comprehensive study on robust PVOS…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Sohyun Lee , Yeho Gwon , Lukas Hoyer , Konrad Schindler , Christos Sakaridis , Suha Kwak

The task of video object segmentation with referring expressions (language-guided VOS) is to, given a linguistic phrase and a video, generate binary masks for the object to which the phrase refers. Our work argues that existing benchmarks…

Computer Vision and Pattern Recognition · Computer Science 2020-10-02 Miriam Bellver , Carles Ventura , Carina Silberer , Ioannis Kazakos , Jordi Torres , Xavier Giro-i-Nieto

Video object segmentation has been applied to various computer vision tasks, such as video editing, autonomous driving, and human-robot interaction. However, the methods based on deep neural networks are vulnerable to adversarial examples,…

Computer Vision and Pattern Recognition · Computer Science 2023-12-14 Ping Li , Yu Zhang , Li Yuan , Jian Zhao , Xianghua Xu , Xiaoqin Zhang