English
Related papers

Related papers: Temporally Consistent Referring Video Object Segme…

200 papers

Video object segmentation (VOS) describes the task of segmenting a set of objects in each frame of a video. In the semi-supervised setting, the first mask of each object is provided at test time. Following the one-shot principle,…

Computer Vision and Pattern Recognition · Computer Science 2020-12-04 Tim Meinhardt , Laura Leal-Taixe

The recent works on Video Object Segmentation achieved remarkable results by matching dense semantic and instance-level features between the current and previous frames for long-time propagation. Nevertheless, global feature matching…

Computer Vision and Pattern Recognition · Computer Science 2024-05-15 Volodymyr Fedynyak , Yaroslav Romanus , Bohdan Hlovatskyi , Bohdan Sydor , Oles Dobosevych , Igor Babin , Roman Riazantsev

Remote sensing video referring object segmentation (RS-RVOS) is challenged by weak target saliency and severe visual information truncation in dynamic scenes, making it extremely difficult to maintain discriminative target representations…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 H. Jiang , Y. Sun , Z. Dong , T. Liu , Y. Gu

Current prevailing Video Object Segmentation methods follow the pipeline of extraction-then-matching, which first extracts features on current and reference frames independently, and then performs dense matching between them. This decoupled…

Computer Vision and Pattern Recognition · Computer Science 2025-05-01 Jiaming Zhang , Yutao Cui , Gangshan Wu , Limin Wang

Referring video object segmentation aims to segment objects within a video corresponding to a given text description. Existing transformer-based temporal modeling approaches face challenges related to query inconsistency and the limited…

Computer Vision and Pattern Recognition · Computer Science 2025-01-16 Sun-Hyuk Choi , Hayoung Jo , Seong-Whan Lee

Referring Video Object Segmentation (RVOS) aims to segment an object of interest throughout a video based on a language description. The prominent challenge lies in aligning static text with dynamic visual content, particularly when objects…

Computer Vision and Pattern Recognition · Computer Science 2025-09-09 Bingrui Zhao , Lin Yuanbo Wu , Xiangtian Fan , Deyin Liu , Lu Zhang , Ruyi He , Jialie Shen , Ximing Li

Contemporary Video Object Segmentation (VOS) approaches typically consist stages of feature extraction, matching, memory management, and multiple objects aggregation. Recent advanced models either employ a discrete modeling for these…

Computer Vision and Pattern Recognition · Computer Science 2024-03-14 Wanyun Li , Pinxue Guo , Xinyu Zhou , Lingyi Hong , Yangji He , Xiangyu Zheng , Wei Zhang , Wenqiang Zhang

Exploring dense matching between the current frame and past frames for long-range context modeling, memory-based methods have demonstrated impressive results in video object segmentation (VOS) recently. Nevertheless, due to the lack of…

Computer Vision and Pattern Recognition · Computer Science 2022-12-14 Junke Wang , Dongdong Chen , Zuxuan Wu , Chong Luo , Chuanxin Tang , Xiyang Dai , Yucheng Zhao , Yujia Xie , Lu Yuan , Yu-Gang Jiang

Semi-supervised video object segmentation (VOS) aims to segment arbitrary target objects in video when the ground truth segmentation mask of the initial frame is provided. Due to this limitation of using prior knowledge about the target…

Computer Vision and Pattern Recognition · Computer Science 2020-09-21 Suhwan Cho , Heansung Lee , Sungmin Woo , Sungjun Jang , Sangyoun Lee

We introduce a novel framework called RefineVIS for Video Instance Segmentation (VIS) that achieves good object association between frames and accurate segmentation masks by iteratively refining the representations using sequence context.…

Computer Vision and Pattern Recognition · Computer Science 2023-06-09 Andre Abrantes , Jiang Wang , Peng Chu , Quanzeng You , Zicheng Liu

Referring Video Object Segmentation (RefVOS) seeks to segment target objects in videos guided by natural language descriptions, demanding both temporal reasoning and fine-grained visual comprehension. Existing sampling strategies for…

Computer Vision and Pattern Recognition · Computer Science 2025-10-13 Ming Dai , Sen Yang , Boqiang Duan , Wankou Yang , Jingdong Wang

Current state-of-the-art Video Object Segmentation (VOS) methods rely on dense per-object mask annotations both during training and testing. This requires time-consuming and costly video annotation mechanisms. We propose a novel Point-VOS…

Computer Vision and Pattern Recognition · Computer Science 2024-06-11 Idil Esen Zulfikar , Sabarinath Mahadevan , Paul Voigtlaender , Bastian Leibe

Segmenting objects in videos is a fundamental computer vision task. The current deep learning based paradigm offers a powerful, but data-hungry solution. However, current datasets are limited by the cost and human effort of annotating…

Computer Vision and Pattern Recognition · Computer Science 2021-01-07 Bin Zhao , Goutam Bhat , Martin Danelljan , Luc Van Gool , Radu Timofte

Weakly supervised instance segmentation reduces the cost of annotations required to train models. However, existing approaches which rely only on image-level class labels predominantly suffer from errors due to (a) partial segmentation of…

Computer Vision and Pattern Recognition · Computer Science 2021-03-25 Qing Liu , Vignesh Ramanathan , Dhruv Mahajan , Alan Yuille , Zhenheng Yang

Video Object Segmentation (VOS) is an active research area of the visual domain. One of its fundamental sub-tasks is semi-supervised / one-shot learning: given only the segmentation mask for the first frame, the task is to provide…

Computer Vision and Pattern Recognition · Computer Science 2020-04-28 Fatemeh Azimi , Benjamin Bischke , Sebastian Palacio , Federico Raue , Joern Hees , Andreas Dengel

Contemporary Video Instance Segmentation (VIS) methods typically adhere to a pre-train then fine-tune regime, where a segmentation model trained on images is fine-tuned on videos. However, the lack of temporal knowledge in the pre-trained…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Qing Zhong , Peng-Tao Jiang , Wen Wang , Guodong Ding , Lin Wu , Kaiqi Huang

Referring video object segmentation (RVOS) has recently generated great popularity in computer vision due to its widespread applications. Existing RVOS setting contains elaborately trimmed videos, with text-referred objects always appearing…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Mingqi Gao , Jinyu Yang , Jingnan Luo , Xiantong Zhen , Jungong Han , Giovanni Montana , Feng Zheng

Video Object Segmentation (VOS) is one of the most fundamental and challenging tasks in computer vision and has a wide range of applications. Most existing methods rely on spatiotemporal memory networks to extract frame-level features and…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Mengjiao Wang , Junpei Zhang , Xu Liu , Yuting Yang , Mengru Ma

Referring Video Object Segmentation (RVOS) aims to segment target objects throughout a video based on a text description. This task has attracted increasing attention in the field of computer vision due to its promising applications in…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Tianming Liang , Haichao Jiang , Wei-Shi Zheng , Jian-Fang Hu

Video Reasoning Segmentation (VRS) aims to segment target objects in videos based on implicit instructions that convey human intent and temporal logic. Existing MLLM-based methods predict masks with a [SEG] token after selecting frames via…

Computer Vision and Pattern Recognition · Computer Science 2026-05-11 Junwei Wen , Deshui Miao , Guangming Lu , Xin Li , Wenjie Pei