English
Related papers

Related papers: 4th PVUW MeViS 3rd Place Report: Sa2VA

200 papers

Referring Video Object Segmentation (RVOS) aims to segment and track objects in videos based on natural language expressions, requiring precise alignment between visual content and textual queries. However, existing methods often suffer…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Seunghun Lee , Jiwan Seo , Jeonghoon Kim , Sungho Moon , Siwon Kim , Haeun Yun , Hyogyeong Jeon , Wonhyeok Choi , Jaehoon Jeong , Zane Durante , Sang Hyun Park , Sunghoon Im

Referring video object segmentation (RVOS) has recently generated great popularity in computer vision due to its widespread applications. Existing RVOS setting contains elaborately trimmed videos, with text-referred objects always appearing…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Mingqi Gao , Jinyu Yang , Jingnan Luo , Xiantong Zhen , Jungong Han , Giovanni Montana , Feng Zheng

Referring Video Object Segmentation (RVOS) aims to segment target objects in video sequences based on natural language descriptions. While recent advances in Multi-modal Large Language Models (MLLMs) have improved RVOS performance through…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Li Zhang , Haoxiang Gao , Zhihao Zhang , Luoxiao Huang , Tao Zhang

Referring Video Object Segmentation (RVOS) aims to segment an object of interest throughout a video based on a language description. The prominent challenge lies in aligning static text with dynamic visual content, particularly when objects…

Computer Vision and Pattern Recognition · Computer Science 2025-09-09 Bingrui Zhao , Lin Yuanbo Wu , Xiangtian Fan , Deyin Liu , Lu Zhang , Ruyi He , Jialie Shen , Ximing Li

The recent transformer-based models have dominated the Referring Video Object Segmentation (RVOS) task due to the superior performance. Most prior works adopt unified DETR framework to generate segmentation masks in query-to-instance…

Computer Vision and Pattern Recognition · Computer Science 2024-01-02 Zhuoyan Luo , Yicheng Xiao , Yong Liu , Yitong Wang , Yansong Tang , Xiu Li , Yujiu Yang

Referring video object segmentation (RVOS) requires tracking and segmenting an object throughout a video according to a given natural language expression, demanding both complex motion understanding and the alignment of visual…

Computer Vision and Pattern Recognition · Computer Science 2025-03-27 Seongchan Kim , Woojeong Jin , Sangbeom Lim , Heeji Yoon , Hyunwook Choi , Seungryong Kim

This report presents an Audio-aware Referring Video Object Segmentation (Ref-VOS) pipeline tailored to the MEVIS\_Audio setting, where the referring expression is provided in spoken form rather than as clean text. Compared with a standard…

Sound · Computer Science 2026-04-22 Deshui Miao , Yameng Gu , Chao Yang , Xin Li , Haijun Zhang , Ming-Hsuan Yang

Referring video object segmentation (RVOS) aims to segment the target instance in a video, referred by a text expression. Conventional approaches are mostly supervised learning, requiring expensive pixel-level mask annotations. To tackle…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Miaojing Shi , Jun Huang , Zijie Yue , Hanli Wang

Referring video object segmentation (RVOS) is an emerging cross-modality task that aims to generate pixel-level maps of the target objects referred by given textual expressions. The main concept involves learning an accurate alignment of…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Baoli Sun , Xinzhu Ma , Ning Wang , Zhihui Wang , Zhiyong Wang

Referring Video Object Segmentation is an emerging multi-modal task that aims to segment objects in the video given a natural language expression. In this work, we build two instance-centric models and fuse predicted results from…

Computer Vision and Pattern Recognition · Computer Science 2024-08-21 Bin Cao , Yisi Zhang , Hanyi Wang , Xingjian He , Jing Liu

The task of video object segmentation with referring expressions (language-guided VOS) is to, given a linguistic phrase and a video, generate binary masks for the object to which the phrase refers. Our work argues that existing benchmarks…

Computer Vision and Pattern Recognition · Computer Science 2020-10-02 Miriam Bellver , Carles Ventura , Carina Silberer , Ioannis Kazakos , Jordi Torres , Xavier Giro-i-Nieto

Despite the promising performance of current video segmentation models on existing benchmarks, these models still struggle with complex scenes. In this paper, we introduce the 6th Large-scale Video Object Segmentation (LSVOS) challenge in…

This report presents an overview of the 7th Large-scale Video Object Segmentation (LSVOS) Challenge held in conjunction with ICCV 2025. Besides the two traditional tracks of LSVOS that jointly target robustness in realistic video scenarios:…

The recent works on Video Object Segmentation achieved remarkable results by matching dense semantic and instance-level features between the current and previous frames for long-time propagation. Nevertheless, global feature matching…

Computer Vision and Pattern Recognition · Computer Science 2024-05-15 Volodymyr Fedynyak , Yaroslav Romanus , Bohdan Hlovatskyi , Bohdan Sydor , Oles Dobosevych , Igor Babin , Roman Riazantsev

The task of referring video object segmentation aims to segment the object in the frames of a given video to which the referring expressions refer. Previous methods adopt multi-stage approach and design complex pipelines to obtain promising…

Computer Vision and Pattern Recognition · Computer Science 2023-01-02 Zhiwei Hu , Bo Chen , Yuan Gao , Zhilong Ji , Jinfeng Bai

Referring video object segmentation (RVOS) aims to segment objects in videos guided by natural language descriptions. We propose FS-RVOS, a Transformer-based model with two key components: a cross-modal affinity module and an instance…

Computer Vision and Pattern Recognition · Computer Science 2025-04-21 Heng Liu , Guanghui Li , Mingqi Gao , Xiantong Zhen , Feng Zheng , Yang Wang

Large-scale Video Object Segmentation (LSVOS) addresses the challenge of accurately tracking and segmenting objects in long video sequences, where difficulties stem from object reappearance, small-scale targets, heavy occlusions, and…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Yujie Xie , Hongyang Zhang , Zhihui Liu , Shihai Ruan

This paper proposes a novel framework utilizing multi-modal large language models (MLLMs) for referring video object segmentation (RefVOS). Previous MLLM-based methods commonly struggle with the dilemma between "Ref" and "VOS": they either…

Computer Vision and Pattern Recognition · Computer Science 2025-04-11 Lang Lin , Xueyang Yu , Ziqi Pang , Yu-Xiong Wang

Referring Video Segmentation (RVOS) aims to segment objects in videos given linguistic expressions. The key to solving RVOS is to extract long-range temporal context information from the interactions of expressions and videos to depict the…

Computer Vision and Pattern Recognition · Computer Science 2025-10-10 Cilin Yan , Jingyun Wang , Guoliang Kang

Referring video object segmentation (RVOS) is a task that aims to segment the target object in all video frames based on a sentence describing the object. Although existing RVOS methods have achieved significant performance, they depend on…

Computer Vision and Pattern Recognition · Computer Science 2023-12-18 Wangbo Zhao , Kepan Nan , Songyang Zhang , Kai Chen , Dahua Lin , Yang You