English
Related papers

Related papers: Unleashing Hierarchical Reasoning: An LLM-Driven F…

200 papers

The Segment Anything Model (SAM) has gained significant attention for its impressive performance in image segmentation. However, it lacks proficiency in referring video object segmentation (RVOS) due to the need for precise user-interactive…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Yonglin Li , Jing Zhang , Xiao Teng , Long Lan , Xinwang Liu

Referring Video Object Segmentation (RVOS) aims to segment and track objects in videos based on natural language expressions, requiring precise alignment between visual content and textual queries. However, existing methods often suffer…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Seunghun Lee , Jiwan Seo , Jeonghoon Kim , Sungho Moon , Siwon Kim , Haeun Yun , Hyogyeong Jeon , Wonhyeok Choi , Jaehoon Jeong , Zane Durante , Sang Hyun Park , Sunghoon Im

Referring video object segmentation (RVOS) has recently generated great popularity in computer vision due to its widespread applications. Existing RVOS setting contains elaborately trimmed videos, with text-referred objects always appearing…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Mingqi Gao , Jinyu Yang , Jingnan Luo , Xiantong Zhen , Jungong Han , Giovanni Montana , Feng Zheng

Referring video object segmentation (RVOS) aims to segment the target instance in a video, referred by a text expression. Conventional approaches are mostly supervised learning, requiring expensive pixel-level mask annotations. To tackle…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Miaojing Shi , Jun Huang , Zijie Yue , Hanli Wang

The task of video object segmentation with referring expressions (language-guided VOS) is to, given a linguistic phrase and a video, generate binary masks for the object to which the phrase refers. Our work argues that existing benchmarks…

Computer Vision and Pattern Recognition · Computer Science 2020-10-02 Miriam Bellver , Carles Ventura , Carina Silberer , Ioannis Kazakos , Jordi Torres , Xavier Giro-i-Nieto

Referring Video Object Segmentation (RVOS) aims to segment out the object in a video referred by an expression. Current RVOS methods view referring expressions as unstructured sequences, neglecting their crucial semantic structure essential…

Computer Vision and Pattern Recognition · Computer Science 2025-08-15 Huihui Xu , Jiashi Lin , Haoyu Chen , Junjun He , Lei Zhu

Referring video object segmentation (R-VOS) is an emerging cross-modal task that aims to segment the target object referred by a language expression in all video frames. In this work, we propose a simple and unified framework built upon…

Computer Vision and Pattern Recognition · Computer Science 2022-03-15 Jiannan Wu , Yi Jiang , Peize Sun , Zehuan Yuan , Ping Luo

Motion expression video segmentation is designed to segment objects in accordance with the input motion expressions. In contrast to the conventional Referring Video Object Segmentation (RVOS), it places emphasis on motion as well as…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Hao Fang , Runmin Cong , Xiankai Lu , Zhiyang Chen , Wei Zhang

The task of referring video object segmentation aims to segment the object in the frames of a given video to which the referring expressions refer. Previous methods adopt multi-stage approach and design complex pipelines to obtain promising…

Computer Vision and Pattern Recognition · Computer Science 2023-01-02 Zhiwei Hu , Bo Chen , Yuan Gao , Zhilong Ji , Jinfeng Bai

Referring Video Object Segmentation (RVOS) aims to segment the object referred to by the query sentence in the video. Most existing methods require end-to-end training with dense mask annotations, which could be computation-consuming and…

Computer Vision and Pattern Recognition · Computer Science 2025-10-09 Ci-Siang Lin , Min-Hung Chen , I-Jieh Liu , Chien-Yi Wang , Sifei Liu , Yu-Chiang Frank Wang

Referring video object segmentation (RVOS) aims to segment objects in videos guided by natural language descriptions. We propose FS-RVOS, a Transformer-based model with two key components: a cross-modal affinity module and an instance…

Computer Vision and Pattern Recognition · Computer Science 2025-04-21 Heng Liu , Guanghui Li , Mingqi Gao , Xiantong Zhen , Feng Zheng , Yang Wang

Referring video object segmentation (RVOS) aims to segment objects in a video described by a natural language expression. However, most existing approaches focus on segmenting only the referred object (typically the actor), even when the…

Computer Vision and Pattern Recognition · Computer Science 2025-08-19 Woojeong Jin , Seongchan Kim , Jaeho Lee , Seungryong Kim

Referring video object segmentation (RVOS) is a challenging task that requires the model to segment the object in a video given the language description. MeViS is a recently proposed dataset that contains motion expressions of the target…

Computer Vision and Pattern Recognition · Computer Science 2025-04-02 Haobo Yuan , Tao Zhang , Xiangtai Li , Lu Qi , Zilong Huang , Shilin Xu , Jiashi Feng , Ming-Hsuan Yang

Referring video object segmentation (RVOS) aims to segment the target instance referred by a given text expression in a video clip. The text expression normally contains sophisticated description of the instance's appearance, action, and…

Computer Vision and Pattern Recognition · Computer Science 2024-04-03 Linfeng Yuan , Miaojing Shi , Zijie Yue , Qijun Chen

The recent transformer-based models have dominated the Referring Video Object Segmentation (RVOS) task due to the superior performance. Most prior works adopt unified DETR framework to generate segmentation masks in query-to-instance…

Computer Vision and Pattern Recognition · Computer Science 2024-01-02 Zhuoyan Luo , Yicheng Xiao , Yong Liu , Yitong Wang , Yansong Tang , Xiu Li , Yujiu Yang

Recent studies have demonstrated the effectiveness of Large Language Models (LLMs) as reasoning modules that can deconstruct complex tasks into more manageable sub-tasks, particularly when applied to visual reasoning tasks for images. In…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Ahmad Mahmood , Ashmal Vayani , Muzammal Naseer , Salman Khan , Fahad Shahbaz Khan

Referring video object segmentation (RVOS) aims to segment target objects throughout a video based on a text description. This is challenging as it involves deep vision-language understanding, pixel-level dense prediction and spatiotemporal…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Tianming Liang , Kun-Yu Lin , Chaolei Tan , Jianguo Zhang , Wei-Shi Zheng , Jian-Fang Hu

Referring Video Segmentation (RVOS) aims to segment objects in videos given linguistic expressions. The key to solving RVOS is to extract long-range temporal context information from the interactions of expressions and videos to depict the…

Computer Vision and Pattern Recognition · Computer Science 2025-10-10 Cilin Yan , Jingyun Wang , Guoliang Kang

Referring Video Object Segmentation (RVOS) aims to segment target objects in video sequences based on natural language descriptions. While recent advances in Multi-modal Large Language Models (MLLMs) have improved RVOS performance through…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Li Zhang , Haoxiang Gao , Zhihao Zhang , Luoxiao Huang , Tao Zhang

Multiple object video object segmentation is a challenging task, specially for the zero-shot case, when no object mask is given at the initial frame and the model has to find the objects to be segmented along the sequence. In our work, we…

Computer Vision and Pattern Recognition · Computer Science 2019-05-22 Carles Ventura , Miriam Bellver , Andreu Girbau , Amaia Salvador , Ferran Marques , Xavier Giro-i-Nieto