English
Related papers

Related papers: RefVOS: A Closer Look at Referring Expressions for…

200 papers

The referring video object segmentation task (RVOS) aims to segment object instances in a given video referred by a language expression in all video frames. Due to the requirement of understanding cross-modal semantics within individual…

Computer Vision and Pattern Recognition · Computer Science 2022-06-27 Leilei Cao , Zhuang Li , Bo Yan , Feng Zhang , Fengliang Qi , Yuchen Hu , Hongbin Wang

Most state-of-the-art semi-supervised video object segmentation methods rely on a pixel-accurate mask of a target object provided for the first frame of a video. However, obtaining a detailed segmentation mask is expensive and…

Computer Vision and Pattern Recognition · Computer Science 2019-02-06 Anna Khoreva , Anna Rohrbach , Bernt Schiele

Referring video object segmentation (R-VOS) is an emerging cross-modal task that aims to segment the target object referred by a language expression in all video frames. In this work, we propose a simple and unified framework built upon…

Computer Vision and Pattern Recognition · Computer Science 2022-03-15 Jiannan Wu , Yi Jiang , Peize Sun , Zehuan Yuan , Ping Luo

Referring Video Object Segmentation (RVOS) requires segmenting specific objects in a video guided by a natural language description. The core challenge of RVOS is to anchor abstract linguistic concepts onto a specific set of pixels and…

Computer Vision and Pattern Recognition · Computer Science 2026-02-27 Zanyi Wang , Dengyang Jiang , Liuzhuozheng Li , Sizhe Dang , Chengzu Li , Harry Yang , Guang Dai , Mengmeng Wang , Jingdong Wang

Referring video object segmentation (RVOS) is a task that aims to segment the target object in all video frames based on a sentence describing the object. Although existing RVOS methods have achieved significant performance, they depend on…

Computer Vision and Pattern Recognition · Computer Science 2023-12-18 Wangbo Zhao , Kepan Nan , Songyang Zhang , Kai Chen , Dahua Lin , Yang You

Existing Video Object Segmentation (VOS) relies on explicit user instructions, such as categories, masks, or short phrases, restricting their ability to perform complex video segmentation requiring reasoning with world knowledge. In this…

Computer Vision and Pattern Recognition · Computer Science 2024-07-17 Cilin Yan , Haochen Wang , Shilin Yan , Xiaolong Jiang , Yao Hu , Guoliang Kang , Weidi Xie , Efstratios Gavves

Traditional reference segmentation tasks have predominantly focused on silent visual scenes, neglecting the integral role of multimodal perception and interaction in human experiences. In this work, we introduce a novel task called…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Yaoting Wang , Peiwen Sun , Dongzhan Zhou , Guangyao Li , Honggang Zhang , Di Hu

This paper strives for motion expressions guided video segmentation, which focuses on segmenting objects in video content based on a sentence describing the motion of the objects. Existing referring video object datasets typically focus on…

Computer Vision and Pattern Recognition · Computer Science 2023-08-17 Henghui Ding , Chang Liu , Shuting He , Xudong Jiang , Chen Change Loy

The task of referring video object segmentation aims to segment the object in the frames of a given video to which the referring expressions refer. Previous methods adopt multi-stage approach and design complex pipelines to obtain promising…

Computer Vision and Pattern Recognition · Computer Science 2023-01-02 Zhiwei Hu , Bo Chen , Yuan Gao , Zhilong Ji , Jinfeng Bai

Referring video object segmentation (RVOS) is an emerging cross-modality task that aims to generate pixel-level maps of the target objects referred by given textual expressions. The main concept involves learning an accurate alignment of…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Baoli Sun , Xinzhu Ma , Ning Wang , Zhihui Wang , Zhiyong Wang

This paper proposes a large-scale multi-modal dataset for referring motion expression video segmentation, focusing on segmenting and tracking target objects in videos based on language description of objects' motions. Existing referring…

Computer Vision and Pattern Recognition · Computer Science 2025-12-13 Henghui Ding , Chang Liu , Shuting He , Kaining Ying , Xudong Jiang , Chen Change Loy , Yu-Gang Jiang

Referring video object segmentation (RVOS) aims to segment objects in a video described by a natural language expression. However, most existing approaches focus on segmenting only the referred object (typically the actor), even when the…

Computer Vision and Pattern Recognition · Computer Science 2025-08-19 Woojeong Jin , Seongchan Kim , Jaeho Lee , Seungryong Kim

Referring video object segmentation (RVOS) aims to segment the target instance in a video, referred by a text expression. Conventional approaches are mostly supervised learning, requiring expensive pixel-level mask annotations. To tackle…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Miaojing Shi , Jun Huang , Zijie Yue , Hanli Wang

Referring Video Object Segmentation (RVOS) aims to segment the object referred to by the query sentence in the video. Most existing methods require end-to-end training with dense mask annotations, which could be computation-consuming and…

Computer Vision and Pattern Recognition · Computer Science 2025-10-09 Ci-Siang Lin , Min-Hung Chen , I-Jieh Liu , Chien-Yi Wang , Sifei Liu , Yu-Chiang Frank Wang

Referring Video Object Segmentation (R-VOS) is a challenging task that aims to segment an object in a video based on a linguistic expression. Most existing R-VOS methods have a critical assumption: the object referred to must appear in the…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Xiang Li , Jinglu Wang , Xiaohao Xu , Xiao Li , Bhiksha Raj , Yan Lu

Referring video object segmentation (RVOS) aims to segment objects in videos guided by natural language descriptions. We propose FS-RVOS, a Transformer-based model with two key components: a cross-modal affinity module and an instance…

Computer Vision and Pattern Recognition · Computer Science 2025-04-21 Heng Liu , Guanghui Li , Mingqi Gao , Xiantong Zhen , Feng Zheng , Yang Wang

Delving into the realm of egocentric vision, the advancement of referring video object segmentation (RVOS) stands as pivotal in understanding human activities. However, existing RVOS task primarily relies on static attributes such as object…

Computer Vision and Pattern Recognition · Computer Science 2024-07-11 Liangyang Ouyang , Ruicong Liu , Yifei Huang , Ryosuke Furuta , Yoichi Sato

Referring Video Object Segmentation (RVOS) aims to segment target objects throughout a video based on a text description. This task has attracted increasing attention in the field of computer vision due to its promising applications in…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Tianming Liang , Haichao Jiang , Wei-Shi Zheng , Jian-Fang Hu

Referring video object segmentation (RVOS) aims to identify, track and segment the objects in a video based on language descriptions, which has received great attention in recent years. However, existing datasets remain focus on short video…

Computer Vision and Pattern Recognition · Computer Science 2025-10-29 Tianming Liang , Haichao Jiang , Yuting Yang , Chaolei Tan , Shuai Li , Wei-Shi Zheng , Jian-Fang Hu

Motion Expression guided Video Segmentation is a challenging task that aims at segmenting objects in the video based on natural language expressions with motion descriptions. Unlike the previous referring video object segmentation (RVOS),…

Computer Vision and Pattern Recognition · Computer Science 2024-06-21 Bin Cao , Yisi Zhang , Xuanxu Lin , Xingjian He , Bo Zhao , Jing Liu
‹ Prev 1 2 3 10 Next ›