English
Related papers

Related papers: Few-Shot Referring Video Single- and Multi-Object …

200 papers

Referring video object segmentation (RVOS) requires tracking and segmenting an object throughout a video according to a given natural language expression, demanding both complex motion understanding and the alignment of visual…

Computer Vision and Pattern Recognition · Computer Science 2025-03-27 Seongchan Kim , Woojeong Jin , Sangbeom Lim , Heeji Yoon , Hyunwook Choi , Seungryong Kim

The reference-based object segmentation tasks, namely referring image segmentation (RIS), few-shot image segmentation (FSS), referring video object segmentation (RVOS), and video object segmentation (VOS), aim to segment a specific object…

Computer Vision and Pattern Recognition · Computer Science 2023-12-27 Jiannan Wu , Yi Jiang , Bin Yan , Huchuan Lu , Zehuan Yuan , Ping Luo

Referring video object segmentation (RVOS) aims to segment target objects throughout a video based on a text description. This is challenging as it involves deep vision-language understanding, pixel-level dense prediction and spatiotemporal…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Tianming Liang , Kun-Yu Lin , Chaolei Tan , Jianguo Zhang , Wei-Shi Zheng , Jian-Fang Hu

Current semi-supervised video object segmentation (VOS) methods usually leverage the entire features of one frame to predict object masks and update memory. This introduces significant redundant computations. To reduce redundancy, we…

Computer Vision and Pattern Recognition · Computer Science 2022-07-22 Bo Miao , Mohammed Bennamoun , Yongsheng Gao , Ajmal Mian

Referring Video Object Segmentation (RVOS) aims to segment target objects in video sequences based on natural language descriptions. While recent advances in Multi-modal Large Language Models (MLLMs) have improved RVOS performance through…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Li Zhang , Haoxiang Gao , Zhihao Zhang , Luoxiao Huang , Tao Zhang

Referring video object segmentation (RVOS) has recently generated great popularity in computer vision due to its widespread applications. Existing RVOS setting contains elaborately trimmed videos, with text-referred objects always appearing…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Mingqi Gao , Jinyu Yang , Jingnan Luo , Xiantong Zhen , Jungong Han , Giovanni Montana , Feng Zheng

Referring Video Object Segmentation (RVOS) aims to segment target objects throughout a video based on a text description. This task has attracted increasing attention in the field of computer vision due to its promising applications in…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Tianming Liang , Haichao Jiang , Wei-Shi Zheng , Jian-Fang Hu

Referring video object segmentation (RVOS) aims to segment the target instance referred by a given text expression in a video clip. The text expression normally contains sophisticated description of the instance's appearance, action, and…

Computer Vision and Pattern Recognition · Computer Science 2024-04-03 Linfeng Yuan , Miaojing Shi , Zijie Yue , Qijun Chen

The recent transformer-based models have dominated the Referring Video Object Segmentation (RVOS) task due to the superior performance. Most prior works adopt unified DETR framework to generate segmentation masks in query-to-instance…

Computer Vision and Pattern Recognition · Computer Science 2024-01-02 Zhuoyan Luo , Yicheng Xiao , Yong Liu , Yitong Wang , Yansong Tang , Xiu Li , Yujiu Yang

Referring video object segmentation (RVOS) aims to segment the target object in a video sequence described by a language expression. Typical multimodal Transformer based RVOS approaches process video sequence in a frame-independent manner…

Computer Vision and Pattern Recognition · Computer Science 2023-09-19 Meng Lan , Fu Rong , Zuchao Li , Wei Yu , Lefei Zhang

This paper proposes a large-scale multi-modal dataset for referring motion expression video segmentation, focusing on segmenting and tracking target objects in videos based on language description of objects' motions. Existing referring…

Computer Vision and Pattern Recognition · Computer Science 2025-12-13 Henghui Ding , Chang Liu , Shuting He , Kaining Ying , Xudong Jiang , Chen Change Loy , Yu-Gang Jiang

This work addresses motion-guided few-shot video object segmentation (FSVOS), which aims to segment dynamic objects in videos based on a few annotated examples with the same motion patterns. Existing FSVOS datasets and methods typically…

Computer Vision and Pattern Recognition · Computer Science 2025-07-30 Kaining Ying , Hengrui Hu , Henghui Ding

Referring Video Object Segmentation (RVOS) requires segmenting the object in video referred by a natural language query. Existing methods mainly rely on sophisticated pipelines to tackle such cross-modal task, and do not explicitly model…

Computer Vision and Pattern Recognition · Computer Science 2023-11-21 Ping Li , Yu Zhang , Li Yuan , Xianghua Xu

Referring Video Object Segmentation (RVOS) aims to segment an object of interest throughout a video based on a language description. The prominent challenge lies in aligning static text with dynamic visual content, particularly when objects…

Computer Vision and Pattern Recognition · Computer Science 2025-09-09 Bingrui Zhao , Lin Yuanbo Wu , Xiangtian Fan , Deyin Liu , Lu Zhang , Ruyi He , Jialie Shen , Ximing Li

Referring-based Video Object Segmentation is a multimodal problem that requires producing fine-grained segmentation results guided by external cues. Traditional approaches to this task typically involve training specialized models, which…

Computer Vision and Pattern Recognition · Computer Science 2025-08-15 Tuyen Tran , Thao Minh Le , Truyen Tran

Referring Video Object Segmentation (R-VOS) methods face challenges in maintaining consistent object segmentation due to temporal context variability and the presence of other visually similar objects. We propose an end-to-end R-VOS…

Computer Vision and Pattern Recognition · Computer Science 2024-10-14 Bo Miao , Mohammed Bennamoun , Yongsheng Gao , Mubarak Shah , Ajmal Mian

Conventional few-shot object segmentation methods learn object segmentation from a few labelled support images with strongly labelled segmentation masks. Recent work has shown to perform on par with weaker levels of supervision in terms of…

Computer Vision and Pattern Recognition · Computer Science 2019-12-20 Mennatullah Siam , Naren Doraiswamy , Boris N. Oreshkin , Hengshuai Yao , Martin Jagersand

Few-Shot Video Object Segmentation (FSVOS) aims to segment objects in a query video with the same category defined by a few annotated support images. However, this task was seldom explored. In this work, based on IPMT, a state-of-the-art…

Computer Vision and Pattern Recognition · Computer Science 2023-09-21 Nian Liu , Kepan Nan , Wangbo Zhao , Yuanwei Liu , Xiwen Yao , Salman Khan , Hisham Cholakkal , Rao Muhammad Anwer , Junwei Han , Fahad Shahbaz Khan

In this work we propose a capsule-based approach for semi-supervised video object segmentation. Current video object segmentation methods are frame-based and often require optical flow to capture temporal consistency across frames which can…

Computer Vision and Pattern Recognition · Computer Science 2019-10-02 Kevin Duarte , Yogesh S Rawat , Mubarak Shah

This paper studies referring video object segmentation (RVOS) by boosting video-level visual-linguistic alignment. Recent approaches model the RVOS task as a sequence prediction problem and perform multi-modal interaction as well as…

Computer Vision and Pattern Recognition · Computer Science 2023-05-29 Zhuoyan Luo , Yicheng Xiao , Yong Liu , Shuyan Li , Yitong Wang , Yansong Tang , Xiu Li , Yujiu Yang