English
Related papers

Related papers: OnlineRefer: A Simple Online Baseline for Referrin…

200 papers

In this work we propose a capsule-based approach for semi-supervised video object segmentation. Current video object segmentation methods are frame-based and often require optical flow to capture temporal consistency across frames which can…

Computer Vision and Pattern Recognition · Computer Science 2019-10-02 Kevin Duarte , Yogesh S Rawat , Mubarak Shah

In Video Instance Segmentation (VIS), current approaches either focus on the quality of the results, by taking the whole video as input and processing it offline; or on speed, by handling it frame by frame at the cost of competitive…

Computer Vision and Pattern Recognition · Computer Science 2022-11-01 Çağan Selim Çoban , Oğuzhan Keskin , Jordi Pont-Tuset , Fatma Güney

Referring video object segmentation (RVOS) is a challenging task that requires the model to segment the object in a video given the language description. MeViS is a recently proposed dataset that contains motion expressions of the target…

Computer Vision and Pattern Recognition · Computer Science 2025-04-02 Haobo Yuan , Tao Zhang , Xiangtai Li , Lu Qi , Zilong Huang , Shilin Xu , Jiashi Feng , Ming-Hsuan Yang

Referring Video Object Segmentation (RVOS) aims to segment target objects in videos based on natural language descriptions. However, fixed keyframe-based approaches that couple a vision language model with a separate propagation module…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Jihwan Hong , Jaeyoung Do

Referring Video Object Segmentation (R-VOS) methods face challenges in maintaining consistent object segmentation due to temporal context variability and the presence of other visually similar objects. We propose an end-to-end R-VOS…

Computer Vision and Pattern Recognition · Computer Science 2024-10-14 Bo Miao , Mohammed Bennamoun , Yongsheng Gao , Mubarak Shah , Ajmal Mian

Referring Video Object Segmentation is an emerging multi-modal task that aims to segment objects in the video given a natural language expression. In this work, we build two instance-centric models and fuse predicted results from…

Computer Vision and Pattern Recognition · Computer Science 2024-08-21 Bin Cao , Yisi Zhang , Hanyi Wang , Xingjian He , Jing Liu

Video object segmentation (VOS) describes the task of segmenting a set of objects in each frame of a video. In the semi-supervised setting, the first mask of each object is provided at test time. Following the one-shot principle,…

Computer Vision and Pattern Recognition · Computer Science 2020-12-04 Tim Meinhardt , Laura Leal-Taixe

We address the highly challenging problem of video object segmentation. Given only the initial mask, the task is to segment the target in the subsequent frames. In order to effectively handle appearance changes and similar background…

Computer Vision and Pattern Recognition · Computer Science 2019-04-19 Andreas Robinson , Felix Järemo Lawin , Martin Danelljan , Fahad Shahbaz Khan , Michael Felsberg

The crux of Referring Video Object Segmentation (RVOS) lies in modeling dense text-video relations to associate abstract linguistic concepts with dynamic visual contents at pixel-level. Current RVOS methods typically use vision and language…

Computer Vision and Pattern Recognition · Computer Science 2024-09-24 Zikun Zhou , Wentao Xiong , Li Zhou , Xin Li , Zhenyu He , Yaowei Wang

Referring Video Segmentation (RVOS) aims to segment objects in videos given linguistic expressions. The key to solving RVOS is to extract long-range temporal context information from the interactions of expressions and videos to depict the…

Computer Vision and Pattern Recognition · Computer Science 2025-10-10 Cilin Yan , Jingyun Wang , Guoliang Kang

Remote sensing video referring object segmentation (RS-RVOS) is challenged by weak target saliency and severe visual information truncation in dynamic scenes, making it extremely difficult to maintain discriminative target representations…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 H. Jiang , Y. Sun , Z. Dong , T. Liu , Y. Gu

Recent state-of-the-art semi-supervised Video Object Segmentation (VOS) methods have shown significant improvements in target object segmentation accuracy when information from preceding frames is used in segmenting the current frame. In…

Computer Vision and Pattern Recognition · Computer Science 2024-02-15 Amir Nazemi , Mohammad Javad Shafiee , Zahra Gharaee , Paul Fieguth

In the booming video era, video segmentation attracts increasing research attention in the multimedia community. Semi-supervised video object segmentation (VOS) aims at segmenting objects in all target frames of a video, given annotated…

Computer Vision and Pattern Recognition · Computer Science 2022-07-05 Xiaohao Xu , Jinglu Wang , Xiang Ming , Yan Lu

The objective of this paper is self-supervised representation learning, with the goal of solving semi-supervised video object segmentation (a.k.a. dense tracking). We make the following contributions: (i) we propose to improve the existing…

Computer Vision and Pattern Recognition · Computer Science 2020-06-23 Fangrui Zhu , Li Zhang , Yanwei Fu , Guodong Guo , Weidi Xie

Referring video object segmentation aims to segment the object referred by a given language expression. Existing works typically require compressed video bitstream to be decoded to RGB frames before being segmented, which increases…

Computer Vision and Pattern Recognition · Computer Science 2022-07-27 Weidong Chen , Dexiang Hong , Yuankai Qi , Zhenjun Han , Shuhui Wang , Laiyun Qing , Qingming Huang , Guorong Li

This paper tackles the task of semi-supervised video object segmentation, i.e., the separation of an object from the background in a video, given the mask of the first frame. We present One-Shot Video Object Segmentation (OSVOS), based on a…

Computer Vision and Pattern Recognition · Computer Science 2017-04-14 Sergi Caelles , Kevis-Kokitsi Maninis , Jordi Pont-Tuset , Laura Leal-Taixé , Daniel Cremers , Luc Van Gool

In recent years, significant progress has been made in video instance segmentation (VIS), with many offline and online methods achieving state-of-the-art performance. While offline methods have the advantage of producing temporally…

Computer Vision and Pattern Recognition · Computer Science 2023-09-22 Junlong Li , Bingyao Yu , Yongming Rao , Jie Zhou , Jiwen Lu

Until recently, the Video Instance Segmentation (VIS) community operated under the common belief that offline methods are generally superior to a frame by frame online processing. However, the recent success of online methods questions this…

Computer Vision and Pattern Recognition · Computer Science 2023-09-19 Tim Meinhardt , Matt Feiszli , Yuchen Fan , Laura Leal-Taixe , Rakesh Ranjan

Given an object mask, Semi-supervised Video Object Segmentation (SVOS) technique aims to track and segment the object across video frames, serving as a fundamental task in computer vision. Although recent memory-based methods demonstrate…

Computer Vision and Pattern Recognition · Computer Science 2025-07-28 Guanyi Qin , Ziyue Wang , Daiyun Shen , Haofeng Liu , Hantao Zhou , Junde Wu , Runze Hu , Yueming Jin

In recent years, the task of segmenting foreground objects from background in a video, i.e. video object segmentation (VOS), has received considerable attention. In this paper, we propose a single end-to-end trainable deep neural network,…

Computer Vision and Pattern Recognition · Computer Science 2019-10-02 Ye Lyu , George Vosselman , Gui-Song Xia , Michael Ying Yang