English
Related papers

Related papers: Temporally Consistent Referring Video Object Segme…

200 papers

Matching-based methods, especially those based on space-time memory, are significantly ahead of other solutions in semi-supervised video object segmentation (VOS). However, continuously growing and redundant template features lead to an…

Computer Vision and Pattern Recognition · Computer Science 2022-08-23 Zhihui Lin , Tianyu Yang , Maomao Li , Ziyu Wang , Chun Yuan , Wenhao Jiang , Wei Liu

Video instance segmentation (VIS) aims to segment and associate all instances of predefined classes for each frame in videos. Prior methods usually obtain segmentation for a frame or clip first, and merge the incomplete results by tracking…

Computer Vision and Pattern Recognition · Computer Science 2021-10-01 Huaijia Lin , Ruizheng Wu , Shu Liu , Jiangbo Lu , Jiaya Jia

Personal robots and driverless cars need to be able to operate in novel environments and thus quickly and efficiently learn to recognise new object classes. We address this problem by considering the task of video object segmentation.…

Computer Vision and Pattern Recognition · Computer Science 2020-08-18 Harkirat Singh Behl , Mohammad Najafi , Anurag Arnab , Philip H. S. Torr

Video instance segmentation (VIS) aims at segmenting and tracking objects in videos. Prior methods typically generate frame-level or clip-level object instances first and then associate them by either additional tracking heads or complex…

Computer Vision and Pattern Recognition · Computer Science 2023-01-06 Fei He , Haoyang Zhang , Naiyu Gao , Jian Jia , Yanhu Shan , Xin Zhao , Kaiqi Huang

Referring video object segmentation (RVOS) aims at segmenting an object in a video following human instruction. Current state-of-the-art methods fall into an offline pattern, in which each clip independently interacts with text embedding…

Computer Vision and Pattern Recognition · Computer Science 2023-07-19 Dongming Wu , Tiancai Wang , Yuang Zhang , Xiangyu Zhang , Jianbing Shen

Video Object Segmentation, and video processing in general, has been historically dominated by methods that rely on the temporal consistency and redundancy in consecutive video frames. When the temporal smoothness is suddenly broken, such…

Computer Vision and Pattern Recognition · Computer Science 2018-05-17 Kevis-Kokitsi Maninis , Sergi Caelles , Yuhua Chen , Jordi Pont-Tuset , Laura Leal-Taixé , Daniel Cremers , Luc Van Gool

Most state-of-the-art semi-supervised video object segmentation methods rely on a pixel-accurate mask of a target object provided for the first frame of a video. However, obtaining a detailed segmentation mask is expensive and…

Computer Vision and Pattern Recognition · Computer Science 2019-02-06 Anna Khoreva , Anna Rohrbach , Bernt Schiele

Existing video object segmentation (VOS) benchmarks focus on short-term videos which just last about 3-5 seconds and where objects are visible most of the time. These videos are poorly representative of practical applications, and the…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Lingyi Hong , Wenchao Chen , Zhongying Liu , Wei Zhang , Pinxue Guo , Zhaoyu Chen , Wenqiang Zhang

Interactive video object segmentation (iVOS) aims at efficiently harvesting high-quality segmentation masks of the target object in a video with user interactions. Most previous state-of-the-arts tackle the iVOS with two independent…

Computer Vision and Pattern Recognition · Computer Science 2020-03-31 Jiaxu Miao , Yunchao Wei , Yi Yang

We present Recurrent Video Masked-Autoencoders (RVM): a novel approach to video representation learning that leverages recurrent computation to model the temporal structure of video data. RVM couples an asymmetric masking objective with a…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Daniel Zoran , Nikhil Parthasarathy , Yi Yang , Drew A Hudson , Joao Carreira , Andrew Zisserman

This report presents an overview of the 7th Large-scale Video Object Segmentation (LSVOS) Challenge held in conjunction with ICCV 2025. Besides the two traditional tracks of LSVOS that jointly target robustness in realistic video scenarios:…

Despite the promising performance of current video segmentation models on existing benchmarks, these models still struggle with complex scenes. In this paper, we introduce the 6th Large-scale Video Object Segmentation (LSVOS) challenge in…

Current state-of-the-art approaches for Semi-supervised Video Object Segmentation (Semi-VOS) propagates information from previous frames to generate segmentation mask for the current frame. This results in high-quality segmentation across…

Computer Vision and Pattern Recognition · Computer Science 2021-05-18 Hyojin Park , Jayeon Yoo , Seohyeong Jeong , Ganesh Venkatesh , Nojun Kwak

Few-shot video object segmentation (FS-VOS) aims at segmenting video frames using a few labelled examples of classes not seen during initial training. In this paper, we present a simple but effective temporal transductive inference (TTI)…

Computer Vision and Pattern Recognition · Computer Science 2023-07-18 Mennatullah Siam , Konstantinos G. Derpanis , Richard P. Wildes

With recent video object segmentation (VOS) benchmarks evolving to challenging scenarios, we revisit a simple but overlooked strategy: restricting the size of memory banks. This diverges from the prevalent practice of expanding memory banks…

Computer Vision and Pattern Recognition · Computer Science 2025-01-15 Junbao Zhou , Ziqi Pang , Yu-Xiong Wang

Referring Video Object Segmentation (RVOS) aims to segment objects in videos based on textual queries. Current methods mainly rely on large-scale supervised fine-tuning (SFT) of Multi-modal Large Language Models (MLLMs). However, this…

Computer Vision and Pattern Recognition · Computer Science 2026-02-09 Haichao Jiang , Tianming Liang , Wei-Shi Zheng , Jian-Fang Hu

The video topic segmentation (VTS) task segments videos into intelligible, non-overlapping topics, facilitating efficient comprehension of video content and quick access to specific content. VTS is also critical to various downstream video…

Artificial Intelligence · Computer Science 2024-12-31 Hai Yu , Chong Deng , Qinglin Zhang , Jiaqing Liu , Qian Chen , Wen Wang

Multi-modal Video Object Segmentation (VOS), including RGB-Thermal, RGB-Depth, and RGB-Event, has garnered attention due to its capability to address challenging scenarios where traditional VOS methods struggle, such as extreme…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Pinxue Guo , Wanyun Li , Hao Huang , Lingyi Hong , Xinyu Zhou , Zhaoyu Chen , Jinglun Li , Kaixun Jiang , Wei Zhang , Wenqiang Zhang

Open-Vocabulary Video Instance Segmentation (VIS) is attracting increasing attention due to its ability to segment and track arbitrary objects. However, the recent Open-Vocabulary VIS attempts obtained unsatisfactory results, especially in…

Computer Vision and Pattern Recognition · Computer Science 2024-07-15 Hao Fang , Peng Wu , Yawei Li , Xinxin Zhang , Xiankai Lu

In this paper, we propose an unsupervised video object co-segmentation framework based on the primary object proposals to extract the common foreground object(s) from a given video set. In addition to the objectness attributes and motion…

Computer Vision and Pattern Recognition · Computer Science 2018-02-12 Michael Ying Yang , Matthias Reso , Jun Tang , Wentong Liao , Bodo Rosenhahn