English
Related papers

Related papers: ActionVOS: Actions as Prompts for Video Object Seg…

200 papers

Referring Video Object Segmentation (RVOS) aims to segment objects in videos based on textual queries. Current methods mainly rely on large-scale supervised fine-tuning (SFT) of Multi-modal Large Language Models (MLLMs). However, this…

Computer Vision and Pattern Recognition · Computer Science 2026-02-09 Haichao Jiang , Tianming Liang , Wei-Shi Zheng , Jian-Fang Hu

In the booming video era, video segmentation attracts increasing research attention in the multimedia community. Semi-supervised video object segmentation (VOS) aims at segmenting objects in all target frames of a video, given annotated…

Computer Vision and Pattern Recognition · Computer Science 2022-07-05 Xiaohao Xu , Jinglu Wang , Xiang Ming , Yan Lu

This paper tackles the task of semi-supervised video object segmentation, i.e., the separation of an object from the background in a video, given the mask of the first frame. We present One-Shot Video Object Segmentation (OSVOS), based on a…

Computer Vision and Pattern Recognition · Computer Science 2017-04-14 Sergi Caelles , Kevis-Kokitsi Maninis , Jordi Pont-Tuset , Laura Leal-Taixé , Daniel Cremers , Luc Van Gool

Referring video object segmentation (RVOS) relies on natural language expressions to segment target objects in video, emphasizing modeling dense text-video relations. The current RVOS methods typically use independently pre-trained vision…

Computer Vision and Pattern Recognition · Computer Science 2024-06-10 Feiyu Pan , Hao Fang , Xiankai Lu

The Audio-Visual Segmentation (AVS) task aims to segment sounding objects in the visual space using audio cues. However, in this work, it is recognized that previous AVS methods show a heavy reliance on detrimental segmentation preferences…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Yaoting Wang , Peiwen Sun , Yuanchao Li , Honggang Zhang , Di Hu

Video object segmentation (VOS) is a crucial task in computer vision, but current VOS methods struggle with complex scenes and prolonged object motions. To address these challenges, the MOSE dataset aims to enhance object recognition and…

Computer Vision and Pattern Recognition · Computer Science 2024-08-30 Deshui Miao , Yameng Gu , Xin Li , Zhenyu He , Yaowei Wang , Ming-Hsuan Yang

Video Object Segmentation (VOS) is crucial for several applications, from video editing to video data generation. Training a VOS model requires an abundance of manually labeled training videos. The de-facto traditional way of annotating…

Computer Vision and Pattern Recognition · Computer Science 2023-11-14 Thanos Delatolas , Vicky Kalogeiton , Dim P. Papadopoulos

As a milestone for video object segmentation, one-shot video object segmentation (OSVOS) has achieved a large margin compared to the conventional optical-flow based methods regarding to the segmentation accuracy. Its excellent performance…

Computer Vision and Pattern Recognition · Computer Science 2019-08-21 Yu Liu , Yutong Dai , Anh-Dzung Doan , Lingqiao Liu , Ian Reid

Video object segmentation (VOS) aims at segmenting a particular object throughout the entire video clip sequence. The state-of-the-art VOS methods have achieved excellent performance (e.g., 90+% J&F) on existing datasets. However, since the…

Computer Vision and Pattern Recognition · Computer Science 2023-10-24 Henghui Ding , Chang Liu , Shuting He , Xudong Jiang , Philip H. S. Torr , Song Bai

Inspired by recent advances of deep learning in instance segmentation and object tracking, we introduce video object segmentation problem as a concept of guided instance segmentation. Our model proceeds on a per-frame basis, guided by the…

Computer Vision and Pattern Recognition · Computer Science 2019-02-05 Anna Khoreva , Federico Perazzi , Rodrigo Benenson , Bernt Schiele , Alexander Sorkine-Hornung

Referring video object segmentation (R-VOS) is an emerging cross-modal task that aims to segment the target object referred by a language expression in all video frames. In this work, we propose a simple and unified framework built upon…

Computer Vision and Pattern Recognition · Computer Science 2022-03-15 Jiannan Wu , Yi Jiang , Peize Sun , Zehuan Yuan , Ping Luo

Referring video object segmentation (RVOS) relies on natural language expressions to segment target objects in video. In this year, LSVOS Challenge RVOS Track replaced the origin YouTube-RVOS benchmark with MeViS. MeViS focuses on referring…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Hao Fang , Feiyu Pan , Xiankai Lu , Wei Zhang , Runmin Cong

The current popular methods for video object segmentation (VOS) implement feature matching through several hand-crafted modules that separately perform feature extraction and matching. However, the above hand-crafted designs empirically…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Qiangqiang Wu , Tianyu Yang , Wei WU , Antoni Chan

Many of the recent successful methods for video object segmentation (VOS) are overly complicated, heavily rely on fine-tuning on the first frame, and/or are slow, and are hence of limited practical use. In this work, we propose FEELVOS as a…

Computer Vision and Pattern Recognition · Computer Science 2019-04-09 Paul Voigtlaender , Yuning Chai , Florian Schroff , Hartwig Adam , Bastian Leibe , Liang-Chieh Chen

Referring Video Object Segmentation (RVOS) aims to segment target objects throughout a video based on a text description. This task has attracted increasing attention in the field of computer vision due to its promising applications in…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Tianming Liang , Haichao Jiang , Wei-Shi Zheng , Jian-Fang Hu

Video object segmentation (VOS) aims to distinguish and track target objects in a video. Despite the excellent performance achieved by off-the-shell VOS models, existing VOS benchmarks mainly focus on short-term videos lasting about 5…

Computer Vision and Pattern Recognition · Computer Science 2024-05-02 Lingyi Hong , Zhongying Liu , Wenchao Chen , Chenzhi Tan , Yuang Feng , Xinyu Zhou , Pinxue Guo , Jinglun Li , Zhaoyu Chen , Shuyong Gao , Wei Zhang , Wenqiang Zhang

In this paper we introduce a Transformer-based approach to video object segmentation (VOS). To address compounding error and scalability issues of prior work, we propose a scalable, end-to-end method for VOS called Sparse Spatiotemporal…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Brendan Duke , Abdalla Ahmed , Christian Wolf , Parham Aarabi , Graham W. Taylor

Recently, Space-Time Memory Network (STM) based methods have achieved state-of-the-art performance in semi-supervised video object segmentation (VOS). A crucial problem in this task is how to model the dependency both among different frames…

Computer Vision and Pattern Recognition · Computer Science 2021-09-21 Jianbiao Mei , Mengmeng Wang , Yeneng Lin , Yi Yuan , Yong Liu

Intelligent robots need to interact with diverse objects across various environments. The appearance and state of objects frequently undergo complex transformations depending on the object properties, e.g., phase transitions. However, in…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Zixuan Chen , Jiaxin Li , Liming Tan , Yejie Guo , Junxuan Liang , Cewu Lu , Yong-Lu Li

Handling occlusion remains a significant challenge for video instance-level tasks like Multiple Object Tracking (MOT) and Video Instance Segmentation (VIS). In this paper, we propose a novel framework, Amodal-Aware Video Instance…

Computer Vision and Pattern Recognition · Computer Science 2025-04-11 Minh Tran , Thang Pham , Winston Bounsavy , Tri Nguyen , Ngan Le