English
Related papers

Related papers: Learning the What and How of Annotation in Video O…

200 papers

The current popular methods for video object segmentation (VOS) implement feature matching through several hand-crafted modules that separately perform feature extraction and matching. However, the above hand-crafted designs empirically…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Qiangqiang Wu , Tianyu Yang , Wei WU , Antoni Chan

Significant progress has been made in Video Object Segmentation (VOS), the video object tracking task in its finest level. While the VOS task can be naturally decoupled into image semantic segmentation and video object tracking,…

Computer Vision and Pattern Recognition · Computer Science 2020-07-14 Xuhua Huang , Jiarui Xu , Yu-Wing Tai , Chi-Keung Tang

Annotating videos with object segmentation masks typically involves a two stage procedure of drawing polygons per object instance for all the frames and then linking them through time. While simple, this is a very tedious, time consuming…

Computer Vision and Pattern Recognition · Computer Science 2021-01-19 Namdar Homayounfar , Justin Liang , Wei-Chiu Ma , Raquel Urtasun

We consider the task of semi-supervised video object segmentation (VOS). Our approach mitigates shortcomings in previous VOS work by addressing detail preservation and temporal consistency using visual warping. In contrast to prior work…

Computer Vision and Pattern Recognition · Computer Science 2021-11-23 Julia Gong , F. Christopher Holsinger , Serena Yeung

Video Object Segmentation (VOS) is an active research area of the visual domain. One of its fundamental sub-tasks is semi-supervised / one-shot learning: given only the segmentation mask for the first frame, the task is to provide…

Computer Vision and Pattern Recognition · Computer Science 2020-04-28 Fatemeh Azimi , Benjamin Bischke , Sebastian Palacio , Federico Raue , Joern Hees , Andreas Dengel

Despite advancements in user-guided video segmentation, extracting complex objects consistently for highly complex scenes is still a labor-intensive task, especially for production. It is not uncommon that a majority of frames need to be…

Computer Vision and Pattern Recognition · Computer Science 2023-08-16 Maksym Bekuzarov , Ariana Bermudez , Joon-Young Lee , Hao Li

Reference-based video object segmentation is an emerging topic which aims to segment the corresponding target object in each video frame referred by a given reference, such as a language expression or a photo mask. However, language…

Computer Vision and Pattern Recognition · Computer Science 2023-11-14 Ruolin Yang , Da Li , Conghui Hu , Timothy Hospedales , Honggang Zhang , Yi-Zhe Song

Current semi-supervised video object segmentation (VOS) methods usually leverage the entire features of one frame to predict object masks and update memory. This introduces significant redundant computations. To reduce redundancy, we…

Computer Vision and Pattern Recognition · Computer Science 2022-07-22 Bo Miao , Mohammed Bennamoun , Yongsheng Gao , Ajmal Mian

Current benchmarks for video segmentation are limited to annotating only salient objects (i.e., foreground instances). Despite their impressive architectural designs, previous works trained on these benchmarks have struggled to adapt to…

Computer Vision and Pattern Recognition · Computer Science 2024-12-04 Sangbeom Lim , Seongchan Kim , Seungjun An , Seokju Cho , Paul Hongsuck Seo , Seungryong Kim

Video object segmentation (VOS) aims to segment specified target objects throughout a video. Although state-of-the-art methods have achieved impressive performance (e.g., 90+% J&F) on benchmarks such as DAVIS and YouTube-VOS, these datasets…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Henghui Ding , Kaining Ying , Chang Liu , Shuting He , Xudong Jiang , Yu-Gang Jiang , Philip H. S. Torr , Song Bai

The task of video object segmentation with referring expressions (language-guided VOS) is to, given a linguistic phrase and a video, generate binary masks for the object to which the phrase refers. Our work argues that existing benchmarks…

Computer Vision and Pattern Recognition · Computer Science 2020-10-02 Miriam Bellver , Carles Ventura , Carina Silberer , Ioannis Kazakos , Jordi Torres , Xavier Giro-i-Nieto

Video object segmentation (VOS) aims at segmenting a particular object throughout the entire video clip sequence. The state-of-the-art VOS methods have achieved excellent performance (e.g., 90+% J&F) on existing datasets. However, since the…

Computer Vision and Pattern Recognition · Computer Science 2023-10-24 Henghui Ding , Chang Liu , Shuting He , Xudong Jiang , Philip H. S. Torr , Song Bai

Exploring dense matching between the current frame and past frames for long-range context modeling, memory-based methods have demonstrated impressive results in video object segmentation (VOS) recently. Nevertheless, due to the lack of…

Computer Vision and Pattern Recognition · Computer Science 2022-12-14 Junke Wang , Dongdong Chen , Zuxuan Wu , Chong Luo , Chuanxin Tang , Xiyang Dai , Yucheng Zhao , Yujia Xie , Lu Yuan , Yu-Gang Jiang

In this paper we present our system for human-in-the-loop video object segmentation. The backbone of our system is a method for one-shot video object segmentation. While fast, this method requires an accurate pixel-level segmentation of one…

Computer Vision and Pattern Recognition · Computer Science 2018-01-03 Arnaud Benard , Michael Gygli

In the booming video era, video segmentation attracts increasing research attention in the multimedia community. Semi-supervised video object segmentation (VOS) aims at segmenting objects in all target frames of a video, given annotated…

Computer Vision and Pattern Recognition · Computer Science 2022-07-05 Xiaohao Xu , Jinglu Wang , Xiang Ming , Yan Lu

This paper tackles the task of semi-supervised video object segmentation, i.e., the separation of an object from the background in a video, given the mask of the first frame. We present One-Shot Video Object Segmentation (OSVOS), based on a…

Computer Vision and Pattern Recognition · Computer Science 2017-04-14 Sergi Caelles , Kevis-Kokitsi Maninis , Jordi Pont-Tuset , Laura Leal-Taixé , Daniel Cremers , Luc Van Gool

Learning long-term spatial-temporal features are critical for many video analysis tasks. However, existing video segmentation methods predominantly rely on static image segmentation techniques, and methods capturing temporal dependency for…

Computer Vision and Pattern Recognition · Computer Science 2018-09-05 Ning Xu , Linjie Yang , Yuchen Fan , Jianchao Yang , Dingcheng Yue , Yuchen Liang , Brian Price , Scott Cohen , Thomas Huang

Video Object Segmentation (VOS) task aims to segmenting a particular object instance throughout the entire video sequence given only the object mask of the first frame. Recently, Segment Anything Model 2 (SAM 2) is proposed, which is a…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Feiyu Pan , Hao Fang , Runmin Cong , Wei Zhang , Xiankai Lu

Learning long-term spatial-temporal features are critical for many video analysis tasks. However, existing video segmentation methods predominantly rely on static image segmentation techniques, and methods capturing temporal dependency for…

Computer Vision and Pattern Recognition · Computer Science 2018-09-11 Ning Xu , Linjie Yang , Yuchen Fan , Dingcheng Yue , Yuchen Liang , Jianchao Yang , Thomas Huang

Video Object Segmentation (VOS) is one of the most fundamental and challenging tasks in computer vision and has a wide range of applications. Most existing methods rely on spatiotemporal memory networks to extract frame-level features and…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Mengjiao Wang , Junpei Zhang , Xu Liu , Yuting Yang , Mengru Ma