English
Related papers

Related papers: Segment Anything Across Shots: A Method and Benchm…

200 papers

Recently, transformer-based approaches have shown promising results for semi-supervised video object segmentation. However, these approaches typically struggle on long videos due to increased GPU memory demands, as they frequently expand…

Computer Vision and Pattern Recognition · Computer Science 2024-09-27 Abdelrahman Shaker , Syed Talal Wasim , Martin Danelljan , Salman Khan , Ming-Hsuan Yang , Fahad Shahbaz Khan

Video Object Segmentation (VOS) is foundational to numerous computer vision applications, including surveillance, autonomous driving, robotics and generative video editing. However, existing VOS models often struggle with precise mask…

Computer Vision and Pattern Recognition · Computer Science 2025-07-28 Elham Soltani Kazemi , Imad Eddine Toubal , Gani Rahmon , Jaired Collins , K. Palaniappan

We propose a novel self-supervised Video Object Segmentation (VOS) approach that strives to achieve better object-background discriminability for accurate object segmentation. Distinct from previous self-supervised VOS methods, our approach…

Computer Vision and Pattern Recognition · Computer Science 2022-04-25 Jyoti Kini , Fahad Shahbaz Khan , Salman Khan , Mubarak Shah

Objective Semi-supervised video object segmentation refers to segmenting the object in subsequent frames given the object label in the first frame. Existing algorithms are mostly based on the objectives of matching and propagation…

Computer Vision and Pattern Recognition · Computer Science 2020-09-03 Zhang Xuerui , Yuan Xia

Amodal perception requires inferring the full shape of an object that is partially occluded. This task is particularly challenging on two levels: (1) it requires more information than what is contained in the instant retina or imaging…

Computer Vision and Pattern Recognition · Computer Science 2022-10-25 Jian Yao , Yuxin Hong , Chiyu Wang , Tianjun Xiao , Tong He , Francesco Locatello , David Wipf , Yanwei Fu , Zheng Zhang

Video object segmentation (VOS) aims to distinguish and track target objects in a video. Despite the excellent performance achieved by off-the-shell VOS models, existing VOS benchmarks mainly focus on short-term videos lasting about 5…

Computer Vision and Pattern Recognition · Computer Science 2024-05-02 Lingyi Hong , Zhongying Liu , Wenchao Chen , Chenzhi Tan , Yuang Feng , Xinyu Zhou , Pinxue Guo , Jinglun Li , Zhaoyu Chen , Shuyong Gao , Wei Zhang , Wenqiang Zhang

This paper delves into the challenges of achieving scalable and effective multi-object modeling for semi-supervised Video Object Segmentation (VOS). Previous VOS methods decode features with a single positive object, limiting the learning…

Computer Vision and Pattern Recognition · Computer Science 2024-05-29 Zongxin Yang , Jiaxu Miao , Yunchao Wei , Wenguan Wang , Xiaohan Wang , Yi Yang

We propose a new method for video object segmentation (VOS) that addresses object pattern learning from unlabeled videos, unlike most existing methods which rely heavily on extensive annotated data. We introduce a unified…

Computer Vision and Pattern Recognition · Computer Science 2020-03-12 Xiankai Lu , Wenguan Wang , Jianbing Shen , Yu-Wing Tai , David Crandall , Steven C. H. Hoi

Referring video object segmentation (RVOS) is a task that aims to segment the target object in all video frames based on a sentence describing the object. Although existing RVOS methods have achieved significant performance, they depend on…

Computer Vision and Pattern Recognition · Computer Science 2023-12-18 Wangbo Zhao , Kepan Nan , Songyang Zhang , Kai Chen , Dahua Lin , Yang You

Amodal instance segmentation, which aims to detect and segment both visible and invisible parts of objects in images, plays a crucial role in various applications including autonomous driving, robotic manipulation, and scene understanding.…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Wei-En Tai , Yu-Lin Shih , Cheng Sun , Yu-Chiang Frank Wang , Hwann-Tzong Chen

The Segment Anything Model (SAM) has gained significant attention for its impressive performance in image segmentation. However, it lacks proficiency in referring video object segmentation (RVOS) due to the need for precise user-interactive…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Yonglin Li , Jing Zhang , Xiao Teng , Long Lan , Xinwang Liu

Video Object Segmentation and Tracking (VOST) presents a complex yet critical challenge in computer vision, requiring robust integration of segmentation and tracking across temporally dynamic frames. Traditional methods have struggled with…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Guoping Xu , Jayaram K. Udupa , Yajun Yu , Hua-Chieh Shao , Songlin Zhao , Wei Liu , You Zhang

Video Semantic Segmentation (VSS) involves assigning a semantic label to each pixel in a video sequence. Prior work in this field has demonstrated promising results by extending image semantic segmentation models to exploit temporal…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Yuetian Weng , Mingfei Han , Haoyu He , Mingjie Li , Lina Yao , Xiaojun Chang , Bohan Zhuang

Segment Anything Model (SAM), known for its remarkable zero-shot segmentation capabilities, has garnered significant attention in the community. Nevertheless, its performance is challenged when dealing with what we refer to as visually…

Computer Vision and Pattern Recognition · Computer Science 2026-01-05 Guangqian Guo , Pengfei Chen , Yong Guo , Huafeng Chen , Boqiang Zhang , Shan Gao

Video segmentation aims at partitioning video sequences into meaningful segments based on objects or regions of interest within frames. Current video segmentation models are often derived from image segmentation techniques, which struggle…

Computer Vision and Pattern Recognition · Computer Science 2024-08-21 Chen Liang , Qiang Guo , Xiaochao Qu , Luoqi Liu , Ting Liu

This paper strives for motion expressions guided video segmentation, which focuses on segmenting objects in video content based on a sentence describing the motion of the objects. Existing referring video object datasets typically focus on…

Computer Vision and Pattern Recognition · Computer Science 2023-08-17 Henghui Ding , Chang Liu , Shuting He , Xudong Jiang , Chen Change Loy

Camouflaged object segmentation presents unique challenges compared to traditional segmentation tasks, primarily due to the high similarity in patterns and colors between camouflaged objects and their backgrounds. Effective solutions to…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 Wenqi Guo , Mohamed Shehata , Shan Du

Tracking any given object(s) spatially and temporally is a common purpose in Visual Object Tracking (VOT) and Video Object Segmentation (VOS). Joint tracking and segmentation have been attempted in some studies but they often lack full…

Computer Vision and Pattern Recognition · Computer Science 2023-09-22 Yuanyou Xu , Zongxin Yang , Yi Yang

Video object segmentation (VOS) aims at pixel-level object tracking given only the annotations in the first frame. Due to the large visual variations of objects in video and the lack of training samples, it remains a difficult task despite…

Computer Vision and Pattern Recognition · Computer Science 2019-07-05 Qiang Zhou , Zilong Huang , Lichao Huang , Yongchao Gong , Han Shen , Chang Huang , Wenyu Liu , Xinggang Wang

Significant progress has been made in Video Object Segmentation (VOS), the video object tracking task in its finest level. While the VOS task can be naturally decoupled into image semantic segmentation and video object tracking,…

Computer Vision and Pattern Recognition · Computer Science 2020-07-14 Xuhua Huang , Jiarui Xu , Yu-Wing Tai , Chi-Keung Tang