English
Related papers

Related papers: TTVOS: Lightweight Video Object Segmentation with …

200 papers

Accuracy and processing speed are two important factors that affect the use of video object segmentation (VOS) in real applications. With the advanced techniques of deep neural networks, the accuracy has been significantly improved,…

Computer Vision and Pattern Recognition · Computer Science 2019-08-29 Tao Zhuo , Zhiyong Cheng , Mohan Kankanhalli

In this paper, we introduce a variant of video object segmentation (VOS) that bridges interactive and semi-automatic approaches, termed Lazy Video Object Segmentation (ziVOS). In contrast, to both tasks, which handle video object…

Computer Vision and Pattern Recognition · Computer Science 2024-11-14 Stéphane Vujasinović , Stefan Becker , Sebastian Bullinger , Norbert Scherer-Negenborn , Michael Arens , Rainer Stiefelhagen

Weakly supervised instance segmentation reduces the cost of annotations required to train models. However, existing approaches which rely only on image-level class labels predominantly suffer from errors due to (a) partial segmentation of…

Computer Vision and Pattern Recognition · Computer Science 2021-03-25 Qing Liu , Vignesh Ramanathan , Dhruv Mahajan , Alan Yuille , Zhenheng Yang

The recent transformer-based models have dominated the Referring Video Object Segmentation (RVOS) task due to the superior performance. Most prior works adopt unified DETR framework to generate segmentation masks in query-to-instance…

Computer Vision and Pattern Recognition · Computer Science 2024-01-02 Zhuoyan Luo , Yicheng Xiao , Yong Liu , Yitong Wang , Yansong Tang , Xiu Li , Yujiu Yang

Semi-supervised video object segmentation (VOS) aims to densely track certain designated objects in videos. One of the main challenges in this task is the existence of background distractors that appear similar to the target objects. We…

Computer Vision and Pattern Recognition · Computer Science 2022-08-16 Suhwan Cho , Heansung Lee , Minhyeok Lee , Chaewon Park , Sungjun Jang , Minjung Kim , Sangyoun Lee

Video semantic segmentation has achieved great progress under the supervision of large amounts of labelled training data. However, domain adaptive video segmentation, which can mitigate data labelling constraints by adapting from a labelled…

Computer Vision and Pattern Recognition · Computer Science 2022-07-07 Yun Xing , Dayan Guan , Jiaxing Huang , Shijian Lu

Memory-based video object segmentation methods model multiple objects over long temporal-spatial spans by establishing memory bank, which achieve the remarkable performance. However, they struggle to overcome the false matching and are…

Computer Vision and Pattern Recognition · Computer Science 2024-09-24 Jintu Zheng , Yun Liang , Yuqing Zhang , Wanchao Su

We approach video object segmentation (VOS) by splitting the task into two sub-tasks: bounding box level tracking, followed by bounding box segmentation. Following this paradigm, we present BoLTVOS (Box-Level Tracking for VOS), which…

Computer Vision and Pattern Recognition · Computer Science 2020-01-01 Paul Voigtlaender , Jonathon Luiten , Bastian Leibe

Despite significant progress in semi-supervised learning for image object detection, several key issues are yet to be addressed for video object detection: (1) Achieving good performance for supervised video object detection greatly depends…

Computer Vision and Pattern Recognition · Computer Science 2023-11-14 Tanvir Mahmud , Chun-Hao Liu , Burhaneddin Yaman , Diana Marculescu

Predicting and tracking objects in real-world scenarios is a critical challenge in Video Object Segmentation (VOS) tasks. Unsupervised VOS (UVOS) has the additional challenge of finding an initial segmentation of salient objects, which…

Computer Vision and Pattern Recognition · Computer Science 2025-08-25 Mohammad Mohammadzadeh Kalati , Farhad Maleki , Ian McQuillan

Referring Video Object Segmentation (RVOS) aims to segment and track objects in videos based on natural language expressions, requiring precise alignment between visual content and textual queries. However, existing methods often suffer…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Seunghun Lee , Jiwan Seo , Jeonghoon Kim , Sungho Moon , Siwon Kim , Haeun Yun , Hyogyeong Jeon , Wonhyeok Choi , Jaehoon Jeong , Zane Durante , Sang Hyun Park , Sunghoon Im

Given an object mask, Semi-supervised Video Object Segmentation (SVOS) technique aims to track and segment the object across video frames, serving as a fundamental task in computer vision. Although recent memory-based methods demonstrate…

Computer Vision and Pattern Recognition · Computer Science 2025-07-28 Guanyi Qin , Ziyue Wang , Daiyun Shen , Haofeng Liu , Hantao Zhou , Junde Wu , Runze Hu , Yueming Jin

Referring Video Object Segmentation (RVOS) requires segmenting specific objects in a video guided by a natural language description. The core challenge of RVOS is to anchor abstract linguistic concepts onto a specific set of pixels and…

Computer Vision and Pattern Recognition · Computer Science 2026-02-27 Zanyi Wang , Dengyang Jiang , Liuzhuozheng Li , Sizhe Dang , Chengzu Li , Harry Yang , Guang Dai , Mengmeng Wang , Jingdong Wang

The video topic segmentation (VTS) task segments videos into intelligible, non-overlapping topics, facilitating efficient comprehension of video content and quick access to specific content. VTS is also critical to various downstream video…

Artificial Intelligence · Computer Science 2024-12-31 Hai Yu , Chong Deng , Qinglin Zhang , Jiaqing Liu , Qian Chen , Wen Wang

Referring video object segmentation (RVOS) aims to segment objects in videos guided by natural language descriptions. We propose FS-RVOS, a Transformer-based model with two key components: a cross-modal affinity module and an instance…

Computer Vision and Pattern Recognition · Computer Science 2025-04-21 Heng Liu , Guanghui Li , Mingqi Gao , Xiantong Zhen , Feng Zheng , Yang Wang

Zero-shot Video Object Segmentation (ZSVOS) aims at segmenting the primary moving object without any human annotations. Mainstream solutions mainly focus on learning a single model on large-scale video datasets, which struggle to generalize…

Computer Vision and Pattern Recognition · Computer Science 2024-03-08 Weihuang Liu , Xi Shen , Haolun Li , Xiuli Bi , Bo Liu , Chi-Man Pun , Xiaodong Cun

Amodal perception requires inferring the full shape of an object that is partially occluded. This task is particularly challenging on two levels: (1) it requires more information than what is contained in the instant retina or imaging…

Computer Vision and Pattern Recognition · Computer Science 2022-10-25 Jian Yao , Yuxin Hong , Chiyu Wang , Tianjun Xiao , Tong He , Francesco Locatello , David Wipf , Yanwei Fu , Zheng Zhang

Exploring dense matching between the current frame and past frames for long-range context modeling, memory-based methods have demonstrated impressive results in video object segmentation (VOS) recently. Nevertheless, due to the lack of…

Computer Vision and Pattern Recognition · Computer Science 2022-12-14 Junke Wang , Dongdong Chen , Zuxuan Wu , Chong Luo , Chuanxin Tang , Xiyang Dai , Yucheng Zhao , Yujia Xie , Lu Yuan , Yu-Gang Jiang

Current prevailing Video Object Segmentation methods follow the pipeline of extraction-then-matching, which first extracts features on current and reference frames independently, and then performs dense matching between them. This decoupled…

Computer Vision and Pattern Recognition · Computer Science 2025-05-01 Jiaming Zhang , Yutao Cui , Gangshan Wu , Limin Wang

Referring video object segmentation (RVOS) relies on natural language expressions to segment target objects in video. In this year, LSVOS Challenge RVOS Track replaced the origin YouTube-RVOS benchmark with MeViS. MeViS focuses on referring…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Hao Fang , Feiyu Pan , Xiankai Lu , Wei Zhang , Runmin Cong