English
Related papers

Related papers: LSVOS Challenge Report: Large-scale Complex and Lo…

200 papers

We present the 2017 DAVIS Challenge on Video Object Segmentation, a public dataset, benchmark, and competition specifically designed for the task of video object segmentation. Following the footsteps of other successful initiatives, such as…

Computer Vision and Pattern Recognition · Computer Science 2018-03-02 Jordi Pont-Tuset , Federico Perazzi , Sergi Caelles , Pablo Arbeláez , Alex Sorkine-Hornung , Luc Van Gool

Pixel-level Video Understanding in the Wild Challenge (PVUW) focus on complex video understanding. In this CVPR 2024 workshop, we add two new tracks, Complex Video Object Segmentation Track based on MOSE dataset and Motion Expression guided…

Video object segmentation (VOS) is a crucial task in computer vision, but current VOS methods struggle with complex scenes and prolonged object motions. To address these challenges, the MOSE dataset aims to enhance object recognition and…

Computer Vision and Pattern Recognition · Computer Science 2024-08-30 Deshui Miao , Yameng Gu , Xin Li , Zhenyu He , Yaowei Wang , Ming-Hsuan Yang

Video object segmentation (VOS) aims at segmenting a particular object throughout the entire video clip sequence. The state-of-the-art VOS methods have achieved excellent performance (e.g., 90+% J&F) on existing datasets. However, since the…

Computer Vision and Pattern Recognition · Computer Science 2023-10-24 Henghui Ding , Chang Liu , Shuting He , Xudong Jiang , Philip H. S. Torr , Song Bai

Referring video object segmentation (RVOS) is a challenging task that requires the model to segment the object in a video given the language description. MeViS is a recently proposed dataset that contains motion expressions of the target…

Computer Vision and Pattern Recognition · Computer Science 2025-04-02 Haobo Yuan , Tao Zhang , Xiangtai Li , Lu Qi , Zilong Huang , Shilin Xu , Jiashi Feng , Ming-Hsuan Yang

Video instance segmentation is a challenging task that serves as the cornerstone of numerous downstream applications, including video editing and autonomous driving. In this report, we present further improvements to the SOTA VIS method,…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Tao Zhang , Xingye Tian , Yikang Zhou , Yu Wu , Shunping Ji , Cilin Yan , Xuebo Wang , Xin Tao , Yuan Zhang , Pengfei Wan

Existing Video Object Segmentation (VOS) relies on explicit user instructions, such as categories, masks, or short phrases, restricting their ability to perform complex video segmentation requiring reasoning with world knowledge. In this…

Computer Vision and Pattern Recognition · Computer Science 2024-07-17 Cilin Yan , Haochen Wang , Shilin Yan , Xiaolong Jiang , Yao Hu , Guoliang Kang , Weidi Xie , Efstratios Gavves

Visual object tracking and segmentation in omnidirectional videos are challenging due to the wide field-of-view and large spherical distortion brought by 360{\deg} images. To alleviate these problems, we introduce a novel representation,…

Computer Vision and Pattern Recognition · Computer Science 2025-06-23 Yinzhe Xu , Huajian Huang , Yingshu Chen , Sai-Kit Yeung

The task of referring video object segmentation aims to segment the object in the frames of a given video to which the referring expressions refer. Previous methods adopt multi-stage approach and design complex pipelines to obtain promising…

Computer Vision and Pattern Recognition · Computer Science 2023-01-02 Zhiwei Hu , Bo Chen , Yuan Gao , Zhilong Ji , Jinfeng Bai

Referring video object segmentation (RVOS) has recently generated great popularity in computer vision due to its widespread applications. Existing RVOS setting contains elaborately trimmed videos, with text-referred objects always appearing…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Mingqi Gao , Jinyu Yang , Jingnan Luo , Xiantong Zhen , Jungong Han , Giovanni Montana , Feng Zheng

Semi-supervised Video Object Segmentation aims to segment a specified target throughout a video sequence, initialized by a first-frame mask. Previous methods rely heavily on appearance-based pattern matching and thus exhibit limited…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Zhixiong Zhang , Shuangrui Ding , Xiaoyi Dong , Yuhang Zang , Yuhang Cao , Jiaqi Wang

This report provides a comprehensive overview of the 4th Pixel-level Video Understanding in the Wild (PVUW) Challenge, held in conjunction with CVPR 2025. It summarizes the challenge outcomes, participating methodologies, and future…

Referring video object segmentation (RVOS) relies on natural language expressions to segment target objects in video. In this year, LSVOS Challenge RVOS Track replaced the origin YouTube-RVOS benchmark with MeViS. MeViS focuses on referring…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Hao Fang , Feiyu Pan , Xiankai Lu , Wei Zhang , Runmin Cong

Video Instance Segmentation (VIS) aims at segmenting and categorizing objects in videos from a closed set of training categories, lacking the generalization ability to handle novel categories in real-world videos. To address this…

Computer Vision and Pattern Recognition · Computer Science 2023-08-08 Haochen Wang , Cilin Yan , Shuai Wang , Xiaolong Jiang , XU Tang , Yao Hu , Weidi Xie , Efstratios Gavves

Current state-of-the-art Video Object Segmentation (VOS) methods rely on dense per-object mask annotations both during training and testing. This requires time-consuming and costly video annotation mechanisms. We propose a novel Point-VOS…

Computer Vision and Pattern Recognition · Computer Science 2024-06-11 Idil Esen Zulfikar , Sabarinath Mahadevan , Paul Voigtlaender , Bastian Leibe

Video object segmentation (VOS) describes the task of segmenting a set of objects in each frame of a video. In the semi-supervised setting, the first mask of each object is provided at test time. Following the one-shot principle,…

Computer Vision and Pattern Recognition · Computer Science 2020-12-04 Tim Meinhardt , Laura Leal-Taixe

Video Instance Segmentation (VIS) is a multi-task problem performing detection, segmentation, and tracking simultaneously. Extended from image set applications, video data additionally induces the temporal information, which, if handled…

Computer Vision and Pattern Recognition · Computer Science 2021-07-12 Thuy C. Nguyen , Tuan N. Tang , Nam LH. Phan , Chuong H. Nguyen , Masayuki Yamazaki , Masao Yamanaka

Video object segmentation (VOS) is a highly challenging problem since the initial mask, defining the target object, is only given at test-time. The main difficulty is to effectively handle appearance changes and similar background objects,…

Computer Vision and Pattern Recognition · Computer Science 2020-04-01 Andreas Robinson , Felix Järemo Lawin , Martin Danelljan , Fahad Shahbaz Khan , Michael Felsberg

We propose Segment Concept (SeC), a concept-driven video object segmentation (VOS) framework that shifts from conventional feature matching to the progressive construction and utilization of high-level, object-centric representations. SeC…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Zhixiong Zhang , Shuangrui Ding , Xiaoyi Dong , Songxin He , Jianfan Lin , Junsong Tang , Yuhang Zang , Yuhang Cao , Dahua Lin , Jiaqi Wang

We present the 2018 DAVIS Challenge on Video Object Segmentation, a public competition specifically designed for the task of video object segmentation. It builds upon the DAVIS 2017 dataset, which was presented in the previous edition of…

Computer Vision and Pattern Recognition · Computer Science 2018-03-28 Sergi Caelles , Alberto Montes , Kevis-Kokitsi Maninis , Yuhua Chen , Luc Van Gool , Federico Perazzi , Jordi Pont-Tuset