English
Related papers

Related papers: 3rd Place Solution for MOSE Track in CVPR 2024 PVU…

200 papers

Current benchmarks for video segmentation are limited to annotating only salient objects (i.e., foreground instances). Despite their impressive architectural designs, previous works trained on these benchmarks have struggled to adapt to…

Computer Vision and Pattern Recognition · Computer Science 2024-12-04 Sangbeom Lim , Seongchan Kim , Seungjun An , Seokju Cho , Paul Hongsuck Seo , Seungryong Kim

Referring Video Object Segmentation (R-VOS) methods face challenges in maintaining consistent object segmentation due to temporal context variability and the presence of other visually similar objects. We propose an end-to-end R-VOS…

Computer Vision and Pattern Recognition · Computer Science 2024-10-14 Bo Miao , Mohammed Bennamoun , Yongsheng Gao , Mubarak Shah , Ajmal Mian

Online video object segmentation is a challenging task as it entails to process the image sequence timely and accurately. To segment a target object through the video, numerous CNN-based methods have been developed by heavily finetuning on…

Computer Vision and Pattern Recognition · Computer Science 2018-06-07 Jingchun Cheng , Yi-Hsuan Tsai , Wei-Chih Hung , Shengjin Wang , Ming-Hsuan Yang

The human visual system processes images with varied degrees of resolution, with the fovea, a small portion of the retina, capturing the highest acuity region, which gradually declines toward the field of view's periphery. However, the…

Computer Vision and Pattern Recognition · Computer Science 2023-04-13 Beatriz Paula , Plinio Moreno

Audio-based Referring Video Object Segmentation (ARVOS) requires grounding audio queries into pixel-level object masks over time, posing challenges in bridging acoustic signals with spatio-temporal visual representations. In this report, we…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Jihwan Hong , Jaeyoung Do

Amodal perception requires inferring the full shape of an object that is partially occluded. This task is particularly challenging on two levels: (1) it requires more information than what is contained in the instant retina or imaging…

Computer Vision and Pattern Recognition · Computer Science 2022-10-25 Jian Yao , Yuxin Hong , Chiyu Wang , Tianjun Xiao , Tong He , Francesco Locatello , David Wipf , Yanwei Fu , Zheng Zhang

The appearance of an object can be fleeting when it transforms. As eggs are broken or paper is torn, their color, shape and texture can change dramatically, preserving virtually nothing of the original except for the identity itself. Yet,…

Computer Vision and Pattern Recognition · Computer Science 2023-03-29 Pavel Tokmakov , Jie Li , Adrien Gaidon

We present a deep learning method for the interactive video object segmentation. Our method is built upon two core operations, interaction and propagation, and each operation is conducted by Convolutional Neural Networks. The two networks…

Computer Vision and Pattern Recognition · Computer Science 2019-05-03 Seoung Wug Oh , Joon-Young Lee , Ning Xu , Seon Joo Kim

This report summarizes the objectives, datasets, and top-performing methodologies of the 2026 Pixel-level Video Understanding in the Wild (PVUW) Challenge, hosted at CVPR 2026, which evaluates state-of-the-art models under highly…

This paper tackles the problem of video object segmentation, given some user annotation which indicates the object of interest. The problem is formulated as pixel-wise retrieval in a learned embedding space: we embed pixels of the same…

Computer Vision and Pattern Recognition · Computer Science 2018-04-10 Yuhua Chen , Jordi Pont-Tuset , Alberto Montes , Luc Van Gool

This technical report explores the MOSEv2 track of the PVUW 2026 Challenge, which targets complex semi-supervised video object segmentation. Built on SAM~3, we develop an automatic re-prompting framework to improve robustness under target…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Mingqi Gao , Sijie Li , Jungong Han

This paper proposes a framework for the interactive video object segmentation (VOS) in the wild where users can choose some frames for annotations iteratively. Then, based on the user annotations, a segmentation algorithm refines the masks.…

Computer Vision and Pattern Recognition · Computer Science 2021-06-18 Zhaoyuan Yin , Jia Zheng , Weixin Luo , Shenhan Qian , Hanling Zhang , Shenghua Gao

Semi-supervised video object segmentation (VOS) has been largely driven by space-time memory (STM) networks, which store past frame features in a spatiotemporal memory to segment the current frame via softmax attention. However, STM…

Computer Vision and Pattern Recognition · Computer Science 2024-11-06 Qin Liu , Jianfeng Wang , Zhengyuan Yang , Linjie Li , Kevin Lin , Marc Niethammer , Lijuan Wang

Semi-supervised video object segmentation (VOS) is a task that involves predicting a target object in a video when the ground truth segmentation mask of the target object is given in the first frame. Recently, space-time memory networks…

Computer Vision and Pattern Recognition · Computer Science 2020-07-17 Hongje Seong , Junhyuk Hyun , Euntai Kim

In this report, we introduce our (pretty straightforard) two-step "detect-then-match" video instance segmentation method. The first step performs instance segmentation for each frame to get a large number of instance mask proposals. The…

Computer Vision and Pattern Recognition · Computer Science 2021-11-03 Yuming Du , Wen Guo , Yang Xiao , Vincent Lepetit

We propose an approach for Open-World Instance Segmentation (OWIS), a task that aims to segment arbitrary unknown objects in images by generalizing from a limited set of annotated object classes during training. Our Segment Object System…

Computer Vision and Pattern Recognition · Computer Science 2024-09-24 Christian Wilms , Tim Rolff , Maris Hillemann , Robert Johanson , Simone Frintrop

Few-Shot Video Object Segmentation (FSVOS) aims to segment objects in a query video with the same category defined by a few annotated support images. However, this task was seldom explored. In this work, based on IPMT, a state-of-the-art…

Computer Vision and Pattern Recognition · Computer Science 2023-09-21 Nian Liu , Kepan Nan , Wangbo Zhao , Yuanwei Liu , Xiwen Yao , Salman Khan , Hisham Cholakkal , Rao Muhammad Anwer , Junwei Han , Fahad Shahbaz Khan

Multi-instance video object segmentation is to segment specific instances throughout a video sequence in pixel level, given only an annotated first frame. In this paper, we implement an effective fully convolutional networks with U-Net…

Computer Vision and Pattern Recognition · Computer Science 2019-05-21 Heguang Liu , Jingle Jiang

The performance of promptable video object segmentation (PVOS) models substantially degrades under input corruptions, which prevents PVOS deployment in safety-critical domains. This paper offers the first comprehensive study on robust PVOS…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Sohyun Lee , Yeho Gwon , Lukas Hoyer , Konrad Schindler , Christos Sakaridis , Suha Kwak

The encoder-decoder based methods for semi-supervised video object segmentation (Semi-VOS) have received extensive attention due to their superior performances. However, most of them have complex intermediate networks which generate strong…

Computer Vision and Pattern Recognition · Computer Science 2020-06-03 Suhwan Cho , MyeongAh Cho , Tae-young Chung , Heansung Lee , Sangyoun Lee