English
Related papers

Related papers: STSeg-Complex Video Object Segmentation: The 1st S…

200 papers

This technical report presents our solution for the CVPR 2026 UG2+ Challenge Track 3: Dynamic Object Segmentation in Turbulence (DOST). We design a training-free multi-signal segmentation pipeline that combines pretrained motion estimation,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Bolian Peng , Ying Tang , Xu Liu , Long Sun , Xiaoqiang Lu

Current referring video object segmentation (R-VOS) techniques extract conditional kernels from encoded (low-resolution) vision-language features to segment the decoded high-resolution features. We discovered that this causes significant…

Computer Vision and Pattern Recognition · Computer Science 2023-07-26 Bo Miao , Mohammed Bennamoun , Yongsheng Gao , Ajmal Mian

The goal of this paper is to discover, segment, and track independently moving objects in complex visual scenes. Previous approaches have explored the use of optical flow for motion segmentation, leading to imperfect predictions due to…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Junyu Xie , Weidi Xie , Andrew Zisserman

Audio-based video object segmentation aims to locate and segment objects in videos conditioned on audio cues, requiring precise understanding of both appearance and motion. Recent audio-driven video segmentation methods extend MLLMs by…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Zhiyu Wang , Xudong Kang , Shutao Li

Visual anomaly detection, an important problem in computer vision, is usually formulated as a one-class classification and segmentation task. The student-teacher (S-T) framework has proved to be effective in solving this challenge. However,…

Computer Vision and Pattern Recognition · Computer Science 2023-03-22 Xuan Zhang , Shiyu Li , Xi Li , Ping Huang , Jiulong Shan , Ting Chen

Animals have evolved highly functional visual systems to understand motion, assisting perception even under complex environments. In this paper, we work towards developing a computer vision system able to segment objects by exploiting…

Computer Vision and Pattern Recognition · Computer Science 2021-08-12 Charig Yang , Hala Lamdouar , Erika Lu , Andrew Zisserman , Weidi Xie

Video instance segmentation, also known as multi-object tracking and segmentation, is an emerging computer vision research area introduced in 2019, aiming at detecting, segmenting, and tracking instances in videos simultaneously. By…

Computer Vision and Pattern Recognition · Computer Science 2023-10-20 Chenhao Xu , Chang-Tsun Li , Yongjian Hu , Chee Peng Lim , Douglas Creighton

Modern one-stage video instance segmentation networks suffer from two limitations. First, convolutional features are neither aligned with anchor boxes nor with ground-truth bounding boxes, reducing the mask sensitivity to spatial location.…

Computer Vision and Pattern Recognition · Computer Science 2021-04-13 Minghan Li , Shuai Li , Lida Li , Lei Zhang

Multi-object tracking (MOT) has profound applications in a variety of fields, including surveillance, sports analytics, self-driving, and cooperative robotics. Despite considerable advancements, existing MOT methodologies tend to falter…

Computer Vision and Pattern Recognition · Computer Science 2023-12-20 Hamza Mukhtar , Muhammad Usman Ghani Khan

Video segmentation is essential for advancing robotics and autonomous driving, particularly in open-world settings where continuous perception and object association across video frames are critical. While the Segment Anything Model (SAM)…

Computer Vision and Pattern Recognition · Computer Science 2024-10-14 Pinxue Guo , Zixu Zhao , Jianxiong Gao , Chongruo Wu , Tong He , Zheng Zhang , Tianjun Xiao , Wenqiang Zhang

We introduce a method for simultaneously classifying, segmenting and tracking object instances in a video sequence. Our method, named MaskProp, adapts the popular Mask R-CNN to video by adding a mask propagation branch that propagates…

Computer Vision and Pattern Recognition · Computer Science 2021-07-13 Gedas Bertasius , Lorenzo Torresani

Semi-supervised video object segmentation (Semi-VOS), which requires only annotating the first frame of a video to segment future frames, has received increased attention recently. Among existing pipelines, the memory-matching-based one is…

Computer Vision and Pattern Recognition · Computer Science 2023-10-24 Weihao Lin , Tao Chen , Chong Yu

Learning long-term spatial-temporal features are critical for many video analysis tasks. However, existing video segmentation methods predominantly rely on static image segmentation techniques, and methods capturing temporal dependency for…

Computer Vision and Pattern Recognition · Computer Science 2018-09-11 Ning Xu , Linjie Yang , Yuchen Fan , Dingcheng Yue , Yuchen Liang , Jianchao Yang , Thomas Huang

Video object segmentation is challenging yet important in a wide variety of applications for video analysis. Recent works formulate video object segmentation as a prediction task using deep nets to achieve appealing state-of-the-art…

Computer Vision and Pattern Recognition · Computer Science 2018-09-05 Yuan-Ting Hu , Jia-Bin Huang , Alexander G. Schwing

Video instance segmentation (VIS) is the task that requires simultaneously classifying, segmenting and tracking object instances of interest in video. Recent methods typically develop sophisticated pipelines to tackle this task. Here, we…

Computer Vision and Pattern Recognition · Computer Science 2021-10-11 Yuqing Wang , Zhaoliang Xu , Xinlong Wang , Chunhua Shen , Baoshan Cheng , Hao Shen , Huaxia Xia

Pixel-level segmentation is essential in remote sensing, where foundational vision models like CLIP and Segment Anything Model(SAM) have demonstrated significant capabilities in zero-shot segmentation tasks. Despite their advances,…

Multimedia · Computer Science 2025-03-12 Xing Zi , Kairui Jin , Xian Tao , Jun Li , Ali Braytee , Rajiv Ratn Shah , Mukesh Prasad

We present an approach to semi-supervised video object segmentation, in the context of the DAVIS 2017 challenge. Our approach combines category-based object detection, category-independent object appearance segmentation and temporal object…

Computer Vision and Pattern Recognition · Computer Science 2017-07-21 Gilad Sharir , Eddie Smolyansky , Itamar Friedman

Identifying moving objects is a crucial capability for autonomous navigation, consistent map generation, and future trajectory prediction of objects. In this paper, we propose a novel network that addresses the challenge of segmenting…

Computer Vision and Pattern Recognition · Computer Science 2023-03-08 Neng Wang , Chenghao Shi , Ruibin Guo , Huimin Lu , Zhiqiang Zheng , Xieyuanli Chen

Spatial semantic segmentation of sound scenes (S5) involves the accurate identification of active sound classes and the precise separation of their sources from complex acoustic mixtures. Conventional systems rely on a two-stage pipeline -…

Sound · Computer Science 2025-07-24 Tobias Morocutti , Jonathan Greif , Paul Primus , Florian Schmid , Gerhard Widmer

Recently, automated medical image segmentation methods based on deep learning have achieved great success. However, they heavily rely on large annotated datasets, which are costly and time-consuming to acquire. Few-shot learning aims to…

Artificial Intelligence · Computer Science 2024-08-20 Jiayu Huo , Ruiqiang Xiao , Haotian Zheng , Yang Liu , Sebastien Ourselin , Rachel Sparks