English
Related papers

Related papers: Video Object Segmentation with Dynamic Query Modul…

200 papers

Conventional few-shot object segmentation methods learn object segmentation from a few labelled support images with strongly labelled segmentation masks. Recent work has shown to perform on par with weaker levels of supervision in terms of…

Computer Vision and Pattern Recognition · Computer Science 2019-12-20 Mennatullah Siam , Naren Doraiswamy , Boris N. Oreshkin , Hengshuai Yao , Martin Jagersand

Moving object segmentation based on LiDAR is a crucial and challenging task for autonomous driving and mobile robotics. Most approaches explore spatio-temporal information from LiDAR sequences to predict moving objects in the current frame.…

Computer Vision and Pattern Recognition · Computer Science 2024-12-12 Zhiheng Li , Yubo Cui , Jiexi Zhong , Zheng Fang

The recent transformer-based models have dominated the Referring Video Object Segmentation (RVOS) task due to the superior performance. Most prior works adopt unified DETR framework to generate segmentation masks in query-to-instance…

Computer Vision and Pattern Recognition · Computer Science 2024-01-02 Zhuoyan Luo , Yicheng Xiao , Yong Liu , Yitong Wang , Yansong Tang , Xiu Li , Yujiu Yang

Existing semi-supervised video object segmentation methods either focus on temporal feature matching or spatial-temporal feature modeling. However, they do not address the issues of sufficient target interaction and efficient parallel…

Computer Vision and Pattern Recognition · Computer Science 2024-04-10 Deshui Miao , Xin Li , Zhenyu He , Huchuan Lu , Ming-Hsuan Yang

We present READMem (Robust Embedding Association for a Diverse Memory), a modular framework for semi-automatic video object segmentation (sVOS) methods designed to handle unconstrained videos. Contemporary sVOS works typically aggregate…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Stéphane Vujasinović , Sebastian Bullinger , Stefan Becker , Norbert Scherer-Negenborn , Michael Arens , Rainer Stiefelhagen

Matching-based networks have achieved state-of-the-art performance for video object segmentation (VOS) tasks by storing every-k frames in an external memory bank for future inference. Storing the intermediate frames' predictions provides…

Computer Vision and Pattern Recognition · Computer Science 2022-04-15 Ali Pourganjalikhan , Charalambos Poullis

This paper strives for motion expressions guided video segmentation, which focuses on segmenting objects in video content based on a sentence describing the motion of the objects. Existing referring video object datasets typically focus on…

Computer Vision and Pattern Recognition · Computer Science 2023-08-17 Henghui Ding , Chang Liu , Shuting He , Xudong Jiang , Chen Change Loy

Referring video object segmentation (RVOS) is a task that aims to segment the target object in all video frames based on a sentence describing the object. Although existing RVOS methods have achieved significant performance, they depend on…

Computer Vision and Pattern Recognition · Computer Science 2023-12-18 Wangbo Zhao , Kepan Nan , Songyang Zhang , Kai Chen , Dahua Lin , Yang You

Recently, Space-Time Memory Network (STM) based methods have achieved state-of-the-art performance in semi-supervised video object segmentation (VOS). A crucial problem in this task is how to model the dependency both among different frames…

Computer Vision and Pattern Recognition · Computer Science 2021-09-21 Jianbiao Mei , Mengmeng Wang , Yeneng Lin , Yi Yuan , Yong Liu

In this paper we introduce a Transformer-based approach to video object segmentation (VOS). To address compounding error and scalability issues of prior work, we propose a scalable, end-to-end method for VOS called Sparse Spatiotemporal…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Brendan Duke , Abdalla Ahmed , Christian Wolf , Parham Aarabi , Graham W. Taylor

We present an approach to semi-supervised video object segmentation, in the context of the DAVIS 2017 challenge. Our approach combines category-based object detection, category-independent object appearance segmentation and temporal object…

Computer Vision and Pattern Recognition · Computer Science 2017-07-21 Gilad Sharir , Eddie Smolyansky , Itamar Friedman

Semi-supervised video object segmentation (VOS) aims to track the designated objects present in the initial frame of a video at the pixel level. To fully exploit the appearance information of an object, pixel-level feature matching is…

Computer Vision and Pattern Recognition · Computer Science 2021-11-15 Suhwan Cho , Heansung Lee , Minjung Kim , Sungjun Jang , Sangyoun Lee

Motion expression video segmentation is designed to segment objects in accordance with the input motion expressions. In contrast to the conventional Referring Video Object Segmentation (RVOS), it places emphasis on motion as well as…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Hao Fang , Runmin Cong , Xiankai Lu , Zhiyang Chen , Wei Zhang

Self-supervised Object Segmentation (SOS) aims to segment objects without any annotations. Under conditions of multi-camera inputs, the structural, textural and geometrical consistency among each view can be leveraged to achieve…

Computer Vision and Pattern Recognition · Computer Science 2025-01-20 Xiaoyun Zheng , Liwei Liao , Jianbo Jiao , Feng Gao , Ronggang Wang

Referring video object segmentation (RVOS) aims to segment the target instance in a video, referred by a text expression. Conventional approaches are mostly supervised learning, requiring expensive pixel-level mask annotations. To tackle…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Miaojing Shi , Jun Huang , Zijie Yue , Hanli Wang

The aim of audio-visual segmentation (AVS) is to precisely differentiate audible objects within videos down to the pixel level. Traditional approaches often tackle this challenge by combining information from various modalities, where the…

Computer Vision and Pattern Recognition · Computer Science 2023-12-20 Dawei Hao , Yuxin Mao , Bowen He , Xiaodong Han , Yuchao Dai , Yiran Zhong

Referring Video Object Segmentation (R-VOS) methods face challenges in maintaining consistent object segmentation due to temporal context variability and the presence of other visually similar objects. We propose an end-to-end R-VOS…

Computer Vision and Pattern Recognition · Computer Science 2024-10-14 Bo Miao , Mohammed Bennamoun , Yongsheng Gao , Mubarak Shah , Ajmal Mian

We propose a self-supervised spatio-temporal matching method, coined Motion-Aware Mask Propagation (MAMP), for video object segmentation. MAMP leverages the frame reconstruction task for training without the need for annotations. During…

Computer Vision and Pattern Recognition · Computer Science 2021-10-29 Bo Miao , Mohammed Bennamoun , Yongsheng Gao , Ajmal Mian

This paper tackles the problem of semi-supervised video object segmentation on resource-constrained devices, such as mobile phones. We formulate this problem as a distillation task, whereby we demonstrate that small space-time-memory…

Computer Vision and Pattern Recognition · Computer Science 2023-03-15 Roy Miles , Mehmet Kerim Yucel , Bruno Manganelli , Albert Saa-Garriga

This work addresses motion-guided few-shot video object segmentation (FSVOS), which aims to segment dynamic objects in videos based on a few annotated examples with the same motion patterns. Existing FSVOS datasets and methods typically…

Computer Vision and Pattern Recognition · Computer Science 2025-07-30 Kaining Ying , Hengrui Hu , Henghui Ding