English
Related papers

Related papers: Iteratively Selecting an Easy Reference Frame Make…

200 papers

Delving into the realm of egocentric vision, the advancement of referring video object segmentation (RVOS) stands as pivotal in understanding human activities. However, existing RVOS task primarily relies on static attributes such as object…

Computer Vision and Pattern Recognition · Computer Science 2024-07-11 Liangyang Ouyang , Ruicong Liu , Yifei Huang , Ryosuke Furuta , Yoichi Sato

Egocentric Referring Video Object Segmentation (Ego-RVOS) aims to segment the specific object actively involved in a human action, as described by a language query, within first-person videos. This task is critical for understanding…

Computer Vision and Pattern Recognition · Computer Science 2026-01-01 Haijing Liu , Zhiyuan Song , Hefeng Wu , Tao Pu , Keze Wang , Liang Lin

Existing video instance segmentation (VIS) approaches generally follow a closed-world assumption, where only seen category instances are identified and spatio-temporally segmented at inference. Open-world formulation relaxes the close-world…

Computer Vision and Pattern Recognition · Computer Science 2023-04-04 Omkar Thawakar , Sanath Narayan , Hisham Cholakkal , Rao Muhammad Anwer , Salman Khan , Jorma Laaksonen , Mubarak Shah , Fahad Shahbaz Khan

We propose FlowCut, a simple and capable method for unsupervised video instance segmentation consisting of a three-stage framework to construct a high-quality video dataset with pseudo labels. To our knowledge, our work is the first attempt…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Alp Eren Sari , Paolo Favaro

Current top-leading solutions for video object segmentation (VOS) typically follow a matching-based regime: for each query frame, the segmentation mask is inferred according to its correspondence to previously processed and the first…

Computer Vision and Pattern Recognition · Computer Science 2023-04-14 Yurong Zhang , Liulei Li , Wenguan Wang , Rong Xie , Li Song , Wenjun Zhang

Handling occlusion remains a significant challenge for video instance-level tasks like Multiple Object Tracking (MOT) and Video Instance Segmentation (VIS). In this paper, we propose a novel framework, Amodal-Aware Video Instance…

Computer Vision and Pattern Recognition · Computer Science 2025-04-11 Minh Tran , Thang Pham , Winston Bounsavy , Tri Nguyen , Ngan Le

Referring video object segmentation (RVOS) is a challenging task that requires the model to segment the object in a video given the language description. MeViS is a recently proposed dataset that contains motion expressions of the target…

Computer Vision and Pattern Recognition · Computer Science 2025-04-02 Haobo Yuan , Tao Zhang , Xiangtai Li , Lu Qi , Zilong Huang , Shilin Xu , Jiashi Feng , Ming-Hsuan Yang

Significant progress has been made in Video Object Segmentation (VOS), the video object tracking task in its finest level. While the VOS task can be naturally decoupled into image semantic segmentation and video object tracking,…

Computer Vision and Pattern Recognition · Computer Science 2020-07-14 Xuhua Huang , Jiarui Xu , Yu-Wing Tai , Chi-Keung Tang

Weakly-supervised semantic segmentation under image tags supervision is a challenging task as it directly associates high-level semantic to low-level appearance. To bridge this gap, in this paper, we propose an iterative bottom-up and…

Computer Vision and Pattern Recognition · Computer Science 2018-06-13 Xiang Wang , Shaodi You , Xi Li , Huimin Ma

While current methods for interactive Video Object Segmentation (iVOS) rely on scribble-based interactions to generate precise object masks, we propose a Click-based interactive Video Object Segmentation (CiVOS) framework to simplify the…

Computer Vision and Pattern Recognition · Computer Science 2022-12-20 Stephane Vujasinovic , Sebastian Bullinger , Stefan Becker , Norbert Scherer-Negenborn , Michael Arens , Rainer Stiefelhagen

Video foreground segmentation (VFS) is an important computer vision task wherein one aims to segment the objects under motion from the background. Most of the current methods are image-based, i.e., rely only on spatial cues while ignoring…

Computer Vision and Pattern Recognition · Computer Science 2024-02-05 Praveen Kumar Pokala , Jaya Sai Kiran Patibandla , Naveen Kumar Pandey , Balakrishna Reddy Pailla

Moving object segmentation plays a crucial role in understanding dynamic scenes involving multiple moving objects, while the difficulties lie in taking into account both spatial texture structures and temporal motion cues. Existing methods…

Computer Vision and Pattern Recognition · Computer Science 2025-02-19 Zhexiong Wan , Bin Fan , Le Hui , Yuchao Dai , Gim Hee Lee

We introduce a novel framework called RefineVIS for Video Instance Segmentation (VIS) that achieves good object association between frames and accurate segmentation masks by iteratively refining the representations using sequence context.…

Computer Vision and Pattern Recognition · Computer Science 2023-06-09 Andre Abrantes , Jiang Wang , Peng Chu , Quanzeng You , Zicheng Liu

Unsupervised multi-object scene decomposition is a fast-emerging problem in representation learning. Despite significant progress in static scenes, such models are unable to leverage important dynamic cues present in video. We propose a…

Computer Vision and Pattern Recognition · Computer Science 2020-06-29 Polina Zablotskaia , Edoardo A. Dominici , Leonid Sigal , Andreas M. Lehrmann

Referring Video Object Segmentation (RVOS) aims to segment target objects in videos based on natural language descriptions. However, fixed keyframe-based approaches that couple a vision language model with a separate propagation module…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Jihwan Hong , Jaeyoung Do

In this work we present a novel solution for Video Instance Segmentation(VIS), that is automatically generating instance level segmentation masks along with object class and tracking them in a video. Our method improves the masks from…

Computer Vision and Pattern Recognition · Computer Science 2021-06-22 Vidit Goel , Jiachen Li , Shubhika Garg , Harsh Maheshwari , Humphrey Shi

Unsupervised video object segmentation has often been tackled by methods based on recurrent neural networks and optical flow. Despite their complexity, these kinds of approaches tend to favour short-term temporal dependencies and are thus…

Computer Vision and Pattern Recognition · Computer Science 2019-10-25 Zhao Yang , Qiang Wang , Luca Bertinetto , Weiming Hu , Song Bai , Philip H. S. Torr

Referring video object segmentation (RVOS) aims at segmenting an object in a video following human instruction. Current state-of-the-art methods fall into an offline pattern, in which each clip independently interacts with text embedding…

Computer Vision and Pattern Recognition · Computer Science 2023-07-19 Dongming Wu , Tiancai Wang , Yuang Zhang , Xiangyu Zhang , Jianbing Shen

Video Object Segmentation (VOS) is foundational to numerous computer vision applications, including surveillance, autonomous driving, robotics and generative video editing. However, existing VOS models often struggle with precise mask…

Computer Vision and Pattern Recognition · Computer Science 2025-07-28 Elham Soltani Kazemi , Imad Eddine Toubal , Gani Rahmon , Jaired Collins , K. Palaniappan

This report presents an Audio-aware Referring Video Object Segmentation (Ref-VOS) pipeline tailored to the MEVIS\_Audio setting, where the referring expression is provided in spoken form rather than as clean text. Compared with a standard…

Sound · Computer Science 2026-04-22 Deshui Miao , Yameng Gu , Chao Yang , Xin Li , Haijun Zhang , Ming-Hsuan Yang