English
Related papers

Related papers: MeViS: A Large-scale Benchmark for Video Segmentat…

200 papers

This paper proposes key instance selection based on video saliency covering objectness and dynamics for unsupervised video object segmentation (UVOS). Our method takes frames sequentially and extracts object proposals with corresponding…

Computer Vision and Pattern Recognition · Computer Science 2019-07-29 Donghyeon Cho , Sungeun Hong , Sungil Kang , Jiwon Kim

In recent years, online Video Instance Segmentation (VIS) methods have shown remarkable advancement with their powerful query-based detectors. Utilizing the output queries of the detector at the frame-level, these methods achieve high…

Computer Vision and Pattern Recognition · Computer Science 2024-03-11 Hanjung Kim , Jaehyun Kang , Miran Heo , Sukjun Hwang , Seoung Wug Oh , Seon Joo Kim

Video instance segmentation (VIS) is a challenging vision task that aims to detect, segment, and track objects in videos. Conventional VIS methods rely on densely-annotated object masks which are expensive. We reduce the human annotations…

Computer Vision and Pattern Recognition · Computer Science 2024-04-03 Shuaiyi Huang , De-An Huang , Zhiding Yu , Shiyi Lan , Subhashree Radhakrishnan , Jose M. Alvarez , Abhinav Shrivastava , Anima Anandkumar

We study the problem of segmenting moving objects in unconstrained videos. Given a video, the task is to segment all the objects that exhibit independent motion in at least one frame. We formulate this as a learning problem and design our…

Computer Vision and Pattern Recognition · Computer Science 2017-12-05 Pavel Tokmakov , Cordelia Schmid , Karteek Alahari

Multi-instance video object segmentation is to segment specific instances throughout a video sequence in pixel level, given only an annotated first frame. In this paper, we implement an effective fully convolutional networks with U-Net…

Computer Vision and Pattern Recognition · Computer Science 2019-05-21 Heguang Liu , Jingle Jiang

In autonomous driving, accurately distinguishing between static and moving objects is crucial for the autonomous driving system. When performing the motion object segmentation (MOS) task, effectively leveraging motion information from…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Xiaoyu Tang , Zeyu Chen , Jintao Cheng , Xieyuanli Chen , Jin Wu , Bohuan Xue

Referring Video Object Segmentation (RVOS) aims to segment specific objects in a video according to textual descriptions. We observe that recent RVOS approaches often place excessive emphasis on feature extraction and temporal modeling,…

Computer Vision and Pattern Recognition · Computer Science 2025-08-20 Ruixin Zhang , Jiaqing Fan , Yifan Liao , Qian Qiao , Fanzhang Li

We address Unsupervised Video Object Segmentation (UVOS), the task of automatically generating accurate pixel masks for salient objects in a video sequence and of tracking these objects consistently through time, without any input about…

Computer Vision and Pattern Recognition · Computer Science 2020-01-16 Jonathon Luiten , Idil Esen Zulfikar , Bastian Leibe

Referring Video Object Segmentation (RVOS) aims to segment target objects in videos based on natural language descriptions. However, fixed keyframe-based approaches that couple a vision language model with a separate propagation module…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Jihwan Hong , Jaeyoung Do

Video object segmentation (VOS) aims at pixel-level object tracking given only the annotations in the first frame. Due to the large visual variations of objects in video and the lack of training samples, it remains a difficult task despite…

Computer Vision and Pattern Recognition · Computer Science 2019-07-05 Qiang Zhou , Zilong Huang , Lichao Huang , Yongchao Gong , Han Shen , Chang Huang , Wenyu Liu , Xinggang Wang

Referring video object segmentation (RVOS) aims at segmenting an object in a video following human instruction. Current state-of-the-art methods fall into an offline pattern, in which each clip independently interacts with text embedding…

Computer Vision and Pattern Recognition · Computer Science 2023-07-19 Dongming Wu , Tiancai Wang , Yuang Zhang , Xiangyu Zhang , Jianbing Shen

This report presents an overview of the 7th Large-scale Video Object Segmentation (LSVOS) Challenge held in conjunction with ICCV 2025. Besides the two traditional tracks of LSVOS that jointly target robustness in realistic video scenarios:…

Video object segmentation can be considered as one of the most challenging computer vision problems. Indeed, so far, no existing solution is able to effectively deal with the peculiarities of real-world videos, especially in cases of…

Computer Vision and Pattern Recognition · Computer Science 2016-01-06 Simone Palazzo , Concetto Spampinato , Daniela Giordano

Recent advances in multimodal large language models (MLLMs) have expanded research in video understanding, primarily focusing on high-level tasks such as video captioning and question-answering. Meanwhile, a smaller body of work addresses…

Computer Vision and Pattern Recognition · Computer Science 2025-04-04 Ali Athar , Xueqing Deng , Liang-Chieh Chen

Unsupervised video object segmentation (UVOS) is a per-pixel binary labeling problem which aims at separating the foreground object from the background in the video without using the ground truth (GT) mask of the foreground object. Most of…

Computer Vision and Pattern Recognition · Computer Science 2021-12-24 Youngjo Lee , Hongje Seong , Euntai Kim

Video object segmentation is an essential task in robot manipulation to facilitate grasping and learning affordances. Incremental learning is important for robotics in unstructured environments, since the total number of objects and their…

Computer Vision and Pattern Recognition · Computer Science 2019-03-14 Mennatullah Siam , Chen Jiang , Steven Lu , Laura Petrich , Mahmoud Gamal , Mohamed Elhoseiny , Martin Jagersand

This paper proposes a novel framework utilizing multi-modal large language models (MLLMs) for referring video object segmentation (RefVOS). Previous MLLM-based methods commonly struggle with the dilemma between "Ref" and "VOS": they either…

Computer Vision and Pattern Recognition · Computer Science 2025-04-11 Lang Lin , Xueyang Yu , Ziqi Pang , Yu-Xiong Wang

Temporal video segmentation and classification have been advanced greatly by public benchmarks in recent years. However, such research still mainly focuses on human actions, failing to describe videos in a holistic view. In addition,…

Computer Vision and Pattern Recognition · Computer Science 2022-12-12 Jie Jiang , Zhimin Li , Jiangfeng Xiong , Rongwei Quan , Qinglin Lu , Wei Liu

Boosted by Multi-modal Large Language Models (MLLMs), text-guided universal segmentation models for the image and video domains have made rapid progress recently. However, these methods are often developed separately for specific domains,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-19 Cong Wei , Yujie Zhong , Haoxian Tan , Yingsen Zeng , Yong Liu , Zheng Zhao , Yujiu Yang

Sa2VA is a recent model for language-guided dense grounding in images and video that achieves state-of-the-art results on multiple segmentation benchmarks and that has become widely popular. However, we found that Sa2VA does not perform…

Computer Vision and Pattern Recognition · Computer Science 2025-11-19 Alexey Nekrasov , Ali Athar , Daan de Geus , Alexander Hermans , Bastian Leibe