中文
相关论文

相关论文: Learning Referring Video Object Segmentation from …

200 篇论文

The objective of this paper is self-supervised representation learning, with the goal of solving semi-supervised video object segmentation (a.k.a. dense tracking). We make the following contributions: (i) we propose to improve the existing…

计算机视觉与模式识别 · 计算机科学 2020-06-23 Fangrui Zhu , Li Zhang , Yanwei Fu , Guodong Guo , Weidi Xie

Video Object Segmentation (VOS) task aims to segment objects in videos. However, previous settings either require time-consuming manual masks of target objects at the first frame during inference or lack the flexibility to specify arbitrary…

计算机视觉与模式识别 · 计算机科学 2024-03-12 Pinxue Guo , Lingyi Hong , Xinyu Zhou , Shuyong Gao , Wanyun Li , Jinglun Li , Zhaoyu Chen , Xiaoqiang Li , Wei Zhang , Wenqiang Zhang

Unsupervised video object segmentation (UVOS) is a per-pixel binary labeling problem which aims at separating the foreground object from the background in the video without using the ground truth (GT) mask of the foreground object. Most of…

计算机视觉与模式识别 · 计算机科学 2021-12-24 Youngjo Lee , Hongje Seong , Euntai Kim

We present an approach to semi-supervised video object segmentation, in the context of the DAVIS 2017 challenge. Our approach combines category-based object detection, category-independent object appearance segmentation and temporal object…

计算机视觉与模式识别 · 计算机科学 2017-07-21 Gilad Sharir , Eddie Smolyansky , Itamar Friedman

Referring image segmentation segments an image from a language expression. With the aim of producing high-quality masks, existing methods often adopt iterative learning approaches that rely on RNNs or stacked attention layers to refine…

计算机视觉与模式识别 · 计算机科学 2023-03-14 Zhao Yang , Jiaqi Wang , Yansong Tang , Kai Chen , Hengshuang Zhao , Philip H. S. Torr

Referring Expression Segmentation (RES) aims to provide a segmentation mask of the target object in an image referred to by the text (i.e., referring expression). Existing methods require large-scale mask annotations. Moreover, such…

计算机视觉与模式识别 · 计算机科学 2024-07-03 Sayan Nag , Koustava Goswami , Srikrishna Karanam

Referring Expression Segmentation (RES) is an emerging task in computer vision, which segments the target instances in images based on text descriptions. However, its development is plagued by the expensive segmentation labels. To address…

计算机视觉与模式识别 · 计算机科学 2023-11-28 Minglang Huang , Yiyi Zhou , Gen Luo , Guannan Jiang , Weilin Zhuang , Xiaoshuai Sun

In this paper, we propose a simple yet effective approach for self-supervised video object segmentation (VOS). Our key insight is that the inherent structural dependencies present in DINO-pretrained Transformers can be leveraged to…

计算机视觉与模式识别 · 计算机科学 2024-07-09 Shuangrui Ding , Rui Qian , Haohang Xu , Dahua Lin , Hongkai Xiong

This paper aims to solve the video object segmentation (VOS) task in a scribble-supervised manner, in which VOS models are not only trained by the sparse scribble annotations but also initialized with the sparse target scribbles for…

计算机视觉与模式识别 · 计算机科学 2023-03-28 Zikun Zhou , Kaige Mao , Wenjie Pei , Hongpeng Wang , Yaowei Wang , Zhenyu He

Semi-supervised video object segmentation (Semi-VOS), which requires only annotating the first frame of a video to segment future frames, has received increased attention recently. Among existing pipelines, the memory-matching-based one is…

计算机视觉与模式识别 · 计算机科学 2023-10-24 Weihao Lin , Tao Chen , Chong Yu

Referring video object segmentation (RVOS) aims to segment objects in a video according to textual descriptions, which requires the integration of multimodal information and temporal dynamics perception. The Segment Anything Model 2 (SAM 2)…

计算机视觉与模式识别 · 计算机科学 2025-08-11 Fu Rong , Meng Lan , Qian Zhang , Lefei Zhang

Referring video object segmentation (RVOS) relies on natural language expressions to segment target objects in video. In this year, LSVOS Challenge RVOS Track replaced the origin YouTube-RVOS benchmark with MeViS. MeViS focuses on referring…

计算机视觉与模式识别 · 计算机科学 2024-08-27 Hao Fang , Feiyu Pan , Xiankai Lu , Wei Zhang , Runmin Cong

In order to learn object segmentation models in videos, conventional methods require a large amount of pixel-wise ground truth annotations. However, collecting such supervised data is time-consuming and labor-intensive. In this paper, we…

计算机视觉与模式识别 · 计算机科学 2019-01-09 Yi-Wen Chen , Yi-Hsuan Tsai , Chu-Ya Yang , Yen-Yu Lin , Ming-Hsuan Yang

Most methods for object instance segmentation require all training examples to be labeled with segmentation masks. This requirement makes it expensive to annotate new categories and has restricted instance segmentation models to ~100…

计算机视觉与模式识别 · 计算机科学 2018-03-28 Ronghang Hu , Piotr Dollár , Kaiming He , Trevor Darrell , Ross Girshick

This report presents an Audio-aware Referring Video Object Segmentation (Ref-VOS) pipeline tailored to the MEVIS\_Audio setting, where the referring expression is provided in spoken form rather than as clean text. Compared with a standard…

声音 · 计算机科学 2026-04-22 Deshui Miao , Yameng Gu , Chao Yang , Xin Li , Haijun Zhang , Ming-Hsuan Yang

Instance segmentation is a fundamental research in computer vision, especially in autonomous driving. However, manual mask annotation for instance segmentation is quite time-consuming and costly. To address this problem, some prior works…

计算机视觉与模式识别 · 计算机科学 2023-12-19 Guangfeng Jiang , Jun Liu , Yuzhi Wu , Wenlong Liao , Tao He , Pai Peng

Labeling pixel-wise object masks in videos is a resource-intensive and laborious process. Box-supervised Video Instance Segmentation (VIS) methods have emerged as a viable solution to mitigate the labor-intensive annotation process. . In…

计算机视觉与模式识别 · 计算机科学 2024-04-23 Zhangjing Yang , Dun Liu , Wensheng Cheng , Jinqiao Wang , Yi Wu

Instance segmentation in 3D images is a fundamental task in biomedical image analysis. While deep learning models often work well for 2D instance segmentation, 3D instance segmentation still faces critical challenges, such as insufficient…

计算机视觉与模式识别 · 计算机科学 2018-07-02 Zhuo Zhao , Lin Yang , Hao Zheng , Ian H. Guldner , Siyuan Zhang , Danny Z. Chen

Referring image segmentation is a challenging task that involves generating pixel-wise segmentation masks based on natural language descriptions. The complexity of this task increases with the intricacy of the sentences provided. Existing…

计算机视觉与模式识别 · 计算机科学 2024-11-05 Hai Nguyen-Truong , E-Ro Nguyen , Tuan-Anh Vu , Minh-Triet Tran , Binh-Son Hua , Sai-Kit Yeung

We present REM, a framework for segmenting a wide range of concepts in video that can be described through natural language. Our method leverages the universal visual-language mapping learned by video diffusion models on Internet-scale data…

计算机视觉与模式识别 · 计算机科学 2025-08-08 Anurag Bagchi , Zhipeng Bao , Yu-Xiong Wang , Pavel Tokmakov , Martial Hebert