中文
相关论文

相关论文: DeVIS: Making Deformable Transformers Work for Vid…

200 篇论文

Referring Video Object Segmentation is an emerging multi-modal task that aims to segment objects in the video given a natural language expression. In this work, we build two instance-centric models and fuse predicted results from…

计算机视觉与模式识别 · 计算机科学 2024-08-21 Bin Cao , Yisi Zhang , Hanyi Wang , Xingjian He , Jing Liu

Until recently, the Video Instance Segmentation (VIS) community operated under the common belief that offline methods are generally superior to a frame by frame online processing. However, the recent success of online methods questions this…

计算机视觉与模式识别 · 计算机科学 2023-09-19 Tim Meinhardt , Matt Feiszli , Yuchen Fan , Laura Leal-Taixe , Rakesh Ranjan

Training on large-scale datasets can boost the performance of video instance segmentation while the annotated datasets for VIS are hard to scale up due to the high labor cost. What we possess are numerous isolated filed-specific datasets,…

计算机视觉与模式识别 · 计算机科学 2024-03-19 Rongkun Zheng , Lu Qi , Xi Chen , Yi Wang , Kun Wang , Yu Qiao , Hengshuang Zhao

Recent trends in Video Instance Segmentation (VIS) have seen a growing reliance on online methods to model complex and lengthy video sequences. However, the degradation of representation and noise accumulation of the online methods,…

计算机视觉与模式识别 · 计算机科学 2023-05-29 Tanveer Hannan , Rajat Koner , Maximilian Bernhard , Suprosanna Shit , Bjoern Menze , Volker Tresp , Matthias Schubert , Thomas Seidl

Recently, Space-Time Memory Network (STM) based methods have achieved state-of-the-art performance in semi-supervised video object segmentation (VOS). A crucial problem in this task is how to model the dependency both among different frames…

计算机视觉与模式识别 · 计算机科学 2021-09-21 Jianbiao Mei , Mengmeng Wang , Yeneng Lin , Yi Yuan , Yong Liu

We present an approach to semi-supervised video object segmentation, in the context of the DAVIS 2017 challenge. Our approach combines category-based object detection, category-independent object appearance segmentation and temporal object…

计算机视觉与模式识别 · 计算机科学 2017-07-21 Gilad Sharir , Eddie Smolyansky , Itamar Friedman

The objective of this paper is self-supervised representation learning, with the goal of solving semi-supervised video object segmentation (a.k.a. dense tracking). We make the following contributions: (i) we propose to improve the existing…

计算机视觉与模式识别 · 计算机科学 2020-06-23 Fangrui Zhu , Li Zhang , Yanwei Fu , Guodong Guo , Weidi Xie

Inspired by recent advances of deep learning in instance segmentation and object tracking, we introduce video object segmentation problem as a concept of guided instance segmentation. Our model proceeds on a per-frame basis, guided by the…

计算机视觉与模式识别 · 计算机科学 2019-02-05 Anna Khoreva , Federico Perazzi , Rodrigo Benenson , Bernt Schiele , Alexander Sorkine-Hornung

Existing video instance segmentation (VIS) approaches generally follow a closed-world assumption, where only seen category instances are identified and spatio-temporally segmented at inference. Open-world formulation relaxes the close-world…

计算机视觉与模式识别 · 计算机科学 2023-04-04 Omkar Thawakar , Sanath Narayan , Hisham Cholakkal , Rao Muhammad Anwer , Salman Khan , Jorma Laaksonen , Mubarak Shah , Fahad Shahbaz Khan

Video object segmentation aims at accurately segmenting the target object regions across consecutive frames. It is technically challenging for coping with complicated factors (e.g., shape deformations, occlusion and out of the lens). Recent…

计算机视觉与模式识别 · 计算机科学 2019-07-03 Peng Sun , Peiwen Lin , Guangliang Cheng , Jianping Shi , Jiawan Zhang , Xi Li

We introduce a novel paradigm for offline Video Instance Segmentation (VIS), based on the hypothesis that explicit object-oriented information can be a strong clue for understanding the context of the entire sequence. To this end, we…

计算机视觉与模式识别 · 计算机科学 2022-10-21 Miran Heo , Sukjun Hwang , Seoung Wug Oh , Joon-Young Lee , Seon Joo Kim

The referring video object segmentation task (RVOS) aims to segment object instances in a given video referred by a language expression in all video frames. Due to the requirement of understanding cross-modal semantics within individual…

计算机视觉与模式识别 · 计算机科学 2022-06-27 Leilei Cao , Zhuang Li , Bo Yan , Feng Zhang , Fengliang Qi , Yuchen Hu , Hongbin Wang

The handling of long videos with complex and occluded sequences has recently emerged as a new challenge in the video instance segmentation (VIS) community. However, existing methods have limitations in addressing this challenge. We argue…

计算机视觉与模式识别 · 计算机科学 2023-03-27 Miran Heo , Sukjun Hwang , Jeongseok Hyun , Hanjung Kim , Seoung Wug Oh , Joon-Young Lee , Seon Joo Kim

In this paper, we introduce the Context-Aware Video Instance Segmentation (CAVIS), a novel framework designed to enhance instance association by integrating contextual information adjacent to each object. To efficiently extract and leverage…

计算机视觉与模式识别 · 计算机科学 2025-07-10 Seunghun Lee , Jiwan Seo , Kiljoon Han , Minwoo Choi , Sunghoon Im

Referring Video Object Segmentation (RVOS) requires segmenting specific objects in a video guided by a natural language description. The core challenge of RVOS is to anchor abstract linguistic concepts onto a specific set of pixels and…

计算机视觉与模式识别 · 计算机科学 2026-02-27 Zanyi Wang , Dengyang Jiang , Liuzhuozheng Li , Sizhe Dang , Chengzu Li , Harry Yang , Guang Dai , Mengmeng Wang , Jingdong Wang

We present a novel approach to unsupervised learning for video object segmentation (VOS). Unlike previous work, our formulation allows to learn dense feature representations directly in a fully convolutional regime. We rely on uniform grid…

计算机视觉与模式识别 · 计算机科学 2021-11-12 Nikita Araslanov , Simone Schaub-Meyer , Stefan Roth

The problem of video object segmentation can become extremely challenging when multiple instances co-exist. While each instance may exhibit large scale and pose variations, the problem is compounded when instances occlude each other causing…

计算机视觉与模式识别 · 计算机科学 2018-03-15 Xiaoxiao Li , Chen Change Loy

While Video Instance Segmentation (VIS) has seen rapid progress, current approaches struggle to predict high-quality masks with accurate boundary details. Moreover, the predicted segmentations often fluctuate over time, suggesting that…

计算机视觉与模式识别 · 计算机科学 2022-07-29 Lei Ke , Henghui Ding , Martin Danelljan , Yu-Wing Tai , Chi-Keung Tang , Fisher Yu

In recent years, video instance segmentation (VIS) has been largely advanced by offline models, while online models gradually attracted less attention possibly due to their inferior performance. However, online methods have their inherent…

计算机视觉与模式识别 · 计算机科学 2022-07-22 Junfeng Wu , Qihao Liu , Yi Jiang , Song Bai , Alan Yuille , Xiang Bai

Contemporary Video Object Segmentation (VOS) approaches typically consist stages of feature extraction, matching, memory management, and multiple objects aggregation. Recent advanced models either employ a discrete modeling for these…

计算机视觉与模式识别 · 计算机科学 2024-03-14 Wanyun Li , Pinxue Guo , Xinyu Zhou , Lingyi Hong , Yangji He , Xiangyu Zheng , Wei Zhang , Wenqiang Zhang