English
Related papers

Related papers: UVIS: Unsupervised Video Instance Segmentation

200 papers

Video segmentation aims to segment and track every pixel in diverse scenarios accurately. In this paper, we present Tube-Link, a versatile framework that addresses multiple core tasks of video segmentation with a unified architecture. Our…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Xiangtai Li , Haobo Yuan , Wenwei Zhang , Guangliang Cheng , Jiangmiao Pang , Chen Change Loy

The discrimination of instance embeddings plays a vital role in associating instances across time for online video instance segmentation (VIS). Instance embedding learning is directly supervised by the contrastive loss computed upon the…

Computer Vision and Pattern Recognition · Computer Science 2023-07-25 Kaining Ying , Qing Zhong , Weian Mao , Zhenhua Wang , Hao Chen , Lin Yuanbo Wu , Yifan Liu , Chengxiang Fan , Yunzhi Zhuge , Chunhua Shen

This paper strives for motion expressions guided video segmentation, which focuses on segmenting objects in video content based on a sentence describing the motion of the objects. Existing referring video object datasets typically focus on…

Computer Vision and Pattern Recognition · Computer Science 2023-08-17 Henghui Ding , Chang Liu , Shuting He , Xudong Jiang , Chen Change Loy

Self-supervised learning (SSL) holds promise in leveraging large amounts of unlabeled data. However, the success of popular SSL methods has limited on single-centric-object images like those in ImageNet and ignores the correlation among the…

Computer Vision and Pattern Recognition · Computer Science 2022-03-15 Zhaowen Li , Yousong Zhu , Fan Yang , Wei Li , Chaoyang Zhao , Yingying Chen , Zhiyang Chen , Jiahao Xie , Liwei Wu , Rui Zhao , Ming Tang , Jinqiao Wang

Semi-supervised video object segmentation (Semi-VOS), which requires only annotating the first frame of a video to segment future frames, has received increased attention recently. Among existing pipelines, the memory-matching-based one is…

Computer Vision and Pattern Recognition · Computer Science 2023-10-24 Weihao Lin , Tao Chen , Chong Yu

Most state-of-the-art semi-supervised video object segmentation methods rely on a pixel-accurate mask of a target object provided for the first frame of a video. However, obtaining a detailed segmentation mask is expensive and…

Computer Vision and Pattern Recognition · Computer Science 2019-02-06 Anna Khoreva , Anna Rohrbach , Bernt Schiele

While Video Instance Segmentation (VIS) has seen rapid progress, current approaches struggle to predict high-quality masks with accurate boundary details. Moreover, the predicted segmentations often fluctuate over time, suggesting that…

Computer Vision and Pattern Recognition · Computer Science 2022-07-29 Lei Ke , Henghui Ding , Martin Danelljan , Yu-Wing Tai , Chi-Keung Tang , Fisher Yu

Unsupervised video object segmentation (VOS) aims to detect and segment the most salient object in videos. The primary techniques used in unsupervised VOS are 1) the collaboration of appearance and motion information; and 2) temporal fusion…

Computer Vision and Pattern Recognition · Computer Science 2024-03-27 Suhwan Cho , Minhyeok Lee , Seunghoon Lee , Dogyoon Lee , Heeseung Choi , Ig-Jae Kim , Sangyoun Lee

Unsupervised video object segmentation aims to segment a target object in the video without a ground truth mask in the initial frame. This challenging task requires extracting features for the most salient common objects within a video…

Computer Vision and Pattern Recognition · Computer Science 2022-09-09 Minhyeok Lee , Suhwan Cho , Seunghoon Lee , Chaewon Park , Sangyoun Lee

Tracking geographic entities from historical maps, such as buildings, offers valuable insights into cultural heritage, urbanization patterns, environmental changes, and various historical research endeavors. However, linking these entities…

Computer Vision and Pattern Recognition · Computer Science 2024-12-19 Xue Xia , Randall Balestriero , Tao Zhang , Lorenz Hurni

Deep learning for unsupervised image segmentation remains challenging due to the absence of human labels. The common idea is to train a segmentation head, with the supervision of pixel-wise pseudo-labels generated based on the…

Computer Vision and Pattern Recognition · Computer Science 2023-08-10 Yi Zhang , Chengyi Wu

Video object segmentation (VOS) describes the task of segmenting a set of objects in each frame of a video. In the semi-supervised setting, the first mask of each object is provided at test time. Following the one-shot principle,…

Computer Vision and Pattern Recognition · Computer Science 2020-12-04 Tim Meinhardt , Laura Leal-Taixe

Video Object Segmentation (VOS) aims to track objects across frames in a video and segment them based on the initial annotated frame of the target objects. Previous VOS works typically rely on fully annotated videos for training. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-05-24 Baiyu Chen , Sixian Chan , Xiaoqin Zhang

Due to the problem of performance constraints of unsupervised video object detection, its large-scale application is limited. In response to this pain point, we propose another excellent method to solve this problematic point. By…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Chao Hu , Liqiang Zhu

Unsupervised video object segmentation has often been tackled by methods based on recurrent neural networks and optical flow. Despite their complexity, these kinds of approaches tend to favour short-term temporal dependencies and are thus…

Computer Vision and Pattern Recognition · Computer Science 2019-10-25 Zhao Yang , Qiang Wang , Luca Bertinetto , Weiming Hu , Song Bai , Philip H. S. Torr

The general domain of video segmentation is currently fragmented into different tasks spanning multiple benchmarks. Despite rapid progress in the state-of-the-art, current methods are overwhelmingly task-specific and cannot conceptually…

Computer Vision and Pattern Recognition · Computer Science 2023-05-11 Ali Athar , Alexander Hermans , Jonathon Luiten , Deva Ramanan , Bastian Leibe

In this work we present a novel solution for Video Instance Segmentation(VIS), that is automatically generating instance level segmentation masks along with object class and tracking them in a video. Our method improves the masks from…

Computer Vision and Pattern Recognition · Computer Science 2021-06-22 Vidit Goel , Jiachen Li , Shubhika Garg , Harsh Maheshwari , Humphrey Shi

In this work, we present a new computer vision task named video object of interest segmentation (VOIS). Given a video and a target image of interest, our objective is to simultaneously segment and track all objects in the video that are…

Computer Vision and Pattern Recognition · Computer Science 2022-12-07 Siyuan Zhou , Chunru Zhan , Biao Wang , Tiezheng Ge , Yuning Jiang , Li Niu

Dynamic texture (DT) segmentation, and video processing in general, is currently widely dominated by methods based on deep neural networks that require the deployment of a large number of layers. Although this parametric approach has shown…

Computer Vision and Pattern Recognition · Computer Science 2020-06-30 Lazhar Khelifi , Max Mignotte

We introduce a novel paradigm for offline Video Instance Segmentation (VIS), based on the hypothesis that explicit object-oriented information can be a strong clue for understanding the context of the entire sequence. To this end, we…

Computer Vision and Pattern Recognition · Computer Science 2022-10-21 Miran Heo , Sukjun Hwang , Seoung Wug Oh , Joon-Young Lee , Seon Joo Kim