中文
相关论文

相关论文: STC: Spatio-Temporal Contrastive Learning for Vide…

200 篇论文

Video instance segmentation (VIS) is a critical task with diverse applications, including autonomous driving and video editing. Existing methods often underperform on complex and long videos in real world, primarily due to two factors.…

计算机视觉与模式识别 · 计算机科学 2023-07-17 Tao Zhang , Xingye Tian , Yu Wu , Shunping Ji , Xuebo Wang , Yuan Zhang , Pengfei Wan

Human video instance segmentation plays an important role in computer understanding of human activities and is widely used in video processing, video surveillance, and human modeling in virtual reality. Most current VIS methods are based on…

计算机视觉与模式识别 · 计算机科学 2022-04-01 Lu Cheng , Mingbo Zhao

We propose MinVIS, a minimal video instance segmentation (VIS) framework that achieves state-of-the-art VIS performance with neither video-based architectures nor training procedures. By only training a query-based image instance…

计算机视觉与模式识别 · 计算机科学 2022-08-04 De-An Huang , Zhiding Yu , Anima Anandkumar

Video instance segmentation (VIS) aims at segmenting and tracking objects in videos. Prior methods typically generate frame-level or clip-level object instances first and then associate them by either additional tracking heads or complex…

计算机视觉与模式识别 · 计算机科学 2023-01-06 Fei He , Haoyang Zhang , Naiyu Gao , Jian Jia , Yanhu Shan , Xin Zhao , Kaiqi Huang

Video Instance Segmentation (VIS) is a new and inherently multi-task problem, which aims to detect, segment, and track each instance in a video sequence. Existing approaches are mainly based on single-frame features or single-scale features…

计算机视觉与模式识别 · 计算机科学 2022-09-26 Xiangtai Li , Hao He , Yibo Yang , Henghui Ding , Kuiyuan Yang , Guangliang Cheng , Yunhai Tong , Dacheng Tao

Segmenting object instances is a key task in machine perception, with safety-critical applications in robotics and autonomous driving. We introduce a novel approach to instance segmentation that jointly leverages measurements from multiple…

计算机视觉与模式识别 · 计算机科学 2022-10-18 Alex Zihao Zhu , Vincent Casser , Reza Mahjourian , Henrik Kretzschmar , Sören Pirk

Weakly supervised instance segmentation reduces the cost of annotations required to train models. However, existing approaches which rely only on image-level class labels predominantly suffer from errors due to (a) partial segmentation of…

计算机视觉与模式识别 · 计算机科学 2021-03-25 Qing Liu , Vignesh Ramanathan , Dhruv Mahajan , Alan Yuille , Zhenheng Yang

In recent years, video instance segmentation (VIS) has been largely advanced by offline models, while online models gradually attracted less attention possibly due to their inferior performance. However, online methods have their inherent…

计算机视觉与模式识别 · 计算机科学 2022-07-22 Junfeng Wu , Qihao Liu , Yi Jiang , Song Bai , Alan Yuille , Xiang Bai

Video instance segmentation (VIS) is a challenging vision task that aims to detect, segment, and track objects in videos. Conventional VIS methods rely on densely-annotated object masks which are expensive. We reduce the human annotations…

计算机视觉与模式识别 · 计算机科学 2024-04-03 Shuaiyi Huang , De-An Huang , Zhiding Yu , Shiyi Lan , Subhashree Radhakrishnan , Jose M. Alvarez , Abhinav Shrivastava , Anima Anandkumar

Video instance segmentation (VIS) task requires classifying, segmenting, and tracking object instances over all frames in a video clip. Recently, VisTR has been proposed as end-to-end transformer-based VIS framework, while demonstrating…

计算机视觉与模式识别 · 计算机科学 2022-03-15 Sudhir Yarram , Jialian Wu , Pan Ji , Yi Xu , Junsong Yuan

This paper addresses the task of unsupervised video multi-object segmentation. Current approaches follow a two-stage paradigm: 1) detect object proposals using pre-trained Mask R-CNN, and 2) conduct generic feature matching for temporal…

计算机视觉与模式识别 · 计算机科学 2021-04-13 Tianfei Zhou , Jianwu Li , Xueyi Li , Ling Shao

Exploring dense matching between the current frame and past frames for long-range context modeling, memory-based methods have demonstrated impressive results in video object segmentation (VOS) recently. Nevertheless, due to the lack of…

计算机视觉与模式识别 · 计算机科学 2022-12-14 Junke Wang , Dongdong Chen , Zuxuan Wu , Chong Luo , Chuanxin Tang , Xiyang Dai , Yucheng Zhao , Yujia Xie , Lu Yuan , Yu-Gang Jiang

Modern one-stage video instance segmentation networks suffer from two limitations. First, convolutional features are neither aligned with anchor boxes nor with ground-truth bounding boxes, reducing the mask sensitivity to spatial location.…

计算机视觉与模式识别 · 计算机科学 2021-04-13 Minghan Li , Shuai Li , Lida Li , Lei Zhang

Video instance segmentation is a challenging task that serves as the cornerstone of numerous downstream applications, including video editing and autonomous driving. In this report, we present further improvements to the SOTA VIS method,…

计算机视觉与模式识别 · 计算机科学 2023-08-29 Tao Zhang , Xingye Tian , Yikang Zhou , Yu Wu , Shunping Ji , Cilin Yan , Xuebo Wang , Xin Tao , Yuan Zhang , Pengfei Wan

Video instance segmentation, also known as multi-object tracking and segmentation, is an emerging computer vision research area introduced in 2019, aiming at detecting, segmenting, and tracking instances in videos simultaneously. By…

计算机视觉与模式识别 · 计算机科学 2023-10-20 Chenhao Xu , Chang-Tsun Li , Yongjian Hu , Chee Peng Lim , Douglas Creighton

Video instance segmentation aims to detect, segment, and track objects in a video. Current approaches extend image-level segmentation algorithms to the temporal domain. However, this results in temporally inconsistent masks. In this work,…

计算机视觉与模式识别 · 计算机科学 2021-12-15 Anirudh S Chakravarthy , Won-Dong Jang , Zudi Lin , Donglai Wei , Song Bai , Hanspeter Pfister

Recently, query based deep networks catch lots of attention owing to their end-to-end pipeline and competitive results on several fundamental computer vision tasks, such as object detection, semantic segmentation, and instance segmentation.…

计算机视觉与模式识别 · 计算机科学 2021-06-24 Shusheng Yang , Yuxin Fang , Xinggang Wang , Yu Li , Ying Shan , Bin Feng , Wenyu Liu

Recent DETR-based methods have advanced the development of Video Instance Segmentation (VIS) through transformers' efficiency and capability in modeling spatial and temporal information. Despite harvesting remarkable progress, existing…

计算机视觉与模式识别 · 计算机科学 2024-12-03 Rongkun Zheng , Lu Qi , Xi Chen , Yi Wang , Kun Wang , Yu Qiao , Hengshuang Zhao

Video Instance Segmentation (VIS) aims at segmenting and categorizing objects in videos from a closed set of training categories, lacking the generalization ability to handle novel categories in real-world videos. To address this…

计算机视觉与模式识别 · 计算机科学 2023-08-08 Haochen Wang , Cilin Yan , Shuai Wang , Xiaolong Jiang , XU Tang , Yao Hu , Weidi Xie , Efstratios Gavves

Inspired by recent advances of deep learning in instance segmentation and object tracking, we introduce video object segmentation problem as a concept of guided instance segmentation. Our model proceeds on a per-frame basis, guided by the…

计算机视觉与模式识别 · 计算机科学 2019-02-05 Anna Khoreva , Federico Perazzi , Rodrigo Benenson , Bernt Schiele , Alexander Sorkine-Hornung