English
Related papers

Related papers: Temporal Transductive Inference for Few-Shot Video…

200 papers

How can unlabeled video augment visual learning? Existing methods perform "slow" feature analysis, encouraging the representations of temporally close frames to exhibit only small differences. While this standard approach captures the fact…

Computer Vision and Pattern Recognition · Computer Science 2016-04-15 Dinesh Jayaraman , Kristen Grauman

Temporal action segmentation is a topic of increasing interest, however, annotating each frame in a video is cumbersome and costly. Weakly supervised approaches therefore aim at learning temporal action segmentation from videos that are…

Computer Vision and Pattern Recognition · Computer Science 2020-04-01 Mohsen Fayyaz , Juergen Gall

Referring Video Object Segmentation (R-VOS) methods face challenges in maintaining consistent object segmentation due to temporal context variability and the presence of other visually similar objects. We propose an end-to-end R-VOS…

Computer Vision and Pattern Recognition · Computer Science 2024-10-14 Bo Miao , Mohammed Bennamoun , Yongsheng Gao , Mubarak Shah , Ajmal Mian

Few-shot segmentation aims at assigning a category label to each image pixel with few annotated samples. It is a challenging task since the dense prediction can only be achieved under the guidance of latent features defined by sparse…

Computer Vision and Pattern Recognition · Computer Science 2020-12-15 Kai Zhu , Wei Zhai , Zheng-Jun Zha , Yang Cao

This paper addresses the task of unsupervised video multi-object segmentation. Current approaches follow a two-stage paradigm: 1) detect object proposals using pre-trained Mask R-CNN, and 2) conduct generic feature matching for temporal…

Computer Vision and Pattern Recognition · Computer Science 2021-04-13 Tianfei Zhou , Jianwu Li , Xueyi Li , Ling Shao

The emergence of attention-based transformer models has led to their extensive use in various tasks, due to their superior generalization and transfer properties. Recent research has demonstrated that such models, when prompted…

Computer Vision and Pattern Recognition · Computer Science 2024-04-19 Mir Rayat Imtiaz Hossain , Mennatullah Siam , Leonid Sigal , James J. Little

Segmentation of objects in a video is challenging due to the nuances such as motion blurring, parallax, occlusions, changes in illumination, etc. Instead of addressing these nuances separately, we focus on building a generalizable solution…

Computer Vision and Pattern Recognition · Computer Science 2023-07-11 Silky Singh , Shripad Deshmukh , Mausoom Sarkar , Rishabh Jain , Mayur Hemani , Balaji Krishnamurthy

Contemporary Video Instance Segmentation (VIS) methods typically adhere to a pre-train then fine-tune regime, where a segmentation model trained on images is fine-tuned on videos. However, the lack of temporal knowledge in the pre-trained…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Qing Zhong , Peng-Tao Jiang , Wen Wang , Guodong Ding , Lin Wu , Kaiqi Huang

Different from static images, videos contain additional temporal and spatial information for better object detection. However, it is costly to obtain a large number of videos with bounding box annotations that are required for supervised…

Computer Vision and Pattern Recognition · Computer Science 2022-08-19 Zhongjie Yu , Gaoang Wang , Lin Chen , Sebastian Raschka , Jiebo Luo

Temporally consistent dense video annotations are scarce and hard to collect. In contrast, image segmentation datasets (and pre-trained models) are ubiquitous, and easier to label for any novel task. In this paper, we introduce a method to…

Computer Vision and Pattern Recognition · Computer Science 2022-03-18 Aharon Azulay , Tavi Halperin , Orestis Vantzos , Nadav Borenstein , Ofir Bibi

Few-shot object detection (FSOD) has thrived in recent years to learn novel object classes with limited data by transferring knowledge gained on abundant base classes. FSOD approaches commonly assume that both the scarcely provided examples…

Computer Vision and Pattern Recognition · Computer Science 2022-09-20 Karim Guirguis , George Eskandar , Matthias Kayser , Bin Yang , Juergen Beyerer

Traditional semantic segmentation tasks require a large number of labels and are difficult to identify unlearned categories. Few-shot semantic segmentation (FSS) aims to use limited labeled support images to identify the segmentation of new…

Computer Vision and Pattern Recognition · Computer Science 2023-09-19 Xianglin Wang , Xiaoliu Luo , Taiping Zhang

Unsupervised Video Object Segmentation (VOS) aims at identifying the contours of primary foreground objects in videos without any prior knowledge. However, previous methods do not fully use spatial-temporal context and fail to tackle this…

Computer Vision and Pattern Recognition · Computer Science 2023-11-21 Ping Li , Yu Zhang , Li Yuan , Huaxin Xiao , Binbin Lin , Xianghua Xu

Learning descriptive spatio-temporal object models from data is paramount for the task of semi-supervised video object segmentation. Most existing approaches mainly rely on models that estimate the segmentation mask based on a reference…

Computer Vision and Pattern Recognition · Computer Science 2019-03-29 Sergi Caelles , Albert Pumarola , Francesc Moreno-Noguer , Alberto Sanfeliu , Luc Van Gool

Transductive inference is widely used in few-shot learning, as it leverages the statistics of the unlabeled query set of a few-shot task, typically yielding substantially better performances than its inductive counterpart. The current…

Machine Learning · Computer Science 2022-04-26 Olivier Veilleux , Malik Boudiaf , Pablo Piantanida , Ismail Ben Ayed

Few-shot learning aims to train a classifier that can generalize well when just a small number of labeled examples per class are given. We introduce a transductive maximum margin classifier for few-shot learning (FS-TMMC). The basic idea of…

Computer Vision and Pattern Recognition · Computer Science 2021-10-29 Fei Pan , Chunlei Xu , Jie Guo , Yanwen Guo

Few-shot detection is a major task in pattern recognition which seeks to localize objects using models trained with few labeled data. One of the mainstream few-shot methods is transfer learning which consists in pretraining a detection…

Computer Vision and Pattern Recognition · Computer Science 2024-02-15 Jie Mei , Mingyuan Jiu , Hichem Sahbi , Xiaoheng Jiang , Mingliang Xu

Transductive inference is an effective means of tackling the data deficiency problem in few-shot learning settings. A popular transductive inference technique for few-shot metric-based approaches, is to update the prototype of each class…

Machine Learning · Computer Science 2020-06-25 Seong Min Kye , Hae Beom Lee , Hoirin Kim , Sung Ju Hwang

Few-shot segmentation (FSS) aims to segment unseen classes given only a few annotated samples. Existing methods suffer the problem of feature undermining, i.e. potential novel classes are treated as background during training phase. Our…

Computer Vision and Pattern Recognition · Computer Science 2021-09-28 Lihe Yang , Wei Zhuo , Lei Qi , Yinghuan Shi , Yang Gao

Recently, Space-Time Memory Network (STM) based methods have achieved state-of-the-art performance in semi-supervised video object segmentation (VOS). A crucial problem in this task is how to model the dependency both among different frames…

Computer Vision and Pattern Recognition · Computer Science 2021-09-21 Jianbiao Mei , Mengmeng Wang , Yeneng Lin , Yi Yuan , Yong Liu