中文
相关论文

相关论文: Self-supervised Video Representation Learning with…

200 篇论文

Self-supervised learning allows for better utilization of unlabelled data. The feature representation obtained by self-supervision can be used in downstream tasks such as classification, object detection, segmentation, and anomaly…

计算机视觉与模式识别 · 计算机科学 2020-06-18 Rabia Ali , Muhammad Umar Karim Khan , Chong Min Kyung

Event cameras have recently gained significant traction since they open up new avenues for low-latency and low-power solutions to complex computer vision problems. To unlock these solutions, it is necessary to develop algorithms that can…

计算机视觉与模式识别 · 计算机科学 2023-09-28 Federico Paredes-Vallés , Kirk Y. W. Scheper , Christophe De Wagter , Guido C. H. E. de Croon

Recent self-supervised video representation learning methods have found significant success by exploring essential properties of videos, e.g. speed, temporal order, etc. This work exploits an essential yet under-explored property of videos,…

计算机视觉与模式识别 · 计算机科学 2022-01-13 Hanwen Liang , Niamul Quader , Zhixiang Chi , Lizhe Chen , Peng Dai , Juwei Lu , Yang Wang

Image-level contrastive representation learning has proven to be highly effective as a generic model for transfer learning. Such generality for transfer learning, however, sacrifices specificity if we are interested in a certain downstream…

计算机视觉与模式识别 · 计算机科学 2021-10-26 Fangyun Wei , Yue Gao , Zhirong Wu , Han Hu , Stephen Lin

Recent self-supervised representation learning techniques have largely closed the gap between supervised and unsupervised learning on ImageNet classification. While the particulars of pretraining on ImageNet are now relatively well…

计算机视觉与模式识别 · 计算机科学 2022-04-05 Elijah Cole , Xuan Yang , Kimberly Wilber , Oisin Mac Aodha , Serge Belongie

While contrastive learning is proven to be an effective training strategy in computer vision, Natural Language Processing (NLP) is only recently adopting it as a self-supervised alternative to Masked Language Modeling (MLM) for improving…

计算与语言 · 计算机科学 2021-09-16 Hooman Sedghamiz , Shivam Raval , Enrico Santus , Tuka Alhanai , Mohammad Ghassemi

Self-supervised video representation learning has been shown to effectively improve downstream tasks such as video retrieval and action recognition. In this paper, we present the Cascade Positive Retrieval (CPR) that successively mines…

计算机视觉与模式识别 · 计算机科学 2022-04-22 Cheng-En Wu , Farley Lai , Yu Hen Hu , Asim Kadav

We present a new self-supervised paradigm on point cloud sequence understanding. Inspired by the discriminative and generative self-supervised methods, we design two tasks, namely point cloud sequence based Contrastive Prediction and…

计算机视觉与模式识别 · 计算机科学 2023-05-23 Xiaoxiao Sheng , Zhiqiang Shen , Gang Xiao

We present a new approach to instill 4D dynamic object priors into learned 3D representations by unsupervised pre-training. We observe that dynamic movement of an object through an environment provides important cues about its objectness,…

计算机视觉与模式识别 · 计算机科学 2022-07-25 Yujin Chen , Matthias Nießner , Angela Dai

Learning node-level representations of heterophilic graphs is crucial for various applications, including fraudster detection and protein function prediction. In such graphs, nodes share structural similarity identified by the equivalence…

机器学习 · 计算机科学 2023-08-22 Asif Khan , Amos Storkey

Unsupervised learning has made substantial progress over the last few years, especially by means of contrastive self-supervised learning. The dominating dataset for benchmarking self-supervised learning has been ImageNet, for which recent…

图像与视频处理 · 电气工程与系统科学 2022-08-17 Karin Stacke , Jonas Unger , Claes Lundström , Gabriel Eilertsen

The objective of this paper is self-supervised learning of feature embeddings that are suitable for matching correspondences along the videos, which we term correspondence flow. By leveraging the natural spatial-temporal coherence in…

计算机视觉与模式识别 · 计算机科学 2019-07-30 Zihang Lai , Weidi Xie

Learning discriminative image representations plays a vital role in long-tailed image classification because it can ease the classifier learning in imbalanced cases. Given the promising performance contrastive learning has shown recently in…

计算机视觉与模式识别 · 计算机科学 2021-03-29 Peng Wang , Kai Han , Xiu-Shen Wei , Lei Zhang , Lei Wang

Self-supervised representation learning is a fundamental problem in computer vision with many useful applications (e.g., image search, instance level recognition, copy detection). In this paper we present a new contrastive self-supervised…

计算机视觉与模式识别 · 计算机科学 2021-11-16 David Wu , Yunnan Wu

We present ConCur, a contrastive video representation learning method that uses curriculum learning to impose a dynamic sampling strategy in contrastive training. More specifically, ConCur starts the contrastive training with easy positive…

计算机视觉与模式识别 · 计算机科学 2022-09-05 Shuvendu Roy , Ali Etemad

Imposing consistency through proxy tasks has been shown to enhance data-driven learning and enable self-supervision in various tasks. This paper introduces novel and effective consistency strategies for optical flow estimation, a problem…

计算机视觉与模式识别 · 计算机科学 2022-05-25 Jisoo Jeong , Jamie Menjay Lin , Fatih Porikli , Nojun Kwak

Unsupervised learning methods for feature extraction are becoming more and more popular. We combine the popular contrastive learning method (prototypical contrastive learning) and the classic representation learning method (autoencoder) to…

计算机视觉与模式识别 · 计算机科学 2022-05-11 Zeyu Cao , Xiaorun Li , Liaoying Zhao

Contrastive learning allows us to flexibly define powerful losses by contrasting positive pairs from sets of negative samples. Recently, the principle has also been used to learn cross-modal embeddings for video and text, yet without…

计算机视觉与模式识别 · 计算机科学 2021-10-01 Mohammadreza Zolfaghari , Yi Zhu , Peter Gehler , Thomas Brox

We present CrissCross, a self-supervised framework for learning audio-visual representations. A novel notion is introduced in our framework whereby in addition to learning the intra-modal and standard 'synchronous' cross-modal relations,…

计算机视觉与模式识别 · 计算机科学 2022-11-28 Pritam Sarkar , Ali Etemad

Traditional supervised learning with deep neural networks requires a tremendous amount of labelled data to converge to a good solution. For 3D medical images, it is often impractical to build a large homogeneous annotated dataset for a…