中文
相关论文

相关论文: Self-supervised Video Representation Learning Usin…

200 篇论文

This paper introduces a novel self-supervised method that leverages incoherence detection for video representation learning. It roots from the observation that visual systems of human beings can easily identify video incoherence based on…

计算机视觉与模式识别 · 计算机科学 2021-09-28 Haozhi Cao , Yuecong Xu , Jianfei Yang , Kezhi Mao , Lihua Xie , Jianxiong Yin , Simon See

Contrastive learning applied to self-supervised representation learning has seen a resurgence in deep models. In this paper, we find that existing contrastive learning based solutions for self-supervised video recognition focus on…

计算机视觉与模式识别 · 计算机科学 2021-10-26 Lin Zhang , Qi She , Zhengyang Shen , Changhu Wang

Recent works have advanced the performance of self-supervised representation learning by a large margin. The core among these methods is intra-image invariance learning. Two different transformations of one image instance are considered as…

计算机视觉与模式识别 · 计算机科学 2021-05-14 Haiping Wu , Xiaolong Wang

Contrastive learning has recently narrowed the gap between self-supervised and supervised methods in image and video domain. State-of-the-art video contrastive learning methods such as CVRL and $\rho$-MoCo spatiotemporally augment two clips…

计算机视觉与模式识别 · 计算机科学 2023-03-14 David Fan , Deyu Yang , Xinyu Li , Vimal Bhat , Rohith MV

We introduce a novel self-supervised contrastive learning method to learn representations from unlabelled videos. Existing approaches ignore the specifics of input distortions, e.g., by learning invariance to temporal transformations.…

计算机视觉与模式识别 · 计算机科学 2021-12-08 Simon Jenni , Hailin Jin

The objective of this paper is visual-only self-supervised video representation learning. We make the following contributions: (i) we investigate the benefit of adding semantic-class positives to instance-based Info Noise Contrastive…

计算机视觉与模式识别 · 计算机科学 2021-01-13 Tengda Han , Weidi Xie , Andrew Zisserman

Visual-only self-supervised learning has achieved significant improvement in video representation learning. Existing related methods encourage models to learn video representations by utilizing contrastive learning or designing specific…

计算机视觉与模式识别 · 计算机科学 2022-04-12 Jinyu Liu , Ying Cheng , Yuejie Zhang , Rui-Wei Zhao , Rui Feng

In this paper, we focus on the self-supervised learning of visual correspondence using unlabeled videos in the wild. Our method simultaneously considers intra- and inter-video representation associations for reliable correspondence…

计算机视觉与模式识别 · 计算机科学 2020-12-10 Ning Wang , Wengang Zhou , Houqiang Li

Robust frame-wise embeddings are essential to perform video analysis and understanding tasks. We present a self-supervised method for representation learning based on aligning temporal video sequences. Our framework uses a transformer-based…

计算机视觉与模式识别 · 计算机科学 2025-03-04 Keyne Oei , Amr Gomaa , Anna Maria Feit , João Belo

We propose a supervised contrastive learning framework for video representation learning that leverages temporally global context. We introduce a video to image aggregation strategy that spatially arranges multiple frames from each video…

计算机视觉与模式识别 · 计算机科学 2025-12-16 Shaif Chowdhury , Mushfika Rahman , Greg Hamerly

Recently, self-supervised representation learning gives further development in multimedia technology. Most existing self-supervised learning methods are applicable to packaged data. However, when it comes to streamed data, they are…

计算机视觉与模式识别 · 计算机科学 2022-11-03 Zhiwei Lin , Yongtao Wang , Hongxiang Lin

We present Cycle-Contrastive Learning (CCL), a novel self-supervised method for learning video representation. Following a nature that there is a belong and inclusion relation of video and its frames, CCL is designed to find correspondences…

计算机视觉与模式识别 · 计算机科学 2020-10-29 Quan Kong , Wenpeng Wei , Ziwei Deng , Tomoaki Yoshinaga , Tomokazu Murakami

We propose a self-supervised learning approach for videos that learns representations of both the RGB frames and the accompanying audio without human supervision. In contrast to images that capture the static scene appearance, videos also…

计算机视觉与模式识别 · 计算机科学 2023-02-16 Simon Jenni , Alexander Black , John Collomosse

This paper introduces a novel method for self-supervised video representation learning via feature prediction. In contrast to the previous methods that focus on future feature prediction, we argue that a supervisory signal arising from…

计算机视觉与模式识别 · 计算机科学 2020-11-13 Nadine Behrmann , Juergen Gall , Mehdi Noroozi

Self-supervised learning allows for better utilization of unlabelled data. The feature representation obtained by self-supervision can be used in downstream tasks such as classification, object detection, segmentation, and anomaly…

计算机视觉与模式识别 · 计算机科学 2020-06-18 Rabia Ali , Muhammad Umar Karim Khan , Chong Min Kyung

We propose a self-supervised approach for learning representations and robotic behaviors entirely from unlabeled videos recorded from multiple viewpoints, and study how this representation can be used in two robotic imitation settings:…

计算机视觉与模式识别 · 计算机科学 2018-03-21 Pierre Sermanet , Corey Lynch , Yevgen Chebotar , Jasmine Hsu , Eric Jang , Stefan Schaal , Sergey Levine

Contrastive representation learning has proven to be an effective self-supervised learning method for images and videos. Most successful approaches are based on Noise Contrastive Estimation (NCE) and use different views of an instance as…

计算机视觉与模式识别 · 计算机科学 2023-09-27 Julien Denize , Jaonary Rabarisoa , Astrid Orcesi , Romain Hérault

We propose a self-supervised visual learning method by predicting the variable playback speeds of a video. Without semantic labels, we learn the spatio-temporal visual representation of the video by leveraging the variations in the visual…

计算机视觉与模式识别 · 计算机科学 2021-06-02 Hyeon Cho , Taehoon Kim , Hyung Jin Chang , Wonjun Hwang

Contrastive self-supervised learning has outperformed supervised pretraining on many downstream tasks like segmentation and object detection. However, current methods are still primarily applied to curated datasets like ImageNet. In this…

计算机视觉与模式识别 · 计算机科学 2021-12-15 Wouter Van Gansbeke , Simon Vandenhende , Stamatios Georgoulis , Luc Van Gool

This paper presents a self-supervised feature learning method for hyperspectral image classification. Our method tries to construct two different views of the raw hyperspectral image through a cross-representation learning method. And then…

计算机视觉与模式识别 · 计算机科学 2024-12-05 Anyu Zhang , Haotian Wu , Zeyu Cao
‹ 上一页 1 2 3 10 下一页 ›