中文
相关论文

相关论文: Video Playback Rate Perception for Self-supervised…

200 篇论文

Self-supervised video representation learning aimed at maximizing similarity between different temporal segments of one video, in order to enforce feature persistence over time. This leads to loss of pertinent information related to…

计算机视觉与模式识别 · 计算机科学 2023-05-12 Di Yang , Yaohui Wang , Quan Kong , Antitza Dantcheva , Lorenzo Garattoni , Gianpiero Francesca , Francois Bremond

This paper introduces a novel self-supervised method that leverages incoherence detection for video representation learning. It roots from the observation that visual systems of human beings can easily identify video incoherence based on…

计算机视觉与模式识别 · 计算机科学 2021-09-28 Haozhi Cao , Yuecong Xu , Jianfei Yang , Kezhi Mao , Lihua Xie , Jianxiong Yin , Simon See

The objective of this paper is self-supervised representation learning, with the goal of solving semi-supervised video object segmentation (a.k.a. dense tracking). We make the following contributions: (i) we propose to improve the existing…

计算机视觉与模式识别 · 计算机科学 2020-06-23 Fangrui Zhu , Li Zhang , Yanwei Fu , Guodong Guo , Weidi Xie

We present a novel technique for self-supervised video representation learning by: (a) decoupling the learning objective into two contrastive subtasks respectively emphasizing spatial and temporal features, and (b) performing it…

计算机视觉与模式识别 · 计算机科学 2021-09-02 Zehua Zhang , David Crandall

We propose a self-supervised method to learn feature representations from videos. A standard approach in traditional self-supervised methods uses positive-negative data pairs to train with contrastive learning strategy. In such a case,…

计算机视觉与模式识别 · 计算机科学 2020-08-13 Li Tao , Xueting Wang , Toshihiko Yamasaki

We introduce a novel self-supervised learning approach to learn representations of videos that are responsive to changes in the motion dynamics. Our representations can be learned from data without human annotation and provide a substantial…

计算机视觉与模式识别 · 计算机科学 2020-07-22 Simon Jenni , Givi Meishvili , Paolo Favaro

This paper introduces a novel method for self-supervised video representation learning via feature prediction. In contrast to the previous methods that focus on future feature prediction, we argue that a supervisory signal arising from…

计算机视觉与模式识别 · 计算机科学 2020-11-13 Nadine Behrmann , Juergen Gall , Mehdi Noroozi

Previous work on action representation learning focused on global representations for short video clips. In contrast, many practical applications, such as video alignment, strongly demand learning the intensive representation of long…

计算机视觉与模式识别 · 计算机科学 2023-03-03 Minghao Chen , Renbo Tu , Chenxi Huang , Yuqi Lin , Boxi Wu , Deng Cai

Temporal modeling is crucial for video super-resolution. Most of the video super-resolution methods adopt the optical flow or deformable convolution for explicitly motion compensation. However, such temporal modeling techniques increase the…

计算机视觉与模式识别 · 计算机科学 2022-04-15 Takashi Isobe , Xu Jia , Xin Tao , Changlin Li , Ruihuang Li , Yongjie Shi , Jing Mu , Huchuan Lu , Yu-Wing Tai

While deep reinforcement learning excels at solving tasks where large amounts of data can be collected through virtually unlimited interaction with the environment, learning from limited interaction remains a key challenge. We posit that an…

机器学习 · 计算机科学 2021-05-21 Max Schwarzer , Ankesh Anand , Rishab Goel , R Devon Hjelm , Aaron Courville , Philip Bachman

In this paper, we propose a novel self-supervised representation learning by taking advantage of a neighborhood-relational encoding (NRE) among the training data. Conventional unsupervised learning methods only focused on training deep…

计算机视觉与模式识别 · 计算机科学 2019-08-29 Mohammad Sabokrou , Mohammad Khalooei , Ehsan Adeli

We introduce a novel self-supervised contrastive learning method to learn representations from unlabelled videos. Existing approaches ignore the specifics of input distortions, e.g., by learning invariance to temporal transformations.…

计算机视觉与模式识别 · 计算机科学 2021-12-08 Simon Jenni , Hailin Jin

Spatially dense self-supervised learning is a rapidly growing problem domain with promising applications for unsupervised segmentation and pretraining for dense downstream tasks. Despite the abundance of temporal data in the form of videos,…

计算机视觉与模式识别 · 计算机科学 2023-08-24 Mohammadreza Salehi , Efstratios Gavves , Cees G. M. Snoek , Yuki M. Asano

We present a self-supervised Contrastive Video Representation Learning (CVRL) method to learn spatiotemporal visual representations from unlabeled videos. Our representations are learned using a contrastive loss, where two augmented clips…

计算机视觉与模式识别 · 计算机科学 2021-04-07 Rui Qian , Tianjian Meng , Boqing Gong , Ming-Hsuan Yang , Huisheng Wang , Serge Belongie , Yin Cui

Modern self-supervised learning algorithms typically enforce persistency of instance representations across views. While being very effective on learning holistic image and video representations, such an objective becomes sub-optimal for…

计算机视觉与模式识别 · 计算机科学 2022-04-05 Liangzhe Yuan , Rui Qian , Yin Cui , Boqing Gong , Florian Schroff , Ming-Hsuan Yang , Hartwig Adam , Ting Liu

We propose a self-supervised learning approach for videos that learns representations of both the RGB frames and the accompanying audio without human supervision. In contrast to images that capture the static scene appearance, videos also…

计算机视觉与模式识别 · 计算机科学 2023-02-16 Simon Jenni , Alexander Black , John Collomosse

Visual Place Recognition (VPR) aims to retrieve frames from a geotagged database that are located at the same place as the query frame. To improve the robustness of VPR in perceptually aliasing scenarios, sequence-based VPR methods are…

计算机视觉与模式识别 · 计算机科学 2024-01-30 Junqiao Zhao , Fenglin Zhang , Yingfeng Cai , Gengxuan Tian , Wenjie Mu , Chen Ye , Tiantian Feng

Most of the existing video self-supervised methods mainly leverage temporal signals of videos, ignoring that the semantics of moving objects and environmental information are all critical for video-related tasks. In this paper, we propose a…

计算机视觉与模式识别 · 计算机科学 2021-07-09 Wei Li , Dezhao Luo , Bo Fang , Yu Zhou , Weiping Wang

We study unsupervised video representation learning that seeks to learn both motion and appearance features from unlabeled video only, which can be reused for downstream tasks such as action recognition. This task, however, is extremely…

计算机视觉与模式识别 · 计算机科学 2021-03-16 Peihao Chen , Deng Huang , Dongliang He , Xiang Long , Runhao Zeng , Shilei Wen , Mingkui Tan , Chuang Gan

Self-supervised approaches for video have shown impressive results in video understanding tasks. However, unlike early works that leverage temporal self-supervision, current state-of-the-art methods primarily rely on tasks from the image…

计算机视觉与模式识别 · 计算机科学 2023-12-21 Ishan Rajendrakumar Dave , Simon Jenni , Mubarak Shah