中文
相关论文

相关论文: Self-supervised Spatiotemporal Representation Lear…

200 篇论文

In order to autonomously learn wide repertoires of complex skills, robots must be able to learn from their own autonomously collected data, without human supervision. One learning signal that is always available for autonomously collected…

机器人学 · 计算机科学 2017-10-18 Frederik Ebert , Chelsea Finn , Alex X. Lee , Sergey Levine

Understanding and predicting video content is essential for planning and reasoning in dynamic environments. Despite advancements, unsupervised learning of object representations and dynamics remains challenging. We present VideoPCDNet, an…

计算机视觉与模式识别 · 计算机科学 2025-06-25 Noel José Rodrigues Vicente , Enrique Lehner , Angel Villar-Corrales , Jan Nogga , Sven Behnke

The crux of self-supervised video representation learning is to build general features from unlabeled videos. However, most recent works have mainly focused on high-level semantics and neglected lower-level representations and their…

计算机视觉与模式识别 · 计算机科学 2021-08-18 Rui Qian , Yuxi Li , Huabin Liu , John See , Shuangrui Ding , Xian Liu , Dian Li , Weiyao Lin

This work explores the use of spatial context as a source of free and plentiful supervisory signal for training a rich visual representation. Given only a large, unlabeled image collection, we extract random pairs of patches from each image…

计算机视觉与模式识别 · 计算机科学 2016-01-19 Carl Doersch , Abhinav Gupta , Alexei A. Efros

As many algorithms depend on a suitable representation of data, learning unique features is considered a crucial task. Although supervised techniques using deep neural networks have boosted the performance of representation learning, the…

计算机视觉与模式识别 · 计算机科学 2020-09-07 Milad Sikaroudi , Amir Safarpoor , Benyamin Ghojogh , Sobhan Shafiei , Mark Crowley , H. R. Tizhoosh

Recently, great progress has been made in 3D deep learning with the emergence of deep neural networks specifically designed for 3D point clouds. These networks are often trained from scratch or from pre-trained models learned purely from…

计算机视觉与模式识别 · 计算机科学 2022-10-31 Bach Tran , Binh-Son Hua , Anh Tuan Tran , Minh Hoai

Self-supervised learning has emerged as a powerful tool for pretraining deep networks on unlabeled data, prior to transfer learning of target tasks with limited annotation. The relevance between the pretraining pretext and target tasks is…

计算机视觉与模式识别 · 计算机科学 2024-04-09 Tianwei Zhang , Dong Wei , Mengmeng Zhu , Shi Gu , Yefeng Zheng

This paper introduces self-supervised neural network models to tackle several fundamental problems in the field of 3D human body analysis and processing. First, we propose VariShaPE (Varifold Shape Parameter Estimator), a novel architecture…

计算机视觉与模式识别 · 计算机科学 2025-09-10 Emmanuel Hartman , Nicolas Charon , Martin Bauer

Self-supervised learning of depth map prediction and motion estimation from monocular video sequences is of vital importance -- since it realizes a broad range of tasks in robotics and autonomous vehicles. A large number of research efforts…

计算机视觉与模式识别 · 计算机科学 2021-03-24 Ue-Hwan Kim , Jong-Hwan Kim

Intelligent agent naturally learns from motion. Various self-supervised algorithms have leveraged motion cues to learn effective visual representations. The hurdle here is that motion is both ambiguous and complex, rendering previous works…

计算机视觉与模式识别 · 计算机科学 2019-04-26 Xiaohang Zhan , Xingang Pan , Ziwei Liu , Dahua Lin , Chen Change Loy

This paper presents a novel yet intuitive approach to unsupervised feature learning. Inspired by the human visual system, we explore whether low-level motion-based grouping cues can be used to learn an effective visual representation.…

计算机视觉与模式识别 · 计算机科学 2017-04-13 Deepak Pathak , Ross Girshick , Piotr Dollár , Trevor Darrell , Bharath Hariharan

Self-supervised prediction is a powerful mechanism to learn representations that capture the underlying structure of the data. Despite recent progress, the self-supervised video prediction task is still challenging. One of the critical…

计算机视觉与模式识别 · 计算机科学 2020-04-21 Hafez Farazi , Sven Behnke

Self-supervised learning, which benefits from automatically constructing labels through pre-designed pretext task, has recently been applied for strengthen supervised learning. Since previous self-supervised pretext tasks are based on…

计算机视觉与模式识别 · 计算机科学 2021-06-10 Zilin Ding , Yuhang Yang , Xuan Cheng , Xiaomin Wang , Ming Liu

In low-level video analyses, effective representations are important to derive the correspondences between video frames. These representations have been learned in a self-supervised fashion from unlabeled images or videos, using carefully…

计算机视觉与模式识别 · 计算机科学 2023-06-23 Rui Li , Dong Liu

Two-stream Convolutional Networks (ConvNets) have shown strong performance for human action recognition in videos. Recently, Residual Networks (ResNets) have arisen as a new technique to train extremely deep architectures. In this paper, we…

计算机视觉与模式识别 · 计算机科学 2016-11-08 Christoph Feichtenhofer , Axel Pinz , Richard P. Wildes

State-of-the-art deep learning approaches for skin lesion recognition often require pretraining on larger and more varied datasets, to overcome the generalization limitations derived from the reduced size of the skin lesion imaging…

计算机视觉与模式识别 · 计算机科学 2022-05-04 Kirill Sirotkin , Marcos Escudero-Viñolo , Pablo Carballeira , Juan Carlos SanMiguel

Semi-Supervised Learning can be more beneficial for the video domain compared to images because of its higher annotation cost and dimensionality. Besides, any video understanding task requires reasoning over both spatial and temporal…

计算机视觉与模式识别 · 计算机科学 2023-03-30 Ishan Rajendrakumar Dave , Mamshad Nayeem Rizve , Chen Chen , Mubarak Shah

This paper introduces a novel approach named CrossVideo, which aims to enhance self-supervised cross-modal contrastive learning in the field of point cloud video understanding. Traditional supervised learning methods encounter limitations…

计算机视觉与模式识别 · 计算机科学 2024-01-30 Yunze Liu , Changxi Chen , Zifan Wang , Li Yi

We propose a method for self-supervised image representation learning under the guidance of 3D geometric consistency. Our intuition is that 3D geometric consistency priors such as smooth regions and surface discontinuities may imply…

计算机视觉与模式识别 · 计算机科学 2022-03-30 Nenglun Chen , Lei Chu , Hao Pan , Yan Lu , Wenping Wang

In video super-resolution, the spatio-temporal coherence between, and among the frames must be exploited appropriately for accurate prediction of the high resolution frames. Although 2D convolutional neural networks (CNNs) are powerful in…

计算机视觉与模式识别 · 计算机科学 2019-06-21 Soo Ye Kim , Jeongyeon Lim , Taeyoung Na , Munchurl Kim