English
Related papers

Related papers: Self-Supervised Visual Representation Learning fro…

200 papers

Unsupervised representation learning has recently received lots of interest due to its powerful generalizability through effectively leveraging large-scale unlabeled data. There are two prevalent approaches for this, contrastive learning…

Machine Learning · Computer Science 2021-06-14 Saehoon Kim , Sungwoong Kim , Juho Lee

Considering the close connection between action recognition and human pose estimation, we design a Collaboratively Self-supervised Video Representation (CSVR) learning framework specific to action recognition by jointly factoring in…

Computer Vision and Pattern Recognition · Computer Science 2025-02-03 Jie Zhang , Zhifan Wan , Lanqing Hu , Stephen Lin , Shuzhe Wu , Shiguang Shan

Learning discriminative representations of unlabelled data is a challenging task. Contrastive self-supervised learning provides a framework to learn meaningful representations using learned notions of similarity measures from simple pretext…

Computer Vision and Pattern Recognition · Computer Science 2023-01-04 Nicklas Boserup , Raghavendra Selvan

This paper addresses the problem of self-supervised video representation learning from a new perspective -- by video pace prediction. It stems from the observation that human visual system is sensitive to video pace, e.g., slow motion, a…

Computer Vision and Pattern Recognition · Computer Science 2020-09-07 Jiangliu Wang , Jianbo Jiao , Yun-Hui Liu

Despite their irresistible success, deep learning algorithms still heavily rely on annotated data. On the other hand, unsupervised settings pose many challenges, especially about determining the right inductive bias in diverse scenarios.…

Computer Vision and Pattern Recognition · Computer Science 2021-03-11 Beril Besbinar , Pascal Frossard

Weakly-supervised semantic segmentation under image tags supervision is a challenging task as it directly associates high-level semantic to low-level appearance. To bridge this gap, in this paper, we propose an iterative bottom-up and…

Computer Vision and Pattern Recognition · Computer Science 2018-06-13 Xiang Wang , Shaodi You , Xi Li , Huimin Ma

The key to integrating visual language tasks is to establish a good alignment strategy. Recently, visual semantic representation has achieved fine-grained visual understanding by dividing grids or image patches. However, the coarse-grained…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Siyu Zhang , Yeming Chen , Yaoru Sun , Fang Wang , Jun Yang , Lizhi Bai , Shangce Gao

Finding correspondences between structural entities decomposing images is of high interest for computer vision applications. In particular, we analyze how to accurately track superpixels - visual primitives generated by aggregating adjacent…

Computer Vision and Pattern Recognition · Computer Science 2019-02-27 Pierre-Henri Conze , Florian Tilquin , Mathieu Lamard , Fabrice Heitz , Gwenolé Quellec

We develop an approach to learning visual representations that embraces multimodal data, driven by a combination of intra- and inter-modal similarity preservation objectives. Unlike existing visual pre-training methods, which solve a proxy…

Computer Vision and Pattern Recognition · Computer Science 2021-04-28 Xin Yuan , Zhe Lin , Jason Kuen , Jianming Zhang , Yilin Wang , Michael Maire , Ajinkya Kale , Baldo Faieta

Unsupervised learning poses one of the most difficult challenges in computer vision today. The task has an immense practical value with many applications in artificial intelligence and emerging technologies, as large quantities of unlabeled…

Computer Vision and Pattern Recognition · Computer Science 2019-05-28 Ioana Croitoru , Simion-Vlad Bogolin , Marius Leordeanu

Navigating off-road with a fast autonomous vehicle depends on a robust perception system that differentiates traversable from non-traversable terrain. Typically, this depends on a semantic understanding which is based on supervised learning…

Contrastive self-supervised learning has emerged as a promising approach to unsupervised visual representation learning. In general, these methods learn global (image-level) representations that are invariant to different views (i.e.,…

Computer Vision and Pattern Recognition · Computer Science 2020-12-09 Pedro O. Pinheiro , Amjad Almahairi , Ryan Y. Benmalek , Florian Golemo , Aaron Courville

Self-supervised representation learning has been highly promising for histopathology image analysis with numerous approaches leveraging their patient-slide-patch hierarchy to learn better representations. In this paper, we explore how the…

Computer Vision and Pattern Recognition · Computer Science 2024-03-22 Hasindri Watawana , Kanchana Ranasinghe , Tariq Mahmood , Muzammal Naseer , Salman Khan , Fahad Shahbaz Khan

The crux of self-supervised video representation learning is to build general features from unlabeled videos. However, most recent works have mainly focused on high-level semantics and neglected lower-level representations and their…

Computer Vision and Pattern Recognition · Computer Science 2021-08-18 Rui Qian , Yuxi Li , Huabin Liu , John See , Shuangrui Ding , Xian Liu , Dian Li , Weiyao Lin

The goal of unsupervised representation learning is to extract a new representation of data, such that solving many different tasks becomes easier. Existing methods typically focus on vectorized data and offer little support for relational…

Machine Learning · Statistics 2017-09-29 Sebastijan Dumancic , Hendrik Blockeel

Recent progress in contrastive learning has revolutionized unsupervised representation learning. Concretely, multiple views (augmentations) from the same image are encouraged to map to the similar embeddings, while views from different…

Computer Vision and Pattern Recognition · Computer Science 2021-01-20 Nanxuan Zhao , Zhirong Wu , Rynson W. H. Lau , Stephen Lin

We present a new self-supervised pre-training of Vision Transformers for dense prediction tasks. It is based on a contrastive loss across views that compares pixel-level representations to global image representations. This strategy…

Computer Vision and Pattern Recognition · Computer Science 2022-06-08 Jaonary Rabarisoa , Valentin Belissen , Florian Chabot , Quoc-Cuong Pham

We propose a novel visual tracking algorithm based on the representations from a discriminatively trained Convolutional Neural Network (CNN). Our algorithm pretrains a CNN using a large set of videos with tracking ground-truths to obtain a…

Computer Vision and Pattern Recognition · Computer Science 2016-01-07 Hyeonseob Nam , Bohyung Han

Deep networks have been successfully applied to visual tracking by learning a generic representation offline from numerous training images. However the offline training is time-consuming and the learned generic representation may be less…

Computer Vision and Pattern Recognition · Computer Science 2015-08-25 Kaihua Zhang , Qingshan Liu , Yi Wu , Ming-Hsuan Yang

We propose a self-supervised visual learning method by predicting the variable playback speeds of a video. Without semantic labels, we learn the spatio-temporal visual representation of the video by leveraging the variations in the visual…

Computer Vision and Pattern Recognition · Computer Science 2021-06-02 Hyeon Cho , Taehoon Kim , Hyung Jin Chang , Wonjun Hwang