English
Related papers

Related papers: Self-Supervised Video Representation Learning with…

200 papers

Semantic representation is of great benefit to the video text tracking(VTT) task that requires simultaneously classifying, detecting, and tracking texts in the video. Most existing approaches tackle this task by appearance similarity in…

Computer Vision and Pattern Recognition · Computer Science 2022-08-22 Zhuang Li , Weijia Wu , Mike Zheng Shou , Jiahong Li , Size Li , Zhongyuan Wang , Hong Zhou

Learning with neural networks from a continuous stream of visual information presents several challenges due to the non-i.i.d. nature of the data. However, it also offers novel opportunities to develop representations that are consistent…

Computer Vision and Pattern Recognition · Computer Science 2024-09-19 Simone Marullo , Matteo Tiezzi , Marco Gori , Stefano Melacci

Contrastive representation learning has proven to be an effective self-supervised learning method for images and videos. Most successful approaches are based on Noise Contrastive Estimation (NCE) and use different views of an instance as…

Computer Vision and Pattern Recognition · Computer Science 2023-09-27 Julien Denize , Jaonary Rabarisoa , Astrid Orcesi , Romain Hérault

Contrastive learning has become a key component of self-supervised learning approaches for computer vision. By learning to embed two augmented versions of the same image close to each other and to push the embeddings of different images…

Computer Vision and Pattern Recognition · Computer Science 2020-12-07 Yannis Kalantidis , Mert Bulent Sariyildiz , Noe Pion , Philippe Weinzaepfel , Diane Larlus

Human behavior understanding in videos is a complex, still unsolved problem and requires to accurately model motion at both the local (pixel-wise dense prediction) and global (aggregation of motion cues) levels. Current approaches based on…

Computer Vision and Pattern Recognition · Computer Science 2019-09-19 C. Spampinato , S. Palazzo , P. D'Oro , D. Giordano , M. Shah

Self-supervised learning has gained popularity because of its ability to avoid the cost of annotating large-scale datasets. It is capable of adopting self-defined pseudo labels as supervision and use the learned representations for several…

Computer Vision and Pattern Recognition · Computer Science 2021-02-09 Ashish Jaiswal , Ashwin Ramesh Babu , Mohammad Zaki Zadeh , Debapriya Banerjee , Fillia Makedon

Self-supervised learning of visual representations has been focusing on learning content features, which do not capture object motion or location, and focus on identifying and differentiating objects in images and videos. On the other hand,…

Computer Vision and Pattern Recognition · Computer Science 2023-07-25 Adrien Bardes , Jean Ponce , Yann LeCun

Recent advances in self-supervised learning have attracted significant attention from both machine learning and neuroscience. This is primarily because self-supervised methods do not require annotated supervisory information, making them…

Neurons and Cognition · Quantitative Biology 2025-12-05 Asaki Kataoka , Yoshihiro Nagano , Masafumi Oizumi

Pursuing realistic results according to human visual perception is the central concern in the image transformation tasks. Perceptual learning approaches like perceptual loss are empirically powerful for such tasks but they usually rely on…

Computer Vision and Pattern Recognition · Computer Science 2020-06-25 Kangfu Mei , Yao Lu , Qiaosi Yi , Haoyu Wu , Juncheng Li , Rui Huang

Learning discriminative representations of unlabelled data is a challenging task. Contrastive self-supervised learning provides a framework to learn meaningful representations using learned notions of similarity measures from simple pretext…

Computer Vision and Pattern Recognition · Computer Science 2023-01-04 Nicklas Boserup , Raghavendra Selvan

The objective of this paper is self-supervised learning from video, in particular for representations for action recognition. We make the following contributions: (i) We propose a new architecture and learning framework Memory-augmented…

Computer Vision and Pattern Recognition · Computer Science 2020-08-04 Tengda Han , Weidi Xie , Andrew Zisserman

Recent co-part segmentation methods mostly operate in a supervised learning setting, which requires a large amount of annotated data for training. To overcome this limitation, we propose a self-supervised deep learning method for co-part…

Computer Vision and Pattern Recognition · Computer Science 2021-04-12 Aliaksandr Siarohin , Subhankar Roy , Stéphane Lathuilière , Sergey Tulyakov , Elisa Ricci , Nicu Sebe

In recent years, contrastive learning achieves impressive results on self-supervised visual representation learning, but there still lacks a rigorous understanding of its learning dynamics. In this paper, we show that if we cast a…

Machine Learning · Computer Science 2023-03-09 Yifei Wang , Qi Zhang , Tianqi Du , Jiansheng Yang , Zhouchen Lin , Yisen Wang

As a subset of unsupervised representation learning, self-supervised representation learning adopts self-defined signals as supervision and uses the learned representation for downstream tasks, such as object detection and image captioning.…

Machine Learning · Computer Science 2021-03-24 Yao-Hung Hubert Tsai , Yue Wu , Ruslan Salakhutdinov , Louis-Philippe Morency

Contrastive learning has emerged as a transformative method for learning effective visual representations through the alignment of image and text embeddings. However, pairwise similarity computation in contrastive loss between image and…

Computer Vision and Pattern Recognition · Computer Science 2024-04-25 Sachin Mehta , Maxwell Horton , Fartash Faghri , Mohammad Hossein Sekhavat , Mahyar Najibi , Mehrdad Farajtabar , Oncel Tuzel , Mohammad Rastegari

Self-supervised video representation learning aimed at maximizing similarity between different temporal segments of one video, in order to enforce feature persistence over time. This leads to loss of pertinent information related to…

Computer Vision and Pattern Recognition · Computer Science 2023-05-12 Di Yang , Yaohui Wang , Quan Kong , Antitza Dantcheva , Lorenzo Garattoni , Gianpiero Francesca , Francois Bremond

Contrastive Learning has recently received interest due to its success in self-supervised representation learning in the computer vision domain. However, the origins of Contrastive Learning date as far back as the 1990s and its development…

Machine Learning · Computer Science 2020-10-29 Phuc H. Le-Khac , Graham Healy , Alan F. Smeaton

This paper presents SimCLR: a simple framework for contrastive learning of visual representations. We simplify recently proposed contrastive self-supervised learning algorithms without requiring specialized architectures or a memory bank.…

Machine Learning · Computer Science 2020-07-02 Ting Chen , Simon Kornblith , Mohammad Norouzi , Geoffrey Hinton

Self-supervised learning can extract representations of good quality from solely unlabeled data, which is appealing for point cloud videos due to their high labelling cost. In this paper, we propose a contrastive mask prediction (PointCMP)…

Computer Vision and Pattern Recognition · Computer Science 2023-05-09 Zhiqiang Shen , Xiaoxiao Sheng , Longguang Wang , Yulan Guo , Qiong Liu , Xi Zhou

Several multi-modality representation learning approaches such as LXMERT and ViLBERT have been proposed recently. Such approaches can achieve superior performance due to the high-level semantic information captured during large-scale…

Computer Vision and Pattern Recognition · Computer Science 2020-07-28 Lei Shi , Kai Shuang , Shijie Geng , Peng Su , Zhengkai Jiang , Peng Gao , Zuohui Fu , Gerard de Melo , Sen Su
‹ Prev 1 3 4 5 6 7 10 Next ›